2024-04-23T23:29:46.468 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T23:29:46.468 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477 --verbose --owner scheduled_teuthology@teuthology --description rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} --name teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/orig.config.yaml 2024-04-23T23:29:46.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T23:29:46.567 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} email: ceph-qa@ceph.com first_in_suite: false job_id: '7670477' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: rbd cache: true rbd cache policy: writearound global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9514 sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 sleep_before_teardown: 0 subset: 69/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4Qm8OHHD3nFiH9wmhLs1/HsIhL+1zDhRAP5dSUWyCihjvSs14Ye0v8U3saHXYriECacWuGp9HNuZAsHJ0xjzo= smithi170.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZdS+gFRsF6rwPQ79IgQ6kFfPsLLwSMKlMFxgzcrOiaZ0+EG66TteZ8cmzJqa0XbEUsENPLYHHxbN/zVGuiDns= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_21:16:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T23:29:46.567 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa; will attempt to use it 2024-04-23T23:29:46.568 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa/tasks 2024-04-23T23:29:46.568 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T23:29:46.570 INFO:teuthology.task.internal:Checking packages... 2024-04-23T23:29:46.594 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b98aab6c00f483888c049d0d8e7bc507e115dd86' 2024-04-23T23:29:46.594 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T23:29:46.595 INFO:teuthology.packaging:ref: None 2024-04-23T23:29:46.595 INFO:teuthology.packaging:tag: None 2024-04-23T23:29:46.595 INFO:teuthology.packaging:branch: squid 2024-04-23T23:29:46.595 INFO:teuthology.packaging:sha1: b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-23T23:29:46.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-04-23T23:29:46.900 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2424.gb98aab6c 2024-04-23T23:29:46.901 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T23:29:46.907 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T23:29:46.907 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T23:29:46.959 INFO:teuthology.task.internal:Saving configuration 2024-04-23T23:29:46.972 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T23:29:47.010 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T23:29:47.035 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 23:24:41.431134', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4Qm8OHHD3nFiH9wmhLs1/HsIhL+1zDhRAP5dSUWyCihjvSs14Ye0v8U3saHXYriECacWuGp9HNuZAsHJ0xjzo='} 2024-04-23T23:29:47.055 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi170.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 23:24:41.432887', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZdS+gFRsF6rwPQ79IgQ6kFfPsLLwSMKlMFxgzcrOiaZ0+EG66TteZ8cmzJqa0XbEUsENPLYHHxbN/zVGuiDns='} 2024-04-23T23:29:47.056 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T23:29:47.061 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-23T23:29:47.061 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-23T23:29:47.062 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T23:29:47.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb5f4e09e50>, signals=[15]) 2024-04-23T23:29:47.151 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T23:29:47.156 INFO:teuthology.task.internal:Opening connections... 2024-04-23T23:29:47.157 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:29:47.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T23:29:47.234 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:29:47.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T23:29:47.306 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T23:29:47.313 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-04-23T23:29:47.330 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-04-23T23:29:47.331 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T23:29:47.388 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-04-23T23:29:47.389 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-04-23T23:29:47.389 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T23:29:47.389 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-04-23T23:29:47.389 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T23:29:47.389 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T23:29:47.389 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T23:29:47.389 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-04-23T23:29:47.412 DEBUG:teuthology.orchestra.run.smithi170:> uname -m 2024-04-23T23:29:47.430 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2024-04-23T23:29:47.430 DEBUG:teuthology.orchestra.run.smithi170:> cat /etc/os-release 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="CentOS Stream" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="9" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:ID="centos" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="rhel fedora" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="9" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el9" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:LOGO="fedora-logo-icon" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://centos.org/" 2024-04-23T23:29:47.487 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-23T23:29:47.488 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-23T23:29:47.488 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-23T23:29:47.488 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2024-04-23T23:29:47.512 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T23:29:47.521 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T23:29:47.576 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T23:29:47.576 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-04-23T23:29:47.579 DEBUG:teuthology.orchestra.run.smithi170:> test '!' -e /home/ubuntu/cephtest 2024-04-23T23:29:47.595 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T23:29:47.610 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T23:29:47.610 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-04-23T23:29:47.635 DEBUG:teuthology.orchestra.run.smithi170:> test -z $(ls -A /var/lib/ceph) 2024-04-23T23:29:47.660 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T23:29:47.707 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T23:29:47.721 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-23T23:29:47.721 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-23T23:29:47.721 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T23:29:47.721 DEBUG:teuthology.orchestra.run.smithi170:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T23:29:47.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:29:47.737 DEBUG:teuthology.orchestra.run.smithi170:> uname -r 2024-04-23T23:29:47.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:29:47.738 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-04-23T23:29:47.793 INFO:teuthology.orchestra.run.smithi170.stdout:5.14.0-437.el9.x86_64 2024-04-23T23:29:47.793 INFO:teuthology.task.kernel:Running kernel on smithi170: 5.14.0-437.el9.x86_64 2024-04-23T23:29:47.793 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum install -y kernel 2024-04-23T23:29:47.796 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-437.el9.x86_64 2024-04-23T23:29:47.796 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-437.el9.x86_64 2024-04-23T23:29:47.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-04-23T23:29:50.017 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-23T23:29:50.270 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.0 MB 00:00 2024-04-23T23:29:51.832 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 26 MB/s | 19 MB 00:00 2024-04-23T23:29:51.998 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-23T23:29:56.257 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.2 MB 00:00 2024-04-23T23:29:57.900 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-23T23:29:57.953 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.2 MB 00:02 2024-04-23T23:29:59.353 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-23T23:30:00.445 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-23T23:30:04.476 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 17 kB/s | 1.7 kB 00:00 2024-04-23T23:30:04.720 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 5.0 MB/s | 21 MB 00:04 2024-04-23T23:30:06.348 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T23:30:06.349 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:30:06.432 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:30:06.432 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:30:06.534 DEBUG:teuthology.orchestra.run.smithi077:> echo no | sudo yum reinstall kernel || true 2024-04-23T23:30:07.031 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 11:30:04 PM UTC. 2024-04-23T23:30:07.176 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-23T23:30:07.185 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-23T23:30:07.186 INFO:teuthology.orchestra.run.smithi077.stderr:Operation aborted. 2024-04-23T23:30:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:Is this ok [y/N]: 2024-04-23T23:30:07.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum reinstall -y kernel || true 2024-04-23T23:30:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 11:30:04 PM UTC. 2024-04-23T23:30:07.843 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:30:07.843 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalling: 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:30:07.844 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 255 k 2024-04-23T23:30:07.845 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 0 2024-04-23T23:30:07.845 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:30:08.270 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.5 MB/s | 255 kB 00:00 2024-04-23T23:30:08.270 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:30:08.270 INFO:teuthology.orchestra.run.smithi077.stdout:Total 599 kB/s | 255 kB 00:00 2024-04-23T23:30:08.286 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:30:08.460 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:30:08.460 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:30:08.465 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:30:08.465 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:30:08.610 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:30:08.687 INFO:teuthology.orchestra.run.smithi077.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T23:30:08.688 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T23:30:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T23:30:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T23:30:09.845 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-23T23:30:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T23:30:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:30:10.048 INFO:teuthology.orchestra.run.smithi077.stdout:Reinstalled: 2024-04-23T23:30:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T23:30:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:30:10.048 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:30:10.209 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T23:30:10.256 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T23:30:10.256 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T23:30:10.256 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T23:30:10.256 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T23:30:10.257 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T23:30:10.289 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-04-23T23:30:10.308 DEBUG:teuthology.parallel:result is None 2024-04-23T23:30:11.685 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-23T23:30:11.685 INFO:teuthology.orchestra.run.smithi170.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-23T23:30:11.790 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:30:11.791 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:30:11.791 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:30:11.914 DEBUG:teuthology.orchestra.run.smithi170:> echo no | sudo yum reinstall kernel || true 2024-04-23T23:30:12.409 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:03 ago on Tue 23 Apr 2024 11:30:09 PM UTC. 2024-04-23T23:30:12.528 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:30:12.535 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:30:12.536 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:30:12.536 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:30:12.536 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 255 k 2024-04-23T23:30:12.536 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-04-23T23:30:12.536 INFO:teuthology.orchestra.run.smithi170.stderr:Operation aborted. 2024-04-23T23:30:12.595 INFO:teuthology.orchestra.run.smithi170.stdout:Is this ok [y/N]: 2024-04-23T23:30:12.596 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum reinstall -y kernel || true 2024-04-23T23:30:13.088 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:04 ago on Tue 23 Apr 2024 11:30:09 PM UTC. 2024-04-23T23:30:13.205 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalling: 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:30:13.206 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:30:13.207 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:30:13.207 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 255 k 2024-04-23T23:30:13.207 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 0 2024-04-23T23:30:13.207 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:30:13.422 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.6 MB/s | 255 kB 00:00 2024-04-23T23:30:13.422 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:30:13.422 INFO:teuthology.orchestra.run.smithi170.stdout:Total 1.2 MB/s | 255 kB 00:00 2024-04-23T23:30:13.441 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:30:13.614 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:30:13.614 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:30:13.619 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:30:13.619 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:30:13.733 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:30:13.815 INFO:teuthology.orchestra.run.smithi170.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T23:30:13.815 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T23:30:14.562 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T23:30:14.562 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-23T23:30:15.250 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-23T23:30:15.251 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:30:15.251 INFO:teuthology.orchestra.run.smithi170.stdout:Reinstalled: 2024-04-23T23:30:15.251 INFO:teuthology.orchestra.run.smithi170.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-23T23:30:15.251 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:30:15.251 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:30:15.451 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q kernel | sort -rV | head -n 1 2024-04-23T23:30:15.497 INFO:teuthology.orchestra.run.smithi170.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-23T23:30:15.497 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-23T23:30:15.497 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-23T23:30:15.497 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-23T23:30:15.498 DEBUG:teuthology.orchestra.run.smithi170:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T23:30:15.530 INFO:teuthology.orchestra.run.smithi170.stdout:ttyS1 2024-04-23T23:30:15.549 DEBUG:teuthology.parallel:result is None 2024-04-23T23:30:15.549 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T23:30:15.559 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T23:30:15.560 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T23:30:15.563 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T23:30:15.604 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T23:30:15.611 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T23:30:15.648 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T23:30:15.649 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T23:30:15.651 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T23:30:15.687 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T23:30:15.698 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T23:30:15.698 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T23:30:15.725 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T23:30:15.785 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T23:30:15.794 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T23:30:15.807 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T23:30:15.818 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T23:30:15.820 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T23:30:15.828 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T23:30:15.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T23:30:15.830 DEBUG:teuthology.orchestra.run.smithi170:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T23:30:15.854 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T23:30:15.863 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T23:30:15.863 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T23:30:15.897 DEBUG:teuthology.orchestra.run.smithi170:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T23:30:15.911 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T23:30:15.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T23:30:16.040 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T23:30:16.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T23:30:16.163 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:30:16.163 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T23:30:16.227 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T23:30:16.263 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T23:30:16.314 DEBUG:teuthology.orchestra.run.smithi170:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T23:30:16.393 DEBUG:teuthology.orchestra.run.smithi170:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T23:30:16.435 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:30:16.435 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T23:30:16.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-04-23T23:30:16.502 DEBUG:teuthology.orchestra.run.smithi170:> sudo service rsyslog restart 2024-04-23T23:30:16.540 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T23:30:16.576 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T23:30:17.058 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T23:30:17.066 INFO:teuthology.task.internal:Starting timer... 2024-04-23T23:30:17.066 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T23:30:17.092 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T23:30:17.141 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-23T23:30:17.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-04-23T23:30:17.215 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-04-23T23:30:17.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo service auditd rotate 2024-04-23T23:30:17.266 INFO:teuthology.orchestra.run.smithi170.stdout:Rotating logs: 2024-04-23T23:30:17.268 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T23:30:17.268 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-04-23T23:30:17.289 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-04-23T23:30:17.289 DEBUG:teuthology.orchestra.run.smithi170:> /usr/sbin/getenforce 2024-04-23T23:30:17.314 INFO:teuthology.orchestra.run.smithi170.stdout:Permissive 2024-04-23T23:30:17.315 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi170.front.sepia.ceph.com': 'permissive'} 2024-04-23T23:30:17.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T23:30:17.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:30:17.356 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T23:30:17.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:30:17.382 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T23:30:17.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-04-23T23:30:17.421 DEBUG:teuthology.orchestra.run.smithi170:> sudo /usr/sbin/setenforce permissive 2024-04-23T23:30:17.450 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T23:30:17.462 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-23T23:30:17.468 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-23T23:30:17.648 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T23:30:17.662 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T23:30:17.663 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi170.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T23:33:42.220 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi170.front.sepia.ceph.com')] 2024-04-23T23:33:42.222 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-23T23:33:42.223 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T23:33:42.298 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-04-23T23:33:42.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-04-23T23:33:42.373 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-23T23:33:42.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi170.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T23:33:42.443 DEBUG:teuthology.orchestra.run.smithi170:> true 2024-04-23T23:33:42.520 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi170.front.sepia.ceph.com' 2024-04-23T23:33:42.521 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T23:33:42.531 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T23:33:42.531 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T23:33:42.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T23:33:42.534 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T23:33:42.534 DEBUG:teuthology.orchestra.run.smithi170:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T23:33:42.558 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T23:33:42.572 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T23:33:42.588 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-23T23:33:42.595 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-04-23T23:33:42.601 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-23T23:33:42.605 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-04-23T23:33:42.618 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T23:33:42.623 INFO:teuthology.orchestra.run.smithi170.stderr:sudo: ntpd: command not found 2024-04-23T23:33:42.631 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T23:33:42.633 INFO:teuthology.orchestra.run.smithi170.stdout:506 Cannot talk to daemon 2024-04-23T23:33:42.646 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-23T23:33:42.659 INFO:teuthology.orchestra.run.smithi170.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-23T23:33:42.693 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-23T23:33:42.695 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T23:33:42.696 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-23T23:33:42.696 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.696 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.696 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.696 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.716 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-23T23:33:42.719 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T23:33:42.720 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-23T23:33:42.720 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.720 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.720 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.720 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:33:42.720 INFO:teuthology.run_tasks:Running task install... 2024-04-23T23:33:42.728 DEBUG:teuthology.task.install:project ceph 2024-04-23T23:33:42.728 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}} 2024-04-23T23:33:42.729 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'} 2024-04-23T23:33:42.729 INFO:teuthology.task.install:Using flavor: default 2024-04-23T23:33:42.734 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T23:33:42.734 INFO:teuthology.task.install:extra packages: [] 2024-04-23T23:33:42.734 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-23T23:33:42.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-23T23:33:42.736 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'tag': None, 'wait_for_package': False} 2024-04-23T23:33:42.736 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-23T23:33:42.875 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-23T23:33:42.875 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-23T23:33:42.944 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/ 2024-04-23T23:33:42.945 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2424.gb98aab6c 2024-04-23T23:33:43.042 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T23:33:43.042 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:33:43.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T23:33:43.066 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T23:33:43.066 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T23:33:43.110 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/b98aab6c00f483888c049d0d8e7bc507e115dd86/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-23T23:33:43.110 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:33:43.110 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-23T23:33:43.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T23:33:43.136 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-23T23:33:43.136 DEBUG:teuthology.orchestra.run.smithi170:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b98aab6c00f483888c049d0d8e7bc507e115dd86/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-23T23:33:43.203 DEBUG:teuthology.orchestra.run.smithi170:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-23T23:33:43.204 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T23:33:43.267 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-04-23T23:33:43.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-04-23T23:33:43.276 DEBUG:teuthology.orchestra.run.smithi170:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-23T23:33:43.340 INFO:teuthology.orchestra.run.smithi170.stdout:check_obsoletes = 1 2024-04-23T23:33:43.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum clean all 2024-04-23T23:33:43.493 INFO:teuthology.orchestra.run.smithi077.stdout:48 files removed 2024-04-23T23:33:43.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw 2024-04-23T23:33:43.566 INFO:teuthology.orchestra.run.smithi170.stdout:48 files removed 2024-04-23T23:33:43.593 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-radosgw 2024-04-23T23:33:44.182 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 206 kB/s | 83 kB 00:00 2024-04-23T23:33:44.215 INFO:teuthology.orchestra.run.smithi170.stdout:ceph packages for x86_64 227 kB/s | 83 kB 00:00 2024-04-23T23:33:44.591 INFO:teuthology.orchestra.run.smithi170.stdout:ceph noarch packages 35 kB/s | 11 kB 00:00 2024-04-23T23:33:44.599 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 31 kB/s | 11 kB 00:00 2024-04-23T23:33:44.966 INFO:teuthology.orchestra.run.smithi170.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2024-04-23T23:33:45.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-04-23T23:33:45.809 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-04-23T23:33:46.408 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.0 MB 00:01 2024-04-23T23:33:47.768 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-23T23:33:48.134 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-23T23:33:52.028 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.2 MB 00:00 2024-04-23T23:33:52.802 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.2 MB 00:01 2024-04-23T23:33:55.538 INFO:teuthology.orchestra.run.smithi170.stdout:CentOS Stream 9 - Extras packages 10 kB/s | 16 kB 00:01 2024-04-23T23:34:14.831 INFO:teuthology.orchestra.run.smithi170.stdout:Extra Packages for Enterprise Linux 1.1 MB/s | 21 MB 00:19 2024-04-23T23:34:19.827 INFO:teuthology.orchestra.run.smithi170.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-23T23:34:21.994 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:34:21.996 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrading: 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-23T23:34:21.997 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T23:34:21.998 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout:Installing weak dependencies: 2024-04-23T23:34:21.999 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T23:34:22.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:34:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:34:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:Install 30 Packages 2024-04-23T23:34:22.000 INFO:teuthology.orchestra.run.smithi170.stdout:Upgrade 2 Packages 2024-04-23T23:34:22.000 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:22.001 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 60 M 2024-04-23T23:34:22.001 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:34:22.887 INFO:teuthology.orchestra.run.smithi170.stdout:(1/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 7.9 MB/s | 5.4 MB 00:00 2024-04-23T23:34:22.945 INFO:teuthology.orchestra.run.smithi170.stdout:(2/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 432 kB/s | 25 kB 00:00 2024-04-23T23:34:23.070 INFO:teuthology.orchestra.run.smithi170.stdout:(3/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 5.8 MB/s | 745 kB 00:00 2024-04-23T23:34:23.204 INFO:teuthology.orchestra.run.smithi170.stdout:(4/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9. 10 MB/s | 10 MB 00:00 2024-04-23T23:34:23.229 INFO:teuthology.orchestra.run.smithi170.stdout:(5/32): libradosstriper1-19.0.0-2424.gb98aab6c. 3.1 MB/s | 501 kB 00:00 2024-04-23T23:34:23.287 INFO:teuthology.orchestra.run.smithi170.stdout:(6/32): python3-ceph-argparse-19.0.0-2424.gb98a 773 kB/s | 45 kB 00:00 2024-04-23T23:34:23.355 INFO:teuthology.orchestra.run.smithi170.stdout:(7/32): python3-ceph-common-19.0.0-2424.gb98aab 1.9 MB/s | 133 kB 00:00 2024-04-23T23:34:23.430 INFO:teuthology.orchestra.run.smithi170.stdout:(8/32): python3-cephfs-19.0.0-2424.gb98aab6c.el 2.1 MB/s | 162 kB 00:00 2024-04-23T23:34:23.530 INFO:teuthology.orchestra.run.smithi170.stdout:(9/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_6 16 MB/s | 5.3 MB 00:00 2024-04-23T23:34:23.555 INFO:teuthology.orchestra.run.smithi170.stdout:(10/32): python3-rados-19.0.0-2424.gb98aab6c.el 2.5 MB/s | 321 kB 00:00 2024-04-23T23:34:23.589 INFO:teuthology.orchestra.run.smithi170.stdout:(11/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 5.0 MB/s | 299 kB 00:00 2024-04-23T23:34:23.614 INFO:teuthology.orchestra.run.smithi170.stdout:(12/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.7 MB/s | 99 kB 00:00 2024-04-23T23:34:23.756 INFO:teuthology.orchestra.run.smithi170.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 641 kB/s | 107 kB 00:00 2024-04-23T23:34:23.781 INFO:teuthology.orchestra.run.smithi170.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 959 kB/s | 160 kB 00:00 2024-04-23T23:34:23.823 INFO:teuthology.orchestra.run.smithi170.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 676 kB/s | 45 kB 00:00 2024-04-23T23:34:23.907 INFO:teuthology.orchestra.run.smithi170.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-23T23:34:23.957 INFO:teuthology.orchestra.run.smithi170.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 845 kB/s | 42 kB 00:00 2024-04-23T23:34:23.991 INFO:teuthology.orchestra.run.smithi170.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.1 MB/s | 662 kB 00:00 2024-04-23T23:34:24.041 INFO:teuthology.orchestra.run.smithi170.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-23T23:34:24.067 INFO:teuthology.orchestra.run.smithi170.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-04-23T23:34:24.092 INFO:teuthology.orchestra.run.smithi170.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-04-23T23:34:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 530 B/s | 16 kB 00:31 2024-04-23T23:34:24.467 INFO:teuthology.orchestra.run.smithi170.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 771 kB/s | 309 kB 00:00 2024-04-23T23:34:24.542 INFO:teuthology.orchestra.run.smithi170.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 348 kB/s | 26 kB 00:00 2024-04-23T23:34:24.742 INFO:teuthology.orchestra.run.smithi170.stdout:(24/32): ceph-common-19.0.0-2424.gb98aab6c.el9. 8.3 MB/s | 21 MB 00:02 2024-04-23T23:34:24.769 INFO:teuthology.orchestra.run.smithi170.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 215 kB/s | 49 kB 00:00 2024-04-23T23:34:24.819 INFO:teuthology.orchestra.run.smithi170.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 914 kB/s | 67 kB 00:00 2024-04-23T23:34:24.928 INFO:teuthology.orchestra.run.smithi170.stdout:(27/32): libarrow-9.0.0-10.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-04-23T23:34:24.953 INFO:teuthology.orchestra.run.smithi170.stdout:(28/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.5 MB/s | 838 kB 00:00 2024-04-23T23:34:24.978 INFO:teuthology.orchestra.run.smithi170.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-23T23:34:25.070 INFO:teuthology.orchestra.run.smithi170.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-23T23:34:25.270 INFO:teuthology.orchestra.run.smithi170.stdout:(31/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 11 MB/s | 3.1 MB 00:00 2024-04-23T23:34:25.362 INFO:teuthology.orchestra.run.smithi170.stdout:(32/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 8.8 MB/s | 3.4 MB 00:00 2024-04-23T23:34:25.366 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:34:25.366 INFO:teuthology.orchestra.run.smithi170.stdout:Total 18 MB/s | 60 MB 00:03 2024-04-23T23:34:25.460 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:34:25.496 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:34:25.496 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:34:25.822 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-23T23:34:25.959 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:34:25.960 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:34:27.451 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:34:27.537 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-23T23:34:27.575 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-23T23:34:27.600 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-23T23:34:27.623 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T23:34:27.650 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T23:34:27.790 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T23:34:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T23:34:28.240 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-23T23:34:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-23T23:34:28.412 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-23T23:34:28.501 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-23T23:34:28.529 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-23T23:34:28.592 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-23T23:34:28.629 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-23T23:34:28.673 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-23T23:34:28.741 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-23T23:34:28.765 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-23T23:34:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-23T23:34:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-23T23:34:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-23T23:34:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-23T23:34:29.029 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-23T23:34:29.056 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-23T23:34:29.085 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-23T23:34:29.118 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-23T23:34:29.431 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-23T23:34:29.473 INFO:teuthology.orchestra.run.smithi170.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-23T23:34:29.562 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-23T23:34:29.594 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-23T23:34:29.638 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-23T23:34:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-23T23:34:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-23T23:34:30.204 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-23T23:34:30.273 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-23T23:34:30.302 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-23T23:34:30.928 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-04-23T23:34:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-23T23:34:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-23T23:34:33.145 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:34:33.147 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 10 M 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.4 M 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.4 M 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 21 M 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 25 k 2024-04-23T23:34:33.148 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 745 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 501 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 5.3 M 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 45 k 2024-04-23T23:34:33.149 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 133 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 162 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 321 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 299 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 99 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:34:33.150 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:34:33.151 INFO:teuthology.orchestra.run.smithi077.stdout:Install 30 Packages 2024-04-23T23:34:33.151 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-04-23T23:34:33.151 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:33.151 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 60 M 2024-04-23T23:34:33.151 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:34:33.157 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-23T23:34:33.203 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-23T23:34:33.303 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-23T23:34:33.303 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T23:34:33.303 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T23:34:33.304 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:33.337 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-23T23:34:35.146 INFO:teuthology.orchestra.run.smithi077.stdout:(1/32): ceph-common-19.0.0-2424.gb98aab6c.el9.x 13 MB/s | 21 MB 00:01 2024-04-23T23:34:35.221 INFO:teuthology.orchestra.run.smithi077.stdout:(2/32): ceph-base-19.0.0-2424.gb98aab6c.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-04-23T23:34:35.246 INFO:teuthology.orchestra.run.smithi077.stdout:(3/32): ceph-selinux-19.0.0-2424.gb98aab6c.el9. 251 kB/s | 25 kB 00:00 2024-04-23T23:34:35.313 INFO:teuthology.orchestra.run.smithi077.stdout:(4/32): libradosstriper1-19.0.0-2424.gb98aab6c. 7.4 MB/s | 501 kB 00:00 2024-04-23T23:34:35.380 INFO:teuthology.orchestra.run.smithi077.stdout:(5/32): libcephfs2-19.0.0-2424.gb98aab6c.el9.x8 4.6 MB/s | 745 kB 00:00 2024-04-23T23:34:35.481 INFO:teuthology.orchestra.run.smithi077.stdout:(6/32): python3-ceph-argparse-19.0.0-2424.gb98a 451 kB/s | 45 kB 00:00 2024-04-23T23:34:35.564 INFO:teuthology.orchestra.run.smithi077.stdout:(7/32): python3-ceph-common-19.0.0-2424.gb98aab 1.6 MB/s | 133 kB 00:00 2024-04-23T23:34:35.631 INFO:teuthology.orchestra.run.smithi077.stdout:(8/32): librgw2-19.0.0-2424.gb98aab6c.el9.x86_6 17 MB/s | 5.3 MB 00:00 2024-04-23T23:34:35.656 INFO:teuthology.orchestra.run.smithi077.stdout:(9/32): python3-cephfs-19.0.0-2424.gb98aab6c.el 1.7 MB/s | 162 kB 00:00 2024-04-23T23:34:35.681 INFO:teuthology.orchestra.run.smithi077.stdout:(10/32): python3-rados-19.0.0-2424.gb98aab6c.el 6.3 MB/s | 321 kB 00:00 2024-04-23T23:34:35.724 INFO:teuthology.orchestra.run.smithi077.stdout:(11/32): python3-rbd-19.0.0-2424.gb98aab6c.el9. 4.4 MB/s | 299 kB 00:00 2024-04-23T23:34:35.749 INFO:teuthology.orchestra.run.smithi077.stdout:(12/32): python3-rgw-19.0.0-2424.gb98aab6c.el9. 1.4 MB/s | 99 kB 00:00 2024-04-23T23:34:35.974 INFO:teuthology.orchestra.run.smithi077.stdout:(13/32): ceph-radosgw-19.0.0-2424.gb98aab6c.el9 4.3 MB/s | 10 MB 00:02 2024-04-23T23:34:35.999 INFO:teuthology.orchestra.run.smithi077.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 388 kB/s | 107 kB 00:00 2024-04-23T23:34:36.025 INFO:teuthology.orchestra.run.smithi077.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 581 kB/s | 160 kB 00:00 2024-04-23T23:34:36.050 INFO:teuthology.orchestra.run.smithi077.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 601 kB/s | 45 kB 00:00 2024-04-23T23:34:36.100 INFO:teuthology.orchestra.run.smithi077.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 849 kB/s | 42 kB 00:00 2024-04-23T23:34:36.142 INFO:teuthology.orchestra.run.smithi077.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-04-23T23:34:36.193 INFO:teuthology.orchestra.run.smithi077.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.7 MB/s | 292 kB 00:00 2024-04-23T23:34:36.218 INFO:teuthology.orchestra.run.smithi077.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 475 kB/s | 36 kB 00:00 2024-04-23T23:34:36.243 INFO:teuthology.orchestra.run.smithi077.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-04-23T23:34:36.277 INFO:teuthology.orchestra.run.smithi077.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 566 kB/s | 47 kB 00:00 2024-04-23T23:34:36.460 INFO:teuthology.orchestra.run.smithi077.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 199 kB/s | 26 kB 00:00 2024-04-23T23:34:36.486 INFO:teuthology.orchestra.run.smithi077.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.1 MB/s | 309 kB 00:00 2024-04-23T23:34:36.520 INFO:teuthology.orchestra.run.smithi077.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 822 kB/s | 49 kB 00:00 2024-04-23T23:34:36.545 INFO:teuthology.orchestra.run.smithi077.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-23T23:34:36.595 INFO:teuthology.orchestra.run.smithi077.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-04-23T23:34:36.670 INFO:teuthology.orchestra.run.smithi077.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-04-23T23:34:36.704 INFO:teuthology.orchestra.run.smithi077.stdout:(29/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.4 MB/s | 838 kB 00:00 2024-04-23T23:34:36.746 INFO:teuthology.orchestra.run.smithi077.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-23T23:34:36.955 INFO:teuthology.orchestra.run.smithi077.stdout:(31/32): librbd1-19.0.0-2424.gb98aab6c.el9.x86_ 13 MB/s | 3.1 MB 00:00 2024-04-23T23:34:37.255 INFO:teuthology.orchestra.run.smithi077.stdout:(32/32): librados2-19.0.0-2424.gb98aab6c.el9.x8 5.8 MB/s | 3.4 MB 00:00 2024-04-23T23:34:37.260 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:34:37.261 INFO:teuthology.orchestra.run.smithi077.stdout:Total 15 MB/s | 60 MB 00:04 2024-04-23T23:34:37.362 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:34:37.399 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:34:37.399 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:34:37.866 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:34:37.868 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:34:39.368 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:34:39.456 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-23T23:34:39.485 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-04-23T23:34:39.510 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-04-23T23:34:39.533 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T23:34:39.556 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-04-23T23:34:39.717 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T23:34:39.770 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-04-23T23:34:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-04-23T23:34:40.229 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-23T23:34:40.330 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-23T23:34:40.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 8/34 2024-04-23T23:34:40.447 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-23T23:34:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 9/34 2024-04-23T23:34:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-04-23T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 11/34 2024-04-23T23:34:40.661 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-23T23:34:40.683 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-23T23:34:40.730 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 13/34 2024-04-23T23:34:40.765 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-04-23T23:34:40.875 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-04-23T23:34:40.907 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-04-23T23:34:40.947 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-04-23T23:34:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-04-23T23:34:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-04-23T23:34:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-04-23T23:34:41.351 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-04-23T23:34:41.389 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-23T23:34:41.478 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 22/34 2024-04-23T23:34:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 23/34 2024-04-23T23:34:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-23T23:34:42.019 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-23T23:34:42.042 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-23T23:34:42.113 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 26/34 2024-04-23T23:34:42.198 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 27/34 2024-04-23T23:34:42.228 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 28/34 2024-04-23T23:34:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-23T23:34:42.819 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /sys 2024-04-23T23:34:42.819 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /proc 2024-04-23T23:34:42.819 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /mnt 2024-04-23T23:34:42.820 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /var/tmp 2024-04-23T23:34:42.820 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /home 2024-04-23T23:34:42.820 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /root 2024-04-23T23:34:42.820 INFO:teuthology.orchestra.run.smithi170.stdout:skipping the directory /tmp 2024-04-23T23:34:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-23T23:34:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-23T23:34:43.796 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:34:43.796 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T23:34:43.796 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T23:34:43.796 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T23:34:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T23:34:43.865 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T23:34:43.865 INFO:teuthology.orchestra.run.smithi170.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T23:34:44.522 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-23T23:34:44.608 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-23T23:34:45.089 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T23:34:45.089 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-23T23:34:45.089 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-23T23:34:45.089 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-23T23:34:45.089 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-23T23:34:45.090 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-23T23:34:45.091 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-23T23:34:45.092 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-23T23:34:45.092 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-23T23:34:45.092 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-23T23:34:45.149 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 29/34 2024-04-23T23:34:45.188 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-23T23:34:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 30/34 2024-04-23T23:34:45.287 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-23T23:34:45.287 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-23T23:34:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:45.315 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-23T23:34:45.894 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout:Upgraded: 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T23:34:45.895 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.896 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:45.897 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:34:46.170 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-test 2024-04-23T23:34:46.733 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:27 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:34:46.856 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:34:46.856 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:34:46.856 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:34:46.856 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout:Install 4 Packages 2024-04-23T23:34:46.857 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:34:46.858 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 49 M 2024-04-23T23:34:46.858 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 207 M 2024-04-23T23:34:46.858 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:34:47.191 INFO:teuthology.orchestra.run.smithi170.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.4 MB/s | 305 kB 00:00 2024-04-23T23:34:47.241 INFO:teuthology.orchestra.run.smithi170.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-23T23:34:49.227 INFO:teuthology.orchestra.run.smithi170.stdout:(3/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 73 kB/s | 163 kB 00:02 2024-04-23T23:34:53.268 INFO:teuthology.orchestra.run.smithi170.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 7.7 MB/s | 48 MB 00:06 2024-04-23T23:34:53.270 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:34:53.270 INFO:teuthology.orchestra.run.smithi170.stdout:Total 7.6 MB/s | 49 MB 00:06 2024-04-23T23:34:53.296 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:34:53.317 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:34:53.317 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:34:53.685 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:34:53.685 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:34:54.200 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:34:54.269 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-23T23:34:54.318 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-23T23:34:54.345 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-04-23T23:34:54.777 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:55.724 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-23T23:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/34 2024-04-23T23:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-23T23:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T23:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-23T23:34:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T23:34:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-23T23:34:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T23:34:57.070 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_6 6/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 7/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9. 8/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x8 9/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 10/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 11/34 2024-04-23T23:34:57.071 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 12/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 13/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-23T23:34:57.072 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 31/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-23T23:34:57.073 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/34 2024-04-23T23:34:57.852 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-23T23:34:57.853 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.854 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-3.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:57.855 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:34:58.103 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-test 2024-04-23T23:34:58.634 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:28 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:34:58.755 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:34:58.755 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:34:58.755 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:34:58.755 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:34:58.755 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 48 M 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 163 k 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-04-23T23:34:58.756 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:34:58.757 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 49 M 2024-04-23T23:34:58.757 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 207 M 2024-04-23T23:34:58.757 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:34:58.854 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-23T23:34:58.933 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-23T23:34:59.227 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): libcephsqlite-19.0.0-2424.gb98aab6c.el9. 407 kB/s | 163 kB 00:00 2024-04-23T23:34:59.423 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 505 kB/s | 305 kB 00:00 2024-04-23T23:34:59.575 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 180 kB/s | 64 kB 00:00 2024-04-23T23:35:01.362 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-23T23:35:01.362 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-23T23:35:01.362 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-23T23:35:01.363 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-23T23:35:01.641 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-23T23:35:01.641 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:01.641 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:01.641 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:01.642 INFO:teuthology.orchestra.run.smithi170.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:01.642 INFO:teuthology.orchestra.run.smithi170.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T23:35:01.642 INFO:teuthology.orchestra.run.smithi170.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T23:35:01.642 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:01.642 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:01.901 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph 2024-04-23T23:35:01.974 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): ceph-test-19.0.0-2424.gb98aab6c.el9.x86_ 15 MB/s | 48 MB 00:03 2024-04-23T23:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:01.976 INFO:teuthology.orchestra.run.smithi077.stdout:Total 15 MB/s | 49 MB 00:03 2024-04-23T23:35:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:02.022 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:02.023 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:02.386 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:02.387 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:02.401 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:43 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:02.527 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:02.529 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T23:35:02.530 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T23:35:02.531 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T23:35:02.532 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout:Install 36 Packages 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 30 M 2024-04-23T23:35:02.533 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 107 M 2024-04-23T23:35:02.534 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:02.898 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:02.983 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-23T23:35:03.022 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-23T23:35:03.050 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-23T23:35:03.378 INFO:teuthology.orchestra.run.smithi170.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-04-23T23:35:03.570 INFO:teuthology.orchestra.run.smithi170.stdout:(2/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-04-23T23:35:03.862 INFO:teuthology.orchestra.run.smithi170.stdout:(3/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 2.3 MB/s | 1.5 MB 00:00 2024-04-23T23:35:03.979 INFO:teuthology.orchestra.run.smithi170.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 2.1 MB/s | 249 kB 00:00 2024-04-23T23:35:04.163 INFO:teuthology.orchestra.run.smithi170.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-04-23T23:35:04.471 INFO:teuthology.orchestra.run.smithi170.stdout:(6/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86_ 19 MB/s | 17 MB 00:00 2024-04-23T23:35:04.538 INFO:teuthology.orchestra.run.smithi170.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 3.3 MB/s | 1.2 MB 00:00 2024-04-23T23:35:04.638 INFO:teuthology.orchestra.run.smithi170.stdout:(8/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86_ 3.7 MB/s | 4.7 MB 00:01 2024-04-23T23:35:04.655 INFO:teuthology.orchestra.run.smithi170.stdout:(9/36): python3-ply-3.11-14.el9.noarch.rpm 580 kB/s | 106 kB 00:00 2024-04-23T23:35:04.681 INFO:teuthology.orchestra.run.smithi170.stdout:(10/36): python3-pycparser-2.20-6.el9.noarch.rp 950 kB/s | 135 kB 00:00 2024-04-23T23:35:04.739 INFO:teuthology.orchestra.run.smithi170.stdout:(11/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.5 MB/s | 215 kB 00:00 2024-04-23T23:35:04.823 INFO:teuthology.orchestra.run.smithi170.stdout:(12/36): python3-requests-2.25.1-8.el9.noarch.r 678 kB/s | 125 kB 00:00 2024-04-23T23:35:04.848 INFO:teuthology.orchestra.run.smithi170.stdout:(13/36): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-04-23T23:35:04.873 INFO:teuthology.orchestra.run.smithi170.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 689 kB/s | 35 kB 00:00 2024-04-23T23:35:04.899 INFO:teuthology.orchestra.run.smithi170.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-04-23T23:35:04.924 INFO:teuthology.orchestra.run.smithi170.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-04-23T23:35:04.949 INFO:teuthology.orchestra.run.smithi170.stdout:(17/36): python3-pytz-2021.1-5.el9.noarch.rpm 506 kB/s | 51 kB 00:00 2024-04-23T23:35:05.041 INFO:teuthology.orchestra.run.smithi170.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-04-23T23:35:05.417 INFO:teuthology.orchestra.run.smithi170.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 93 kB/s | 43 kB 00:00 2024-04-23T23:35:05.500 INFO:teuthology.orchestra.run.smithi170.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 262 kB/s | 151 kB 00:00 2024-04-23T23:35:05.609 INFO:teuthology.orchestra.run.smithi170.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 98 kB/s | 11 kB 00:00 2024-04-23T23:35:05.634 INFO:teuthology.orchestra.run.smithi170.stdout:(22/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 317 kB/s | 172 kB 00:00 2024-04-23T23:35:05.718 INFO:teuthology.orchestra.run.smithi170.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 163 kB/s | 18 kB 00:00 2024-04-23T23:35:05.743 INFO:teuthology.orchestra.run.smithi170.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 213 kB/s | 23 kB 00:00 2024-04-23T23:35:05.768 INFO:teuthology.orchestra.run.smithi170.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.0 MB/s | 358 kB 00:00 2024-04-23T23:35:05.818 INFO:teuthology.orchestra.run.smithi170.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 194 kB/s | 19 kB 00:00 2024-04-23T23:35:05.844 INFO:teuthology.orchestra.run.smithi170.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 196 kB/s | 20 kB 00:00 2024-04-23T23:35:05.877 INFO:teuthology.orchestra.run.smithi170.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 425 kB/s | 46 kB 00:00 2024-04-23T23:35:05.936 INFO:teuthology.orchestra.run.smithi170.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 672 kB/s | 79 kB 00:00 2024-04-23T23:35:05.978 INFO:teuthology.orchestra.run.smithi170.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 164 kB/s | 16 kB 00:00 2024-04-23T23:35:06.028 INFO:teuthology.orchestra.run.smithi170.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-04-23T23:35:06.070 INFO:teuthology.orchestra.run.smithi170.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 673 kB/s | 90 kB 00:00 2024-04-23T23:35:06.095 INFO:teuthology.orchestra.run.smithi170.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 305 kB/s | 36 kB 00:00 2024-04-23T23:35:06.154 INFO:teuthology.orchestra.run.smithi170.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-04-23T23:35:06.196 INFO:teuthology.orchestra.run.smithi170.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2024-04-23T23:35:06.329 INFO:teuthology.orchestra.run.smithi170.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.6 MB/s | 427 kB 00:00 2024-04-23T23:35:06.333 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:06.333 INFO:teuthology.orchestra.run.smithi170.stdout:Total 7.9 MB/s | 30 MB 00:03 2024-04-23T23:35:06.472 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:06.511 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:06.511 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:06.807 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:06.807 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:07.566 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/4 2024-04-23T23:35:07.630 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-23T23:35:08.053 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:08.124 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-23T23:35:08.156 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-23T23:35:08.184 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-23T23:35:08.255 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-23T23:35:08.300 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-23T23:35:08.333 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-23T23:35:08.426 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-23T23:35:08.512 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-23T23:35:08.552 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-23T23:35:08.587 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-23T23:35:08.617 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-23T23:35:08.652 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-23T23:35:08.685 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-23T23:35:08.726 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-23T23:35:08.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-23T23:35:08.803 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-23T23:35:08.841 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-23T23:35:08.915 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-23T23:35:09.056 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-23T23:35:09.142 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-23T23:35:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-23T23:35:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-23T23:35:09.291 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-23T23:35:09.346 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-23T23:35:09.534 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-23T23:35:09.587 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-23T23:35:09.666 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-23T23:35:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-23T23:35:09.811 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-23T23:35:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-23T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/4 2024-04-23T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/4 2024-04-23T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/4 2024-04-23T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-23T23:35:10.088 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-23T23:35:10.114 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-23T23:35:10.139 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-23T23:35:10.139 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:10.139 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T23:35:10.139 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T23:35:10.139 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T23:35:10.139 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-23T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-23T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-23T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:10.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph 2024-04-23T23:35:11.020 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:41 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:11.147 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:11.149 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 6.6 k 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 2.4 M 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 1.5 M 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 249 k 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 4.7 M 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 17 M 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-23T23:35:11.150 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-23T23:35:11.151 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-23T23:35:11.152 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-23T23:35:11.153 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-23T23:35:11.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:11.153 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:11.153 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:11.153 INFO:teuthology.orchestra.run.smithi077.stdout:Install 36 Packages 2024-04-23T23:35:11.153 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:11.154 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 30 M 2024-04-23T23:35:11.154 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 107 M 2024-04-23T23:35:11.154 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:11.589 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-23T23:35:11.616 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-23T23:35:11.616 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:11.616 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T23:35:11.616 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T23:35:11.616 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T23:35:11.617 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:12.057 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-23T23:35:12.080 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-23T23:35:12.080 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:12.080 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T23:35:12.080 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T23:35:12.080 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T23:35:12.080 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:12.307 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-23T23:35:12.330 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-23T23:35:12.330 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:12.330 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T23:35:12.331 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T23:35:12.331 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T23:35:12.331 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:12.403 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-23T23:35:12.492 INFO:teuthology.orchestra.run.smithi077.stdout:(1/36): ceph-19.0.0-2424.gb98aab6c.el9.x86_64.r 17 kB/s | 6.6 kB 00:00 2024-04-23T23:35:13.284 INFO:teuthology.orchestra.run.smithi077.stdout:(2/36): ceph-mgr-19.0.0-2424.gb98aab6c.el9.x86_ 1.3 MB/s | 1.5 MB 00:01 2024-04-23T23:35:13.801 INFO:teuthology.orchestra.run.smithi077.stdout:(3/36): ceph-mds-19.0.0-2424.gb98aab6c.el9.x86_ 1.4 MB/s | 2.4 MB 00:01 2024-04-23T23:35:13.960 INFO:teuthology.orchestra.run.smithi077.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2424.gb98a 1.5 MB/s | 249 kB 00:00 2024-04-23T23:35:14.085 INFO:teuthology.orchestra.run.smithi077.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-04-23T23:35:14.099 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-23T23:35:14.099 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-23T23:35:14.099 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-23T23:35:14.099 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-23T23:35:14.100 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-23T23:35:14.101 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-23T23:35:14.102 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-23T23:35:14.102 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-23T23:35:14.102 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-23T23:35:14.102 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-23T23:35:14.177 INFO:teuthology.orchestra.run.smithi077.stdout:(6/36): python3-cryptography-36.0.1-4.el9.x86_6 13 MB/s | 1.2 MB 00:00 2024-04-23T23:35:14.219 INFO:teuthology.orchestra.run.smithi077.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-23T23:35:14.261 INFO:teuthology.orchestra.run.smithi077.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-04-23T23:35:14.303 INFO:teuthology.orchestra.run.smithi077.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.9 MB/s | 125 kB 00:00 2024-04-23T23:35:14.345 INFO:teuthology.orchestra.run.smithi077.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 5.0 MB/s | 215 kB 00:00 2024-04-23T23:35:14.387 INFO:teuthology.orchestra.run.smithi077.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-04-23T23:35:14.429 INFO:teuthology.orchestra.run.smithi077.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 4.0 MB/s | 172 kB 00:00 2024-04-23T23:35:14.462 INFO:teuthology.orchestra.run.smithi077.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 1.0 MB/s | 35 kB 00:00 2024-04-23T23:35:14.496 INFO:teuthology.orchestra.run.smithi077.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.5 MB/s | 51 kB 00:00 2024-04-23T23:35:14.529 INFO:teuthology.orchestra.run.smithi077.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.2 MB/s | 42 kB 00:00 2024-04-23T23:35:14.697 INFO:teuthology.orchestra.run.smithi077.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 134 kB/s | 22 kB 00:00 2024-04-23T23:35:14.906 INFO:teuthology.orchestra.run.smithi077.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 725 kB/s | 151 kB 00:00 2024-04-23T23:35:14.947 INFO:teuthology.orchestra.run.smithi077.stdout:(18/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.0 MB/s | 43 kB 00:00 2024-04-23T23:35:15.014 INFO:teuthology.orchestra.run.smithi077.stdout:(19/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-23T23:35:15.089 INFO:teuthology.orchestra.run.smithi077.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 4.7 MB/s | 358 kB 00:00 2024-04-23T23:35:15.131 INFO:teuthology.orchestra.run.smithi077.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2024-04-23T23:35:15.173 INFO:teuthology.orchestra.run.smithi077.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 424 kB/s | 18 kB 00:00 2024-04-23T23:35:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-23T23:35:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:15.175 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T23:35:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T23:35:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:15.178 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:15.215 INFO:teuthology.orchestra.run.smithi077.stdout:(23/36): python3-jaraco-collections-3.0.0-8.el9 556 kB/s | 23 kB 00:00 2024-04-23T23:35:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:(24/36): python3-jaraco-functools-3.5.0-2.el9.n 467 kB/s | 19 kB 00:00 2024-04-23T23:35:15.299 INFO:teuthology.orchestra.run.smithi077.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 475 kB/s | 20 kB 00:00 2024-04-23T23:35:15.341 INFO:teuthology.orchestra.run.smithi077.stdout:(26/36): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-04-23T23:35:15.391 INFO:teuthology.orchestra.run.smithi077.stdout:(27/36): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-04-23T23:35:15.450 INFO:teuthology.orchestra.run.smithi077.stdout:(28/36): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-04-23T23:35:15.509 INFO:teuthology.orchestra.run.smithi077.stdout:(29/36): ceph-mon-19.0.0-2424.gb98aab6c.el9.x86 1.6 MB/s | 4.7 MB 00:03 2024-04-23T23:35:15.525 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-base 2024-04-23T23:35:15.534 INFO:teuthology.orchestra.run.smithi077.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-04-23T23:35:15.609 INFO:teuthology.orchestra.run.smithi077.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 742 kB/s | 36 kB 00:00 2024-04-23T23:35:15.668 INFO:teuthology.orchestra.run.smithi077.stdout:(32/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-04-23T23:35:15.702 INFO:teuthology.orchestra.run.smithi077.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 467 kB/s | 90 kB 00:00 2024-04-23T23:35:15.735 INFO:teuthology.orchestra.run.smithi077.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2024-04-23T23:35:15.760 INFO:teuthology.orchestra.run.smithi077.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 341 kB/s | 20 kB 00:00 2024-04-23T23:35:16.033 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:57 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:16.111 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:35:16.151 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:16.152 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:35:16.152 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:16.214 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install cephadm 2024-04-23T23:35:16.717 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:00:57 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:16.837 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:16.838 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:16.838 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 762 k 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 768 k 2024-04-23T23:35:16.839 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:17.848 INFO:teuthology.orchestra.run.smithi170.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 755 kB/s | 762 kB 00:01 2024-04-23T23:35:17.849 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:17.849 INFO:teuthology.orchestra.run.smithi170.stdout:Total 754 kB/s | 762 kB 00:01 2024-04-23T23:35:17.849 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:17.855 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:17.855 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:17.861 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:17.862 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:17.936 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:18.346 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:18.443 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:18.636 INFO:teuthology.orchestra.run.smithi077.stdout:(36/36): ceph-osd-19.0.0-2424.gb98aab6c.el9.x86 3.1 MB/s | 17 MB 00:05 2024-04-23T23:35:18.640 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:18.641 INFO:teuthology.orchestra.run.smithi077.stdout:Total 4.0 MB/s | 30 MB 00:07 2024-04-23T23:35:18.752 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:18.776 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:18.960 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:18.960 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:18.960 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:18.960 INFO:teuthology.orchestra.run.smithi170.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:18.960 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:18.960 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:19.107 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:19.187 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T23:35:19.702 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:00 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:19.824 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:19.824 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 145 k 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 435 k 2024-04-23T23:35:19.825 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:20.046 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 656 kB/s | 145 kB 00:00 2024-04-23T23:35:20.047 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:20.047 INFO:teuthology.orchestra.run.smithi170.stdout:Total 651 kB/s | 145 kB 00:00 2024-04-23T23:35:20.047 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:20.055 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:20.055 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:20.112 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:20.112 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-23T23:35:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-23T23:35:20.371 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:20.371 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T23:35:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:20.376 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-23T23:35:20.487 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-23T23:35:20.515 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-23T23:35:20.594 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-23T23:35:20.639 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-23T23:35:20.672 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-23T23:35:20.763 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-23T23:35:20.833 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-23T23:35:20.883 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-23T23:35:20.919 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-23T23:35:20.949 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-23T23:35:20.983 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-23T23:35:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-23T23:35:21.057 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-23T23:35:21.092 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-23T23:35:21.127 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-23T23:35:21.165 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-23T23:35:21.236 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-23T23:35:21.236 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:21.236 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:21.237 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:21.237 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:21.237 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:21.237 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-23T23:35:21.384 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-23T23:35:21.448 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr 2024-04-23T23:35:21.472 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-23T23:35:21.535 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-23T23:35:21.573 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-23T23:35:21.622 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-23T23:35:21.678 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-23T23:35:21.863 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-23T23:35:21.927 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-23T23:35:21.960 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:02 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:22.005 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-23T23:35:22.042 INFO:teuthology.orchestra.run.smithi170.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:35:22.082 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:22.083 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:35:22.083 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:22.092 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-23T23:35:22.126 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-23T23:35:22.151 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T23:35:22.258 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-23T23:35:22.425 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 31/36 2024-04-23T23:35:22.454 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-23T23:35:22.480 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 32/36 2024-04-23T23:35:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-23T23:35:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T23:35:22.480 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-23T23:35:22.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:22.656 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:03 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:22.777 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:22.778 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:22.778 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:22.778 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:22.778 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:22.778 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-23T23:35:22.778 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:22.779 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:22.780 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-04-23T23:35:22.780 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:22.780 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 8.6 M 2024-04-23T23:35:22.780 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 103 M 2024-04-23T23:35:22.780 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:23.598 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2424.gb9 113 kB/s | 32 kB 00:00 2024-04-23T23:35:23.625 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2424.gb98 50 kB/s | 15 kB 00:00 2024-04-23T23:35:23.792 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.6 MB/s | 269 kB 00:00 2024-04-23T23:35:23.913 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-23T23:35:23.939 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 33/36 2024-04-23T23:35:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-23T23:35:23.939 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T23:35:23.940 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-23T23:35:23.940 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:23.943 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-04-23T23:35:24.026 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.6 MB/s | 863 kB 00:00 2024-04-23T23:35:24.101 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 260 kB/s | 19 kB 00:00 2024-04-23T23:35:24.152 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 2.6 MB/s | 548 kB 00:00 2024-04-23T23:35:24.194 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-04-23T23:35:24.236 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 734 kB/s | 31 kB 00:00 2024-04-23T23:35:24.278 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-04-23T23:35:24.303 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.8 MB/s | 188 kB 00:00 2024-04-23T23:35:24.381 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-23T23:35:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 34/36 2024-04-23T23:35:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-23T23:35:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T23:35:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-23T23:35:24.404 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:24.632 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-23T23:35:24.658 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 35/36 2024-04-23T23:35:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-23T23:35:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T23:35:24.658 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-23T23:35:24.658 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:24.719 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-23T23:35:25.411 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab 1.7 MB/s | 3.5 MB 00:02 2024-04-23T23:35:25.413 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:25.414 INFO:teuthology.orchestra.run.smithi170.stdout:Total 3.3 MB/s | 8.6 MB 00:02 2024-04-23T23:35:25.461 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:25.479 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:25.479 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:25.633 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:25.633 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:26.155 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:26.311 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-23T23:35:26.347 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-23T23:35:26.393 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-23T23:35:26.424 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-23T23:35:26.492 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 36/36 2024-04-23T23:35:26.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/36 2024-04-23T23:35:26.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/36 2024-04-23T23:35:26.492 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 3/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 4/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 5/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9. 6/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-23T23:35:26.493 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-23T23:35:26.494 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-23T23:35:26.499 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-23T23:35:26.500 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-23T23:35:26.624 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-23T23:35:26.725 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-23T23:35:26.771 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-23T23:35:26.807 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-23T23:35:26.839 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-23T23:35:27.550 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-04-23T23:35:27.551 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-23T23:35:27.552 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-23T23:35:27.553 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-23T23:35:27.554 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-23T23:35:27.554 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-23T23:35:27.554 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-23T23:35:27.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-base 2024-04-23T23:35:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-23T23:35:28.400 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:58 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:28.477 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-base-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:35:28.517 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:35:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:28.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install cephadm 2024-04-23T23:35:29.091 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:00:59 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:29.209 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 762 k 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:29.210 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:35:29.211 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 762 k 2024-04-23T23:35:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 768 k 2024-04-23T23:35:29.211 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:29.248 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-23T23:35:29.249 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T23:35:29.533 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:29.534 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm-19.0.0-2424.gb98aab6c.el9.noarch.rpm 2.3 MB/s | 762 kB 00:00 2024-04-23T23:35:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.3 MB/s | 762 kB 00:00 2024-04-23T23:35:29.541 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:29.546 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:29.552 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:29.781 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T23:35:30.065 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:30.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:30.288 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:11 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:30.417 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:30.418 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-23T23:35:30.418 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:30.418 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-23T23:35:30.418 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:30.418 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-23T23:35:30.418 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:30.419 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:30.420 INFO:teuthology.orchestra.run.smithi170.stdout:======================================================================================= 2024-04-23T23:35:30.420 INFO:teuthology.orchestra.run.smithi170.stdout:Install 12 Packages 2024-04-23T23:35:30.420 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:30.420 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 38 M 2024-04-23T23:35:30.420 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 209 M 2024-04-23T23:35:30.420 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:30.461 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:30.702 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/1 2024-04-23T23:35:30.702 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:30.702 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:30.702 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:30.702 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:30.703 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:30.930 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-immutable-object-cache 2024-04-23T23:35:31.445 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:01 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:31.487 INFO:teuthology.orchestra.run.smithi170.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 385 kB/s | 195 kB 00:00 2024-04-23T23:35:31.566 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:31.567 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:31.567 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-23T23:35:31.567 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:31.567 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:31.567 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 145 k 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 145 k 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 435 k 2024-04-23T23:35:31.568 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:31.595 INFO:teuthology.orchestra.run.smithi170.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-04-23T23:35:31.763 INFO:teuthology.orchestra.run.smithi170.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 803 kB 00:00 2024-04-23T23:35:31.789 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-immutable-object-cache-19.0.0-2424.gb98aab 656 kB/s | 145 kB 00:00 2024-04-23T23:35:31.789 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:31.790 INFO:teuthology.orchestra.run.smithi077.stdout:Total 651 kB/s | 145 kB 00:00 2024-04-23T23:35:31.790 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:31.798 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:31.798 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:31.854 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:31.855 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:31.862 INFO:teuthology.orchestra.run.smithi170.stdout:(4/12): ceph-mgr-diskprediction-local-19.0.0-24 8.4 MB/s | 7.4 MB 00:00 2024-04-23T23:35:31.905 INFO:teuthology.orchestra.run.smithi170.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 128 kB/s | 18 kB 00:00 2024-04-23T23:35:31.980 INFO:teuthology.orchestra.run.smithi170.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 302 kB/s | 35 kB 00:00 2024-04-23T23:35:32.005 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:32.088 INFO:teuthology.orchestra.run.smithi170.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.2 MB/s | 244 kB 00:00 2024-04-23T23:35:32.090 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-23T23:35:32.114 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-23T23:35:32.114 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:32.114 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-23T23:35:32.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:32.297 INFO:teuthology.orchestra.run.smithi170.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.3 MB/s | 3.0 MB 00:00 2024-04-23T23:35:32.381 INFO:teuthology.orchestra.run.smithi170.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-04-23T23:35:32.856 INFO:teuthology.orchestra.run.smithi170.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 5.0 MB/s | 4.7 MB 00:00 2024-04-23T23:35:32.935 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c. 1/1 2024-04-23T23:35:32.935 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:32.935 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:32.935 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:35:32.935 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:32.935 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:33.039 INFO:teuthology.orchestra.run.smithi170.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.4 MB/s | 5.1 MB 00:00 2024-04-23T23:35:33.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr 2024-04-23T23:35:33.665 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:03 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:33.743 INFO:teuthology.orchestra.run.smithi077.stdout:Package ceph-mgr-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:35:33.787 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:33.788 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:35:33.788 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:33.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-dashboard 2024-04-23T23:35:34.371 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:04 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:34.491 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 3.5 M 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 32 k 2024-04-23T23:35:34.492 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 15 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout:Install 12 Packages 2024-04-23T23:35:34.493 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:34.494 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 8.6 M 2024-04-23T23:35:34.494 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 103 M 2024-04-23T23:35:34.494 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:34.964 INFO:teuthology.orchestra.run.smithi170.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 6.3 MB/s | 16 MB 00:02 2024-04-23T23:35:34.965 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:34.965 INFO:teuthology.orchestra.run.smithi170.stdout:Total 8.4 MB/s | 38 MB 00:04 2024-04-23T23:35:35.311 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:35.337 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:35.338 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:35.468 INFO:teuthology.orchestra.run.smithi077.stdout:(1/12): ceph-prometheus-alerts-19.0.0-2424.gb98 82 kB/s | 15 kB 00:00 2024-04-23T23:35:35.510 INFO:teuthology.orchestra.run.smithi077.stdout:(2/12): ceph-grafana-dashboards-19.0.0-2424.gb9 138 kB/s | 32 kB 00:00 2024-04-23T23:35:35.744 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:35.744 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:35.902 INFO:teuthology.orchestra.run.smithi077.stdout:(3/12): ceph-mgr-dashboard-19.0.0-2424.gb98aab6 5.7 MB/s | 3.5 MB 00:00 2024-04-23T23:35:36.086 INFO:teuthology.orchestra.run.smithi077.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 468 kB/s | 269 kB 00:00 2024-04-23T23:35:36.311 INFO:teuthology.orchestra.run.smithi077.stdout:(5/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.2 MB/s | 1.0 MB 00:00 2024-04-23T23:35:36.579 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:36.636 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T23:35:36.653 INFO:teuthology.orchestra.run.smithi077.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 57 kB/s | 19 kB 00:00 2024-04-23T23:35:36.680 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T23:35:36.770 INFO:teuthology.orchestra.run.smithi077.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 801 kB/s | 548 kB 00:00 2024-04-23T23:35:36.789 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T23:35:36.823 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T23:35:36.895 INFO:teuthology.orchestra.run.smithi077.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.1 MB/s | 144 kB 00:00 2024-04-23T23:35:36.996 INFO:teuthology.orchestra.run.smithi077.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 308 kB/s | 31 kB 00:00 2024-04-23T23:35:37.001 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T23:35:37.030 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T23:35:37.107 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T23:35:37.121 INFO:teuthology.orchestra.run.smithi077.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-04-23T23:35:37.229 INFO:teuthology.orchestra.run.smithi077.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.5 MB/s | 2.0 MB 00:00 2024-04-23T23:35:37.554 INFO:teuthology.orchestra.run.smithi077.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 523 kB/s | 863 kB 00:01 2024-04-23T23:35:37.559 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:37.559 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.8 MB/s | 8.6 MB 00:03 2024-04-23T23:35:37.606 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:37.622 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:37.623 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:37.760 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T23:35:37.775 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:37.775 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:37.876 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T23:35:38.313 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-04-23T23:35:38.424 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-04-23T23:35:38.470 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-04-23T23:35:38.501 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-04-23T23:35:38.578 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-04-23T23:35:38.704 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-04-23T23:35:38.796 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-04-23T23:35:38.840 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-04-23T23:35:38.868 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-04-23T23:35:38.904 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 10/12 2024-04-23T23:35:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T23:35:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 11/12 2024-04-23T23:35:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-23T23:35:40.154 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T23:35:40.188 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 12/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el 1/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noa 2/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9 3/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-04-23T23:35:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-04-23T23:35:41.366 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-04-23T23:35:41.366 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-04-23T23:35:41.366 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-04-23T23:35:41.366 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-04-23T23:35:41.366 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-04-23T23:35:41.662 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-23T23:35:41.663 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-23T23:35:41.664 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-23T23:35:41.664 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-23T23:35:41.664 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:41.664 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:41.930 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-23T23:35:42.449 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:12 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:42.573 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 7.4 M 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-23T23:35:42.574 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:======================================================================================= 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout:Install 12 Packages 2024-04-23T23:35:42.575 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 38 M 2024-04-23T23:35:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 209 M 2024-04-23T23:35:42.576 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T23:35:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T23:35:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T23:35:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:43.200 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:43.201 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:43.390 INFO:teuthology.orchestra.run.smithi077.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 729 kB/s | 195 kB 00:00 2024-04-23T23:35:43.423 INFO:teuthology.orchestra.run.smithi077.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-04-23T23:35:43.449 INFO:teuthology.orchestra.run.smithi077.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 556 kB/s | 33 kB 00:00 2024-04-23T23:35:43.507 INFO:teuthology.orchestra.run.smithi077.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-04-23T23:35:43.544 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-rook 2024-04-23T23:35:43.566 INFO:teuthology.orchestra.run.smithi077.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 606 kB/s | 35 kB 00:00 2024-04-23T23:35:43.717 INFO:teuthology.orchestra.run.smithi077.stdout:(6/12): ceph-mgr-diskprediction-local-19.0.0-24 12 MB/s | 7.4 MB 00:00 2024-04-23T23:35:43.775 INFO:teuthology.orchestra.run.smithi077.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.5 MB/s | 3.0 MB 00:00 2024-04-23T23:35:43.959 INFO:teuthology.orchestra.run.smithi077.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.0 MB/s | 244 kB 00:00 2024-04-23T23:35:44.026 INFO:teuthology.orchestra.run.smithi077.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 10 MB/s | 4.7 MB 00:00 2024-04-23T23:35:44.051 INFO:teuthology.orchestra.run.smithi077.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.7 MB/s | 250 kB 00:00 2024-04-23T23:35:44.069 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:25 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:44.126 INFO:teuthology.orchestra.run.smithi077.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-04-23T23:35:44.189 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:44.190 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:44.190 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:44.190 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T23:35:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout:Install 13 Packages 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 2.2 M 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 26 M 2024-04-23T23:35:44.192 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:45.085 INFO:teuthology.orchestra.run.smithi077.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-04-23T23:35:45.086 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:45.086 INFO:teuthology.orchestra.run.smithi077.stdout:Total 15 MB/s | 38 MB 00:02 2024-04-23T23:35:45.131 INFO:teuthology.orchestra.run.smithi170.stdout:(1/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 164 kB/s | 49 kB 00:00 2024-04-23T23:35:45.356 INFO:teuthology.orchestra.run.smithi170.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 36 kB/s | 19 kB 00:00 2024-04-23T23:35:45.427 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:45.440 INFO:teuthology.orchestra.run.smithi170.stdout:(3/13): python3-jsonpatch-1.21-16.el9.noarch.rp 42 kB/s | 26 kB 00:00 2024-04-23T23:35:45.452 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:45.452 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:45.857 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:45.858 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:46.006 INFO:teuthology.orchestra.run.smithi170.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 254 kB/s | 222 kB 00:00 2024-04-23T23:35:46.215 INFO:teuthology.orchestra.run.smithi170.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 185 kB/s | 159 kB 00:00 2024-04-23T23:35:46.416 INFO:teuthology.orchestra.run.smithi170.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 286 kB/s | 279 kB 00:00 2024-04-23T23:35:46.474 INFO:teuthology.orchestra.run.smithi170.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 124 kB/s | 32 kB 00:00 2024-04-23T23:35:46.666 INFO:teuthology.orchestra.run.smithi170.stdout:(8/13): python3-requests-oauthlib-1.3.0-12.el9. 81 kB/s | 54 kB 00:00 2024-04-23T23:35:46.691 INFO:teuthology.orchestra.run.smithi170.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 54 kB/s | 15 kB 00:00 2024-04-23T23:35:46.716 INFO:teuthology.orchestra.run.smithi170.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 944 kB/s | 206 kB 00:00 2024-04-23T23:35:46.722 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-23T23:35:46.800 INFO:teuthology.orchestra.run.smithi170.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.1 MB/s | 90 kB 00:00 2024-04-23T23:35:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-23T23:35:46.949 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-23T23:35:47.001 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-23T23:35:47.009 INFO:teuthology.orchestra.run.smithi170.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 186 kB/s | 59 kB 00:00 2024-04-23T23:35:47.034 INFO:teuthology.orchestra.run.smithi170.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 2.8 MB/s | 1.0 MB 00:00 2024-04-23T23:35:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:47.038 INFO:teuthology.orchestra.run.smithi170.stdout:Total 792 kB/s | 2.2 MB 00:02 2024-04-23T23:35:47.101 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:47.117 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:47.117 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-23T23:35:47.200 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:47.201 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:47.208 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-23T23:35:47.285 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-23T23:35:47.713 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:47.879 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T23:35:47.930 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-23T23:35:47.934 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T23:35:48.000 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T23:35:48.036 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T23:35:48.047 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-23T23:35:48.077 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T23:35:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T23:35:48.272 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-23T23:35:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T23:35:49.035 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T23:35:49.076 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T23:35:49.110 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T23:35:49.158 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T23:35:49.188 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-23T23:35:49.283 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T23:35:49.946 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T23:35:49.947 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T23:35:50.280 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T23:35:50.280 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:50.280 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:50.280 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:50.280 INFO:teuthology.orchestra.run.smithi170.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:50.281 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:50.319 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-23T23:35:50.351 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-23T23:35:50.527 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T23:35:51.034 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:32 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:51.154 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T23:35:51.155 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout:Install 6 Packages 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:51.156 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 7.0 M 2024-04-23T23:35:51.157 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 33 M 2024-04-23T23:35:51.157 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:51.470 INFO:teuthology.orchestra.run.smithi170.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-04-23T23:35:51.636 INFO:teuthology.orchestra.run.smithi170.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-04-23T23:35:51.695 INFO:teuthology.orchestra.run.smithi170.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.4 MB/s | 548 kB 00:00 2024-04-23T23:35:51.720 INFO:teuthology.orchestra.run.smithi170.stdout:(4/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 342 kB/s | 141 kB 00:00 2024-04-23T23:35:51.737 INFO:teuthology.orchestra.run.smithi170.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 576 kB/s | 58 kB 00:00 2024-04-23T23:35:51.754 INFO:teuthology.orchestra.run.smithi170.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 869 kB/s | 51 kB 00:00 2024-04-23T23:35:51.755 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:51.755 INFO:teuthology.orchestra.run.smithi170.stdout:Total 12 MB/s | 7.0 MB 00:00 2024-04-23T23:35:51.825 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:51.836 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:51.837 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:51.933 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:51.933 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:52.233 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:52.392 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T23:35:52.447 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T23:35:52.960 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 12/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aa 1/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-23T23:35:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-23T23:35:52.997 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-23T23:35:52.997 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-23T23:35:52.997 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-23T23:35:53.041 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T23:35:53.105 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T23:35:53.135 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-23T23:35:53.401 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-23T23:35:53.401 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-23T23:35:53.402 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-23T23:35:53.403 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:53.403 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:53.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-rook 2024-04-23T23:35:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-23T23:35:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-23T23:35:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T23:35:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T23:35:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T23:35:53.889 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T23:35:54.129 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T23:35:54.129 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:54.129 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:54.129 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:54.129 INFO:teuthology.orchestra.run.smithi170.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T23:35:54.130 INFO:teuthology.orchestra.run.smithi170.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T23:35:54.130 INFO:teuthology.orchestra.run.smithi170.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T23:35:54.130 INFO:teuthology.orchestra.run.smithi170.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T23:35:54.130 INFO:teuthology.orchestra.run.smithi170.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T23:35:54.130 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:54.130 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:54.290 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:24 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:54.366 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-fuse 2024-04-23T23:35:54.410 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:54.411 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:54.411 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:35:54.411 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 49 k 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-23T23:35:54.412 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout:Install 13 Packages 2024-04-23T23:35:54.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:54.414 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 2.2 M 2024-04-23T23:35:54.414 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 26 M 2024-04-23T23:35:54.414 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:54.876 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:35 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:54.986 INFO:teuthology.orchestra.run.smithi077.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 240 kB/s | 19 kB 00:00 2024-04-23T23:35:54.997 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:54.997 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-04-23T23:35:54.998 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:54.999 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 969 k 2024-04-23T23:35:54.999 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 2.8 M 2024-04-23T23:35:54.999 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:55.011 INFO:teuthology.orchestra.run.smithi077.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 244 kB/s | 26 kB 00:00 2024-04-23T23:35:55.095 INFO:teuthology.orchestra.run.smithi077.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-04-23T23:35:55.120 INFO:teuthology.orchestra.run.smithi077.stdout:(4/13): ceph-mgr-rook-19.0.0-2424.gb98aab6c.el9 230 kB/s | 49 kB 00:00 2024-04-23T23:35:55.145 INFO:teuthology.orchestra.run.smithi077.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-04-23T23:35:55.170 INFO:teuthology.orchestra.run.smithi077.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-04-23T23:35:55.196 INFO:teuthology.orchestra.run.smithi077.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-04-23T23:35:55.304 INFO:teuthology.orchestra.run.smithi077.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 202 kB/s | 32 kB 00:00 2024-04-23T23:35:55.329 INFO:teuthology.orchestra.run.smithi077.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 94 kB/s | 15 kB 00:00 2024-04-23T23:35:55.405 INFO:teuthology.orchestra.run.smithi077.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 983 kB/s | 206 kB 00:00 2024-04-23T23:35:55.424 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.8 MB/s | 889 kB 00:00 2024-04-23T23:35:55.430 INFO:teuthology.orchestra.run.smithi077.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-04-23T23:35:55.458 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 234 kB/s | 80 kB 00:00 2024-04-23T23:35:55.458 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:55.459 INFO:teuthology.orchestra.run.smithi170.stdout:Total 2.1 MB/s | 969 kB 00:00 2024-04-23T23:35:55.471 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:55.472 INFO:teuthology.orchestra.run.smithi077.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-04-23T23:35:55.493 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:55.493 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:55.539 INFO:teuthology.orchestra.run.smithi077.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.4 MB/s | 1.0 MB 00:00 2024-04-23T23:35:55.540 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:55.540 INFO:teuthology.orchestra.run.smithi077.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-04-23T23:35:55.570 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:55.571 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:55.601 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:35:55.615 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:35:55.615 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:35:55.698 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:35:55.699 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:35:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T23:35:55.948 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-23T23:35:56.197 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:35:56.368 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-23T23:35:56.423 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-23T23:35:56.488 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-23T23:35:56.533 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-23T23:35:56.575 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-23T23:35:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-23T23:35:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-23T23:35:56.669 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-23T23:35:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-23T23:35:56.819 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-23T23:35:56.821 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T23:35:56.821 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:56.821 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:56.821 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T23:35:56.821 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:56.821 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:57.068 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install ceph-volume 2024-04-23T23:35:57.552 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-23T23:35:57.585 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:38 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:35:57.599 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-23T23:35:57.633 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-23T23:35:57.681 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-23T23:35:57.703 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-23T23:35:57.707 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:35:57.708 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repository Size 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:Installing dependencies: 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:Install 2 Packages 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:57.709 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 341 k 2024-04-23T23:35:57.710 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 1.5 M 2024-04-23T23:35:57.710 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:35:58.079 INFO:teuthology.orchestra.run.smithi170.stdout:(1/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 1.0 MB/s | 264 kB 00:00 2024-04-23T23:35:58.255 INFO:teuthology.orchestra.run.smithi170.stdout:(2/2): python3-packaging-20.9-5.el9.noarch.rpm 183 kB/s | 77 kB 00:00 2024-04-23T23:35:58.255 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:35:58.256 INFO:teuthology.orchestra.run.smithi170.stdout:Total 623 kB/s | 341 kB 00:00 2024-04-23T23:35:58.267 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:35:58.277 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:35:58.277 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:35:58.302 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:35:58.302 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:35:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 13/13 2024-04-23T23:35:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 1/13 2024-04-23T23:35:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-23T23:35:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-23T23:35:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-23T23:35:58.439 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-23T23:35:58.440 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-23T23:35:58.447 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:35:58.628 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-23T23:35:58.665 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-23T23:35:58.681 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-23T23:35:58.681 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:35:58.681 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T23:35:58.681 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-23T23:35:58.733 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-23T23:35:58.734 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-23T23:35:58.734 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-23T23:35:58.734 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-23T23:35:58.734 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-23T23:35:58.734 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:58.734 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:35:58.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-mgr-cephadm 2024-04-23T23:35:59.311 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-23T23:35:59.502 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:29 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:35:59.604 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-23T23:35:59.604 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:59.604 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:35:59.605 INFO:teuthology.orchestra.run.smithi170.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:35:59.605 INFO:teuthology.orchestra.run.smithi170.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T23:35:59.605 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:35:59.605 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:35:59.622 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:35:59.622 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 141 k 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:35:59.623 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:35:59.624 INFO:teuthology.orchestra.run.smithi077.stdout:Install 6 Packages 2024-04-23T23:35:59.624 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:35:59.624 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 7.0 M 2024-04-23T23:35:59.624 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 33 M 2024-04-23T23:35:59.624 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:35:59.929 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados-devel 2024-04-23T23:36:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:(1/6): ceph-mgr-cephadm-19.0.0-2424.gb98aab6c.e 632 kB/s | 141 kB 00:00 2024-04-23T23:36:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 997 kB/s | 248 kB 00:00 2024-04-23T23:36:00.201 INFO:teuthology.orchestra.run.smithi077.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 692 kB/s | 58 kB 00:00 2024-04-23T23:36:00.243 INFO:teuthology.orchestra.run.smithi077.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 1.2 MB/s | 51 kB 00:00 2024-04-23T23:36:00.293 INFO:teuthology.orchestra.run.smithi077.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.7 MB/s | 548 kB 00:00 2024-04-23T23:36:00.451 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:41 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:00.494 INFO:teuthology.orchestra.run.smithi077.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.5 MB/s | 6.0 MB 00:00 2024-04-23T23:36:00.494 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:00.494 INFO:teuthology.orchestra.run.smithi077.stdout:Total 8.0 MB/s | 7.0 MB 00:00 2024-04-23T23:36:00.564 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:00.575 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:00.575 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:00.575 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:00.576 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:00.576 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-23T23:36:00.576 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 127 k 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 456 k 2024-04-23T23:36:00.577 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:36:00.670 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:00.671 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:00.786 INFO:teuthology.orchestra.run.smithi170.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 607 kB/s | 127 kB 00:00 2024-04-23T23:36:00.787 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:00.787 INFO:teuthology.orchestra.run.smithi170.stdout:Total 602 kB/s | 127 kB 00:00 2024-04-23T23:36:00.787 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:36:00.793 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:36:00.793 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:36:00.860 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:36:00.860 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:36:00.969 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:36:01.109 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:01.144 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-23T23:36:01.187 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-23T23:36:01.537 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:01.705 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-23T23:36:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-23T23:36:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:01.804 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:36:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:01.804 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-23T23:36:01.891 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-23T23:36:02.034 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs2 2024-04-23T23:36:02.564 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:43 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:02.644 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 6/6 2024-04-23T23:36:02.644 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 1/6 2024-04-23T23:36:02.644 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-23T23:36:02.645 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-23T23:36:02.645 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-23T23:36:02.645 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-23T23:36:02.645 INFO:teuthology.orchestra.run.smithi170.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:02.687 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:02.687 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:02.687 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:02.759 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install libcephfs-devel 2024-04-23T23:36:02.898 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-23T23:36:02.898 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:02.899 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:03.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-fuse 2024-04-23T23:36:03.278 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:44 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:03.397 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:03.398 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:03.398 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 32 k 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 142 k 2024-04-23T23:36:03.399 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:36:03.565 INFO:teuthology.orchestra.run.smithi170.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 191 kB/s | 32 kB 00:00 2024-04-23T23:36:03.565 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:03.565 INFO:teuthology.orchestra.run.smithi170.stdout:Total 190 kB/s | 32 kB 00:00 2024-04-23T23:36:03.565 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:36:03.569 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:36:03.569 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:36:03.571 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:36:03.571 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:36:03.629 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:33 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:03.661 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:36:03.750 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 889 k 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-23T23:36:03.751 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout:Install 2 Packages 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 969 k 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 2.8 M 2024-04-23T23:36:03.752 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:03.769 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:04.104 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:04.297 INFO:teuthology.orchestra.run.smithi077.stdout:(1/2): ceph-fuse-19.0.0-2424.gb98aab6c.el9.x86_ 2.0 MB/s | 889 kB 00:00 2024-04-23T23:36:04.318 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:04.318 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:04.318 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:36:04.318 INFO:teuthology.orchestra.run.smithi170.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:04.318 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:04.318 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:04.505 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librados2 2024-04-23T23:36:04.581 INFO:teuthology.orchestra.run.smithi077.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 113 kB/s | 80 kB 00:00 2024-04-23T23:36:04.582 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:04.582 INFO:teuthology.orchestra.run.smithi077.stdout:Total 1.1 MB/s | 969 kB 00:00 2024-04-23T23:36:04.594 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:04.615 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:04.616 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:04.693 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:04.693 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:04.883 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:05.008 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-23T23:36:05.020 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:46 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:05.079 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-23T23:36:05.100 INFO:teuthology.orchestra.run.smithi170.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:05.141 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:05.142 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:05.142 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:05.216 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install librbd1 2024-04-23T23:36:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2/2 2024-04-23T23:36:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/2 2024-04-23T23:36:05.724 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:46 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:05.803 INFO:teuthology.orchestra.run.smithi170.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:05.843 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:05.844 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:05.844 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:05.912 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rados 2024-04-23T23:36:06.000 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-23T23:36:06.000 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:06.000 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:06.000 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-23T23:36:06.000 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:06.000 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:06.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-volume 2024-04-23T23:36:06.421 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:47 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:06.500 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:06.541 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:06.542 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:06.542 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:06.615 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rgw 2024-04-23T23:36:06.762 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:36 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:06.884 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.0.0-2424.gb98aab6c.el9 ceph-noarch 264 k 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:06.886 INFO:teuthology.orchestra.run.smithi077.stdout:Install 2 Packages 2024-04-23T23:36:06.886 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:06.886 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 341 k 2024-04-23T23:36:06.886 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 1.5 M 2024-04-23T23:36:06.886 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:07.125 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:48 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:07.168 INFO:teuthology.orchestra.run.smithi077.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 476 kB/s | 77 kB 00:00 2024-04-23T23:36:07.204 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:07.246 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:07.247 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:07.247 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:07.277 INFO:teuthology.orchestra.run.smithi077.stdout:(2/2): ceph-volume-19.0.0-2424.gb98aab6c.el9.no 974 kB/s | 264 kB 00:00 2024-04-23T23:36:07.277 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:07.278 INFO:teuthology.orchestra.run.smithi077.stdout:Total 868 kB/s | 341 kB 00:00 2024-04-23T23:36:07.289 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:07.298 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:07.299 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:07.318 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-cephfs 2024-04-23T23:36:07.323 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:07.323 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:07.466 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:07.658 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-23T23:36:07.696 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-23T23:36:07.711 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2/2 2024-04-23T23:36:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:36:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-23T23:36:07.712 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:07.829 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:48 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:07.909 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:07.950 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:07.951 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:07.951 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:08.026 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install python3-rbd 2024-04-23T23:36:08.405 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 1/2 2024-04-23T23:36:08.533 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:49 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:08.613 INFO:teuthology.orchestra.run.smithi170.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:08.654 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:08.655 INFO:teuthology.orchestra.run.smithi170.stdout:Nothing to do. 2024-04-23T23:36:08.655 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.0.0-2424.gb98aab6c.el9.noarch 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:08.690 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:08.726 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-fuse 2024-04-23T23:36:09.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados-devel 2024-04-23T23:36:09.233 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:50 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:09.353 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:09.353 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:09.353 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-23T23:36:09.353 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 86 k 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 231 k 2024-04-23T23:36:09.354 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:36:09.615 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:39 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:09.684 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 259 kB/s | 86 kB 00:00 2024-04-23T23:36:09.685 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:09.685 INFO:teuthology.orchestra.run.smithi170.stdout:Total 258 kB/s | 86 kB 00:00 2024-04-23T23:36:09.685 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:36:09.692 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:36:09.692 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:36:09.738 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:09.738 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 127 k 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 127 k 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 456 k 2024-04-23T23:36:09.739 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:09.755 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:36:09.755 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:36:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:36:09.966 INFO:teuthology.orchestra.run.smithi077.stdout:librados-devel-19.0.0-2424.gb98aab6c.el9.x86_64 561 kB/s | 127 kB 00:00 2024-04-23T23:36:09.966 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:09.966 INFO:teuthology.orchestra.run.smithi077.stdout:Total 557 kB/s | 127 kB 00:00 2024-04-23T23:36:09.967 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:09.972 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:09.972 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:10.006 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:10.037 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:10.037 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:10.330 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:10.592 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:10.593 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:10.593 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:36:10.593 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:10.593 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:10.593 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:10.743 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:10.869 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-mirror 2024-04-23T23:36:10.974 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:10.974 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:10.974 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:10.974 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:10.974 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:10.974 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:11.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs2 2024-04-23T23:36:11.401 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:52 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:11.526 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout: Package Arch Version Repo Size 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:36:11.527 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:11.528 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:36:11.528 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:11.528 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 3.1 M 2024-04-23T23:36:11.528 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 13 M 2024-04-23T23:36:11.528 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:36:11.721 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:41 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:11.801 INFO:teuthology.orchestra.run.smithi077.stdout:Package libcephfs2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:11.842 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:11.843 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:11.843 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:11.921 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 7.9 MB/s | 3.1 MB 00:00 2024-04-23T23:36:11.921 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:11.922 INFO:teuthology.orchestra.run.smithi170.stdout:Total 7.8 MB/s | 3.1 MB 00:00 2024-04-23T23:36:11.922 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:36:11.930 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install libcephfs-devel 2024-04-23T23:36:11.931 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:36:11.931 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:36:12.012 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:36:12.012 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:36:12.437 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:36:12.449 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:42 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:12.496 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:12.521 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:12.521 INFO:teuthology.orchestra.run.smithi170.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:36:12.521 INFO:teuthology.orchestra.run.smithi170.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T23:36:12.521 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T23:36:12.522 INFO:teuthology.orchestra.run.smithi170.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T23:36:12.522 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:12.570 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:12.571 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:12.571 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-23T23:36:12.571 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:12.571 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 32 k 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 32 k 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 142 k 2024-04-23T23:36:12.572 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:12.812 INFO:teuthology.orchestra.run.smithi077.stdout:libcephfs-devel-19.0.0-2424.gb98aab6c.el9.x86_6 132 kB/s | 32 kB 00:00 2024-04-23T23:36:12.812 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:12.812 INFO:teuthology.orchestra.run.smithi077.stdout:Total 132 kB/s | 32 kB 00:00 2024-04-23T23:36:12.813 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:12.816 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:12.816 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:12.818 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:12.819 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:12.905 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:12.998 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:13.551 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:13.551 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:13.551 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:36:13.551 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:13.551 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:13.551 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:13.555 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:13.555 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:13.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librados2 2024-04-23T23:36:13.822 DEBUG:teuthology.orchestra.run.smithi170:> sudo yum -y install rbd-nbd 2024-04-23T23:36:14.239 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:44 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:14.317 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:14.339 INFO:teuthology.orchestra.run.smithi170.stdout:Last metadata expiration check: 0:01:55 ago on Tue 23 Apr 2024 11:34:19 PM UTC. 2024-04-23T23:36:14.358 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:14.358 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:14.358 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:14.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install librbd1 2024-04-23T23:36:14.462 INFO:teuthology.orchestra.run.smithi170.stdout:Dependencies resolved. 2024-04-23T23:36:14.462 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:14.462 INFO:teuthology.orchestra.run.smithi170.stdout: Package Architecture Version Repository Size 2024-04-23T23:36:14.462 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:Installing: 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction Summary 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:================================================================================ 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:Install 1 Package 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:Total download size: 170 k 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:Installed size: 494 k 2024-04-23T23:36:14.463 INFO:teuthology.orchestra.run.smithi170.stdout:Downloading Packages: 2024-04-23T23:36:14.692 INFO:teuthology.orchestra.run.smithi170.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 740 kB/s | 170 kB 00:00 2024-04-23T23:36:14.692 INFO:teuthology.orchestra.run.smithi170.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:14.692 INFO:teuthology.orchestra.run.smithi170.stdout:Total 735 kB/s | 170 kB 00:00 2024-04-23T23:36:14.693 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction check 2024-04-23T23:36:14.700 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction check succeeded. 2024-04-23T23:36:14.700 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction test 2024-04-23T23:36:14.763 INFO:teuthology.orchestra.run.smithi170.stdout:Transaction test succeeded. 2024-04-23T23:36:14.763 INFO:teuthology.orchestra.run.smithi170.stdout:Running transaction 2024-04-23T23:36:14.923 INFO:teuthology.orchestra.run.smithi170.stdout: Preparing : 1/1 2024-04-23T23:36:14.930 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:44 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:15.008 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:15.037 INFO:teuthology.orchestra.run.smithi170.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:15.049 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:15.050 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:15.050 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:15.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rados 2024-04-23T23:36:15.403 INFO:teuthology.orchestra.run.smithi170.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:15.623 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:45 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:15.626 INFO:teuthology.orchestra.run.smithi170.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:15.626 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:15.626 INFO:teuthology.orchestra.run.smithi170.stdout:Installed: 2024-04-23T23:36:15.626 INFO:teuthology.orchestra.run.smithi170.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:15.626 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:15.626 INFO:teuthology.orchestra.run.smithi170.stdout:Complete! 2024-04-23T23:36:15.701 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rados-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:15.742 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:15.743 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:15.743 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:15.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rgw 2024-04-23T23:36:15.876 DEBUG:teuthology.parallel:result is None 2024-04-23T23:36:16.310 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:46 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:16.389 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rgw-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:16.431 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:16.432 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:16.432 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:16.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-cephfs 2024-04-23T23:36:17.002 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:47 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:17.080 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-cephfs-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:17.121 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:17.122 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:17.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install python3-rbd 2024-04-23T23:36:17.694 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:47 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:17.773 INFO:teuthology.orchestra.run.smithi077.stdout:Package python3-rbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 is already installed. 2024-04-23T23:36:17.813 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:Nothing to do. 2024-04-23T23:36:17.814 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:17.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-fuse 2024-04-23T23:36:18.377 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:48 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:18.497 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 86 k 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:18.498 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:36:18.499 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 86 k 2024-04-23T23:36:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 231 k 2024-04-23T23:36:18.499 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:18.814 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-fuse-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 271 kB/s | 86 kB 00:00 2024-04-23T23:36:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:Total 270 kB/s | 86 kB 00:00 2024-04-23T23:36:18.815 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:18.822 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:19.024 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:19.151 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:19.509 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:19.733 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:19.733 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:19.733 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:19.733 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:19.734 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:19.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-mirror 2024-04-23T23:36:20.485 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:50 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:20.606 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repo Size 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 3.1 M 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 3.1 M 2024-04-23T23:36:20.607 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 13 M 2024-04-23T23:36:20.608 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:20.975 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-mirror-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 8.4 MB/s | 3.1 MB 00:00 2024-04-23T23:36:20.976 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:20.976 INFO:teuthology.orchestra.run.smithi077.stdout:Total 8.4 MB/s | 3.1 MB 00:00 2024-04-23T23:36:20.976 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:20.985 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:21.065 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:21.506 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:21.684 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:21.709 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:21.709 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-23T23:36:21.710 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-23T23:36:21.710 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T23:36:21.710 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-23T23:36:21.710 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:22.629 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:22.629 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:22.629 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:22.629 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:22.629 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:22.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install rbd-nbd 2024-04-23T23:36:23.396 INFO:teuthology.orchestra.run.smithi077.stdout:Last metadata expiration check: 0:01:53 ago on Tue 23 Apr 2024 11:34:30 PM UTC. 2024-04-23T23:36:23.516 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-04-23T23:36:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:23.517 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-04-23T23:36:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:23.517 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-04-23T23:36:23.517 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.0.0-2424.gb98aab6c.el9 ceph 170 k 2024-04-23T23:36:23.517 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:Install 1 Package 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 170 k 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 494 k 2024-04-23T23:36:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-04-23T23:36:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:rbd-nbd-19.0.0-2424.gb98aab6c.el9.x86_64.rpm 723 kB/s | 170 kB 00:00 2024-04-23T23:36:23.754 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-04-23T23:36:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:Total 718 kB/s | 170 kB 00:00 2024-04-23T23:36:23.755 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-04-23T23:36:23.762 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-04-23T23:36:23.762 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-04-23T23:36:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-04-23T23:36:23.825 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-04-23T23:36:23.983 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-04-23T23:36:24.116 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:24.484 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:24.703 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 1/1 2024-04-23T23:36:24.704 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-04-23T23:36:24.704 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.0.0-2424.gb98aab6c.el9.x86_64 2024-04-23T23:36:24.704 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:24.704 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-04-23T23:36:24.954 DEBUG:teuthology.parallel:result is None 2024-04-23T23:36:24.955 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-23T23:36:25.176 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T23:36:25.197 INFO:teuthology.orchestra.run.smithi077.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-23T23:36:25.198 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-23T23:36:25.198 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-23T23:36:25.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=b98aab6c00f483888c049d0d8e7bc507e115dd86 2024-04-23T23:36:25.342 DEBUG:teuthology.orchestra.run.smithi170:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-23T23:36:25.367 INFO:teuthology.orchestra.run.smithi170.stdout:19.0.0-2424.gb98aab6c.el9 2024-04-23T23:36:25.368 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2424.gb98aab6c.el9 2024-04-23T23:36:25.368 INFO:teuthology.task.install:The correct ceph version 19.0.0-2424.gb98aab6c is installed. 2024-04-23T23:36:25.369 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T23:36:25.370 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:25.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T23:36:25.395 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:25.395 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T23:36:25.436 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T23:36:25.436 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:25.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T23:36:25.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T23:36:25.522 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:25.522 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T23:36:25.549 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T23:36:25.614 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T23:36:25.615 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:25.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T23:36:25.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T23:36:25.702 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:25.702 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T23:36:25.728 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T23:36:25.792 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T23:36:25.792 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:25.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T23:36:25.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T23:36:25.881 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:25.881 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T23:36:25.906 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T23:36:25.970 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T23:36:26.057 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T23:36:26.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-04-23T23:36:26.059 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 777 /var/log/ceph 2024-04-23T23:36:26.083 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T23:36:26.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T23:36:26.122 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T23:36:26.147 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T23:36:26.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T23:36:26.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T23:36:26.219 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T23:36:26.219 INFO:tasks.ceph:config {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T23:36:26.220 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7670477', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9514, 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'sleep_before_teardown': 0, 'subset': '69/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b98aab6c00f483888c049d0d8e7bc507e115dd86/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86', 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH4Qm8OHHD3nFiH9wmhLs1/HsIhL+1zDhRAP5dSUWyCihjvSs14Ye0v8U3saHXYriECacWuGp9HNuZAsHJ0xjzo=', 'smithi170.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBZdS+gFRsF6rwPQ79IgQ6kFfPsLLwSMKlMFxgzcrOiaZ0+EG66TteZ8cmzJqa0XbEUsENPLYHHxbN/zVGuiDns='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_21:16:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T23:36:26.220 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T23:36:26.250 DEBUG:teuthology.orchestra.run.smithi170:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T23:36:26.264 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T23:36:26.305 DEBUG:teuthology.orchestra.run.smithi170:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T23:36:26.328 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:26.328 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T23:36:26.381 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T23:36:26.381 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-23 23:36:21.969663358 +0000 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-23 23:33:23.875413489 +0000 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-23 23:33:23.875413489 +0000 2024-04-23T23:36:26.436 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-23 23:33:23.875413489 +0000 2024-04-23T23:36:26.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T23:36:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-23T23:36:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-23T23:36:26.498 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000179886 s, 2.8 MB/s 2024-04-23T23:36:26.499 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T23:36:26.555 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-23 23:36:21.969663358 +0000 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-23 23:33:24.221406722 +0000 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-23 23:33:24.221406722 +0000 2024-04-23T23:36:26.612 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-23 23:33:24.221406722 +0000 2024-04-23T23:36:26.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T23:36:26.674 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-23T23:36:26.674 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-23T23:36:26.674 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000187625 s, 2.7 MB/s 2024-04-23T23:36:26.675 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T23:36:26.731 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-04-23T23:36:26.786 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-23 23:36:21.969663358 +0000 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-23 23:33:24.552400250 +0000 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-23 23:33:24.552400250 +0000 2024-04-23T23:36:26.787 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-23 23:33:24.552400250 +0000 2024-04-23T23:36:26.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T23:36:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-23T23:36:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-23T23:36:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000176223 s, 2.9 MB/s 2024-04-23T23:36:26.850 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T23:36:26.905 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-04-23T23:36:26.961 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T23:36:26.961 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:26.961 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-23T23:36:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-04-23 23:36:21.970663339 +0000 2024-04-23T23:36:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-04-23 23:33:24.892393601 +0000 2024-04-23T23:36:26.962 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-04-23 23:33:24.892393601 +0000 2024-04-23T23:36:26.962 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-04-23 23:33:24.892393601 +0000 2024-04-23T23:36:26.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T23:36:27.023 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-04-23T23:36:27.023 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-04-23T23:36:27.023 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000182032 s, 2.8 MB/s 2024-04-23T23:36:27.025 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T23:36:27.080 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:27.080 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:27.081 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T23:36:27.097 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T23:36:27.097 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_1 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-23 23:36:12.775689891 +0000 2024-04-23T23:36:27.154 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-23 23:33:23.866152735 +0000 2024-04-23T23:36:27.155 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-23 23:33:23.866152735 +0000 2024-04-23T23:36:27.155 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-23 23:33:23.866152735 +0000 2024-04-23T23:36:27.155 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T23:36:27.218 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-23T23:36:27.218 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-23T23:36:27.218 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000112262 s, 4.6 MB/s 2024-04-23T23:36:27.220 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T23:36:27.276 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_2 2024-04-23T23:36:27.332 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T23:36:27.332 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:27.332 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-23T23:36:27.332 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:27.333 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:27.333 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-23 23:36:12.775689891 +0000 2024-04-23T23:36:27.333 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-23 23:33:24.202144880 +0000 2024-04-23T23:36:27.333 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-23 23:33:24.202144880 +0000 2024-04-23T23:36:27.333 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-23 23:33:24.202144880 +0000 2024-04-23T23:36:27.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T23:36:27.396 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-23T23:36:27.396 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-23T23:36:27.396 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 0.000104613 s, 4.9 MB/s 2024-04-23T23:36:27.397 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T23:36:27.453 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_3 2024-04-23T23:36:27.508 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T23:36:27.508 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:27.508 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-23T23:36:27.508 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:27.509 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:27.509 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-23 23:36:12.775689891 +0000 2024-04-23T23:36:27.509 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-23 23:33:24.506137774 +0000 2024-04-23T23:36:27.509 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-23 23:33:24.506137774 +0000 2024-04-23T23:36:27.509 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-23 23:33:24.506137774 +0000 2024-04-23T23:36:27.509 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T23:36:27.570 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-23T23:36:27.570 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-23T23:36:27.570 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.3612e-05 s, 6.1 MB/s 2024-04-23T23:36:27.571 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T23:36:27.627 DEBUG:teuthology.orchestra.run.smithi170:> stat /dev/vg_nvme/lv_4 2024-04-23T23:36:27.682 INFO:teuthology.orchestra.run.smithi170.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T23:36:27.682 INFO:teuthology.orchestra.run.smithi170.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T23:36:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-04-23T23:36:27.682 INFO:teuthology.orchestra.run.smithi170.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T23:36:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:Context: system_u:object_r:device_t:s0 2024-04-23T23:36:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:Access: 2024-04-23 23:36:12.775689891 +0000 2024-04-23T23:36:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:Modify: 2024-04-23 23:33:24.842129919 +0000 2024-04-23T23:36:27.683 INFO:teuthology.orchestra.run.smithi170.stdout:Change: 2024-04-23 23:33:24.842129919 +0000 2024-04-23T23:36:27.683 INFO:teuthology.orchestra.run.smithi170.stdout: Birth: 2024-04-23 23:33:24.842129919 +0000 2024-04-23T23:36:27.683 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T23:36:27.744 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records in 2024-04-23T23:36:27.744 INFO:teuthology.orchestra.run.smithi170.stderr:1+0 records out 2024-04-23T23:36:27.744 INFO:teuthology.orchestra.run.smithi170.stderr:512 bytes copied, 8.2127e-05 s, 6.2 MB/s 2024-04-23T23:36:27.745 DEBUG:teuthology.orchestra.run.smithi170:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T23:36:27.801 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:27.801 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T23:36:27.801 INFO:tasks.ceph:Generating config... 2024-04-23T23:36:27.802 INFO:tasks.ceph:[client] rbd cache = True 2024-04-23T23:36:27.802 INFO:tasks.ceph:[client] rbd cache policy = writearound 2024-04-23T23:36:27.802 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-23T23:36:27.802 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-04-23T23:36:27.802 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-04-23T23:36:27.803 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T23:36:27.803 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T23:36:27.803 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T23:36:27.803 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T23:36:27.803 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T23:36:27.803 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-23T23:36:27.804 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-23T23:36:27.804 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T23:36:27.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T23:36:27.854 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T23:36:27.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T23:36:27.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T23:36:27.925 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.c', '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]'), ('mon.b', '172.21.15.170')] 2024-04-23T23:36:27.926 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790],172.21.15.170', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd cache': True, 'rbd cache policy': 'writearound'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-23T23:36:27.926 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:27.927 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T23:36:27.982 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --addv c '[v2:172.21.15.77:3301,v1:172.21.15.77:6790]' --add b 172.21.15.170 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:28.067 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid f73eea51-5002-4eee-8d85-f2db649bc1b5 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:fsid f73eea51-5002-4eee-8d85-f2db649bc1b5 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2024-04-23T23:36:28.080313+0000 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-23T23:36:28.080313+0000 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 17 (quincy) 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.170:3300/0,v1:172.21.15.170:6789/0] mon.b 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.77:3301/0,v1:172.21.15.77:6790/0] mon.c 2024-04-23T23:36:28.068 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-23T23:36:28.069 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T23:36:28.084 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f73eea51-5002-4eee-8d85-f2db649bc1b5... 2024-04-23T23:36:28.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T23:36:28.126 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T23:36:28.163 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.164 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-04-23T23:36:28.165 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790],172.21.15.170" 2024-04-23T23:36:28.166 INFO:teuthology.orchestra.run.smithi077.stdout: mon client directed command retry = 5 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on pool no app = False 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject socket failures = 5000 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = f73eea51-5002-4eee-8d85-f2db649bc1b5 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.167 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-04-23T23:36:28.168 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = stupid 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-04-23T23:36:28.169 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: osd blocked scrub grace period = 3600 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: osd max markdown count = 1000 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: osd shutdown pgref assert = True 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-04-23T23:36:28.170 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T23:36:28.171 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-04-23T23:36:28.172 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi077.stdout: rbd cache = True 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi077.stdout: rbd cache policy = writearound 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-04-23T23:36:28.173 INFO:teuthology.orchestra.run.smithi170.stdout:[global] 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: chdir = "" 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: auth supported = cephx 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: filestore xattr use omap = true 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: mon clock drift allowed = 1.000 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: osd crush chooseleaf type = 0 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: auth debug = true 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on old message = true 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: ms die on bug = true 2024-04-23T23:36:28.174 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon pg warn max object skew = 0 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default size = 2 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow primary affinity = true 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd allow pg remap = true 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on legacy crush tunables = false 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on crush straw calc version zero = false 2024-04-23T23:36:28.175 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on no sortbitwise = false 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on osd down out interval zero = false 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on too few osds = false 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon_allow_pool_size_one = true 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: osd default data pool replay window = 5 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon allow pool delete = true 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon cluster log file level = debug 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: debug asserts on shutdown = true 2024-04-23T23:36:28.176 INFO:teuthology.orchestra.run.smithi170.stdout: mon health detail to clog = false 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: mon host = "172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790],172.21.15.170" 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: mon client directed command retry = 5 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: mon warn on pool no app = False 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: ms inject socket failures = 5000 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: fsid = f73eea51-5002-4eee-8d85-f2db649bc1b5 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout:[osd] 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: osd journal size = 100 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub load threshold = 5.0 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: osd scrub max interval = 600 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: osd mclock profile = high_recovery_ops 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: osd recover clone overlap = true 2024-04-23T23:36:28.177 INFO:teuthology.orchestra.run.smithi170.stdout: osd recovery max chunk = 1048576 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug shutdown = true 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug op order = true 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug verify stray on activate = true 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug trim objects = true 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd open classes on start = true 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug pg log writeout = true 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd deep scrub update digest min age = 30 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: osd map max advance = 10 2024-04-23T23:36:28.178 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: journal zero on create = true 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: filestore ondisk finisher threads = 3 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: filestore apply finisher threads = 3 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: bdev debug aio = true 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: osd debug misdirected ops = true 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: bdev async discard = True 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: bdev enable discard = True 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore allocator = stupid 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore block size = 96636764160 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: bluestore fsck on mount = True 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluefs = 1/20 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: debug bluestore = 1/20 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-23T23:36:28.179 INFO:teuthology.orchestra.run.smithi170.stdout: debug osd = 20 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: debug rocksdb = 4/10 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd full ratio = 0.9 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd nearfull ratio = 0.8 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: osd blocked scrub grace period = 3600 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: osd failsafe full ratio = 0.95 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: osd max markdown count = 1000 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: osd objectstore = bluestore 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: osd shutdown pgref assert = True 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr] 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: debug mgr = 20 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-23T23:36:28.180 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mgr/telemetry/nag = false 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout:[mon] 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: debug ms = 1 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: debug mon = 20 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: debug paxos = 20 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: debug auth = 20 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon data avail warn = 5 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon mgr mkfs grace = 240 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min pgs per osd = 4 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd reporter subtree level = osd 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon osd prime pg temp = true 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: mon reweight min bytes per osd = 10 2024-04-23T23:36:28.181 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: # 1m isn't quite enough 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: mon_down_mkfs_grace = 2m 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.182 INFO:teuthology.orchestra.run.smithi170.stdout: mon_warn_on_filestore_osds = false 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout:[client] 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: rgw cache enabled = true 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable ops log = true 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: rgw enable usage log = true 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: rbd cache = True 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout: rbd cache policy = writearound 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.a] 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.c] 2024-04-23T23:36:28.183 INFO:teuthology.orchestra.run.smithi170.stdout:[mon.b] 2024-04-23T23:36:28.185 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T23:36:28.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T23:36:28.277 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T23:36:28.277 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:28.278 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T23:36:28.292 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:28.292 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T23:36:28.346 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:36:28.347 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:28.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T23:36:28.347 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T23:36:28.419 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:28.419 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:28.474 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:36:28.474 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:28.474 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T23:36:28.474 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T23:36:28.507 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:28.508 DEBUG:teuthology.orchestra.run.smithi170:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:28.563 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T23:36:28.563 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T23:36:28.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T23:36:28.610 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T23:36:28.612 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T23:36:28.671 INFO:teuthology.orchestra.run.smithi170.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T23:36:28.674 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T23:36:28.674 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T23:36:28.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T23:36:28.712 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T23:36:28.724 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-23T23:36:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-23T23:36:28.775 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T23:36:28.775 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi170.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T23:36:28.775 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T23:36:28.798 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:28.798 INFO:tasks.ceph:role: osd.0 2024-04-23T23:36:28.798 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:36:28.799 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T23:36:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:28.868 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:28.868 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:28.868 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:28.868 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:28.869 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:28.869 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:28.869 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:29.374 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-23T23:36:29.376 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-23T23:36:29.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T23:36:29.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T23:36:29.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T23:36:29.621 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:29.621 INFO:tasks.ceph:role: osd.1 2024-04-23T23:36:29.621 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:36:29.621 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T23:36:29.691 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:29.692 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-23T23:36:30.151 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-23T23:36:30.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-23T23:36:30.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T23:36:30.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T23:36:30.331 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:30.331 INFO:tasks.ceph:role: osd.2 2024-04-23T23:36:30.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:36:30.331 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T23:36:30.401 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:30.402 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:30.891 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-23T23:36:30.893 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-23T23:36:30.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-23T23:36:31.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T23:36:31.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T23:36:31.109 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:31.109 INFO:tasks.ceph:role: osd.3 2024-04-23T23:36:31.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:36:31.110 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:31.180 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:31.688 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-04-23T23:36:31.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-04-23T23:36:31.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-23T23:36:31.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T23:36:31.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:31.966+0000 7fb026c0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-23T23:36:31.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:31.968+0000 7fb026c0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-23T23:36:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:31.968+0000 7fb026c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T23:36:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:31.968+0000 7fb026c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T23:36:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:31.968+0000 7fb026c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T23:36:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:31.969+0000 7fb026c0c640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-23T23:36:34.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T23:36:34.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:34.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:34.938+0000 7f3b8540d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-23T23:36:34.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:34.938+0000 7f3b8540d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-23T23:36:34.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:34.938+0000 7f3b8540d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T23:36:34.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:34.938+0000 7f3b8540d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T23:36:34.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:34.938+0000 7f3b8540d640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T23:36:34.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:34.939+0000 7f3b8540d640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-23T23:36:37.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T23:36:37.806 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:37.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:37.907+0000 7efe9609a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-23T23:36:37.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:37.907+0000 7efe9609a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-23T23:36:37.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:37.907+0000 7efe9609a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T23:36:37.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:37.907+0000 7efe9609a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T23:36:37.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:37.908+0000 7efe9609a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T23:36:37.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:37.908+0000 7efe9609a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-23T23:36:40.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T23:36:40.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:40.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:40.866+0000 7f9de7413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-23T23:36:40.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:40.867+0000 7f9de7413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-23T23:36:40.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:40.867+0000 7f9de7413640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T23:36:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:40.867+0000 7f9de7413640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T23:36:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:40.867+0000 7f9de7413640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T23:36:40.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:36:40.867+0000 7f9de7413640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-23T23:36:43.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T23:36:43.762 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-23T23:36:43.790 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:43.791 INFO:tasks.ceph:role: osd.4 2024-04-23T23:36:43.791 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:36:43.791 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T23:36:43.857 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:43.857 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:43.857 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:43.857 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:43.858 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:43.858 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:43.858 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:43.858 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:43.858 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:43.858 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:43.890 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-23T23:36:43.892 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-23T23:36:43.892 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-23T23:36:43.962 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-23T23:36:44.031 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-23T23:36:44.094 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:44.095 INFO:tasks.ceph:role: osd.5 2024-04-23T23:36:44.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:36:44.095 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T23:36:44.158 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:44.159 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:44.191 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-23T23:36:44.193 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-23T23:36:44.193 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-23T23:36:44.266 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-23T23:36:44.333 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-23T23:36:44.398 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:44.398 INFO:tasks.ceph:role: osd.6 2024-04-23T23:36:44.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:36:44.399 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:44.462 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:44.463 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:44.494 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-23T23:36:44.496 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-23T23:36:44.497 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-23T23:36:44.564 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-23T23:36:44.632 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-23T23:36:44.695 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T23:36:44.695 INFO:tasks.ceph:role: osd.7 2024-04-23T23:36:44.695 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:36:44.695 DEBUG:teuthology.orchestra.run.smithi170:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T23:36:44.757 INFO:teuthology.orchestra.run.smithi170.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout: = sunit=0 swidth=0 blks 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T23:36:44.758 INFO:teuthology.orchestra.run.smithi170.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T23:36:44.790 INFO:teuthology.orchestra.run.smithi170.stdout:Discarding blocks...Done. 2024-04-23T23:36:44.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi170.front.sepia.ceph.com -o noatime 2024-04-23T23:36:44.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-23T23:36:44.860 DEBUG:teuthology.orchestra.run.smithi170:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-23T23:36:44.928 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:45.018 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:45.029+0000 7fc73ac63640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-23T23:36:45.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:45.029+0000 7fc73ac63640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-23T23:36:45.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:45.029+0000 7fc73ac63640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T23:36:45.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:45.029+0000 7fc73ac63640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T23:36:45.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:45.029+0000 7fc73ac63640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T23:36:45.019 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:45.030+0000 7fc73ac63640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-23T23:36:47.857 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T23:36:47.883 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:47.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:47.980+0000 7f952d60c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-23T23:36:47.969 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:47.980+0000 7f952d60c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-23T23:36:47.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:47.980+0000 7f952d60c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T23:36:47.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:47.980+0000 7f952d60c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T23:36:47.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:47.980+0000 7f952d60c640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T23:36:47.970 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:47.980+0000 7f952d60c640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-23T23:36:50.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T23:36:50.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:50.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:50.950+0000 7f81d3711640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-23T23:36:50.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:50.950+0000 7f81d3711640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-23T23:36:50.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:50.950+0000 7f81d3711640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T23:36:50.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:50.950+0000 7f81d3711640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T23:36:50.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:50.950+0000 7f81d3711640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T23:36:50.940 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:50.951+0000 7f81d3711640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-23T23:36:53.787 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-23T23:36:53.815 DEBUG:teuthology.orchestra.run.smithi170:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:53.915+0000 7fe78dc18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-23T23:36:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:53.915+0000 7fe78dc18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-23T23:36:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:53.915+0000 7fe78dc18640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T23:36:53.904 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:53.915+0000 7fe78dc18640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T23:36:53.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:53.915+0000 7fe78dc18640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T23:36:53.905 INFO:teuthology.orchestra.run.smithi170.stderr:2024-04-23T23:36:53.915+0000 7fe78dc18640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-23T23:36:56.761 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-23T23:36:56.788 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T23:36:56.789 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:56.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-23T23:36:56.818 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:56.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T23:36:56.885 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:56.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T23:36:56.952 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:56.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T23:36:57.018 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:57.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T23:36:57.084 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:57.084 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T23:36:57.113 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:57.113 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-23T23:36:57.182 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:57.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-23T23:36:57.250 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:57.250 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-23T23:36:57.316 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:57.317 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-23T23:36:57.382 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:36:57.382 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T23:36:57.399 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:36:57.399 DEBUG:teuthology.orchestra.run.smithi170:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-23T23:36:57.440 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T23:36:57.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T23:36:57.443 DEBUG:teuthology.orchestra.run.smithi170:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD8RShmmIIjJRAAWXHw2vNnv0VUT1ZKDxxubA== 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD/RShmMSmyORAAs58ulm92lTqXdAxnTgohkQ== 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQACRihmZQP9NxAAP/gBUPiScPDlVgp8SFQxqQ== 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-04-23T23:36:57.487 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAFRihmghIpNhAArliOjY2VflyA/ZjI0KTcZw== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAIRihmDAG5MxAAmB2eAytszRl/jcnofRztCg== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD8RShmVN3KKBAAMFGUe1kYe4UXZALjFNjGow== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQANRihm2jHcARAA33oYWRnTZaXIPSq5gWovGg== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAPRihmv86GOhAACH8R+w0fmAlNNomsKrQvXQ== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQASRihmKB3AOBAAGPlzonB2vfjV7ZSb5RoHnQ== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAVRihmgHekNhAARqttxFfswSNkz8svzxodsw== 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-04-23T23:36:57.488 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD8RShmqUM/KxAAd6pNsJzD4jEJwCnwxukVzg== 2024-04-23T23:36:57.489 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-04-23T23:36:57.489 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD8RShmwMlALhAANXQbVeXMobnyuLSbEjR6cQ== 2024-04-23T23:36:57.507 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.y] 2024-04-23T23:36:57.507 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD8RShmmIIjJRAAWXHw2vNnv0VUT1ZKDxxubA== 2024-04-23T23:36:57.507 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.0] 2024-04-23T23:36:57.507 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD/RShmMSmyORAAs58ulm92lTqXdAxnTgohkQ== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.1] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQACRihmZQP9NxAAP/gBUPiScPDlVgp8SFQxqQ== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.2] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAFRihmghIpNhAArliOjY2VflyA/ZjI0KTcZw== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.3] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAIRihmDAG5MxAAmB2eAytszRl/jcnofRztCg== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[mgr.x] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD8RShmVN3KKBAAMFGUe1kYe4UXZALjFNjGow== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.4] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQANRihm2jHcARAA33oYWRnTZaXIPSq5gWovGg== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.5] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAPRihmv86GOhAACH8R+w0fmAlNNomsKrQvXQ== 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.6] 2024-04-23T23:36:57.508 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQASRihmKB3AOBAAGPlzonB2vfjV7ZSb5RoHnQ== 2024-04-23T23:36:57.509 INFO:teuthology.orchestra.run.smithi170.stdout:[osd.7] 2024-04-23T23:36:57.509 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQAVRihmgHekNhAARqttxFfswSNkz8svzxodsw== 2024-04-23T23:36:57.509 INFO:teuthology.orchestra.run.smithi170.stdout:[client.0] 2024-04-23T23:36:57.509 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD8RShmqUM/KxAAd6pNsJzD4jEJwCnwxukVzg== 2024-04-23T23:36:57.509 INFO:teuthology.orchestra.run.smithi170.stdout:[client.1] 2024-04-23T23:36:57.509 INFO:teuthology.orchestra.run.smithi170.stdout: key = AQD8RShmwMlALhAANXQbVeXMobnyuLSbEjR6cQ== 2024-04-23T23:36:57.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T23:36:57.533 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T23:36:57.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.605 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.655 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.658 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.713 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.764 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T23:36:57.816 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T23:36:57.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.916 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:57.966 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:58.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:58.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T23:36:58.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T23:36:58.066 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T23:36:58.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T23:36:58.121 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T23:36:58.172 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T23:36:58.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T23:36:58.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T23:36:58.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T23:36:58.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-23T23:36:58.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T23:36:58.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-23T23:36:58.499 DEBUG:teuthology.orchestra.run.smithi170:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-23T23:36:58.526 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T23:36:58.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-23T23:36:58.643 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:58.646 DEBUG:teuthology.orchestra.run.smithi170:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T23:36:58.698 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T23:36:58.698 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T23:36:58.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T23:36:58.700 INFO:tasks.ceph.mon.a:Started 2024-04-23T23:36:58.700 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-23T23:36:58.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-23T23:36:58.702 INFO:tasks.ceph.mon.c:Started 2024-04-23T23:36:58.703 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-23T23:36:58.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-23T23:36:58.740 INFO:tasks.ceph.mon.b:Started 2024-04-23T23:36:58.741 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T23:36:58.741 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-23T23:36:58.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-23T23:36:58.743 INFO:tasks.ceph.mgr.y:Started 2024-04-23T23:36:58.743 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T23:36:58.744 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T23:36:58.745 INFO:tasks.ceph.mgr.x:Started 2024-04-23T23:36:58.745 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T23:36:58.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T23:37:04.095 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-04-23T23:37:04.106 INFO:tasks.ceph:check_enable_crimson: False 2024-04-23T23:37:04.107 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T23:37:04.107 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:37:04.107 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T23:37:04.131 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:37:04.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T23:37:04.135 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:04.147+0000 7f96dea0f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T23:37:04.195 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:37:04.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T23:37:04.259 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-04-23T23:37:04.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T23:37:04.282 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:04.294+0000 7f96dea0f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T23:37:04.322 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:37:04.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-23T23:37:04.336 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:04.347+0000 7f96dea0f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T23:37:04.346 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:37:04.346 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-23T23:37:04.410 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:37:04.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-23T23:37:04.474 DEBUG:teuthology.orchestra.run.smithi170:> set -ex 2024-04-23T23:37:04.474 DEBUG:teuthology.orchestra.run.smithi170:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-23T23:37:04.538 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 83bcc6ca-0a72-4e35-94f8-5e998f400255 0 2024-04-23T23:37:04.588 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:04.599+0000 7f96dea0f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T23:37:04.636 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:04.648+0000 7f96dea0f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T23:37:04.759 INFO:teuthology.orchestra.run.smithi170.stdout:0 2024-04-23T23:37:04.771 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 1f301988-977e-4d44-8e15-1bb166701438 1 2024-04-23T23:37:04.940 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:04.952+0000 7fd624852040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T23:37:04.990 INFO:teuthology.orchestra.run.smithi170.stdout:1 2024-04-23T23:37:05.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 49ee3814-425e-4ec5-9f7c-b007d26b4249 2 2024-04-23T23:37:05.091 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:05.103+0000 7fd624852040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T23:37:05.145 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:05.157+0000 7fd624852040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T23:37:05.179 INFO:teuthology.orchestra.run.smithi170.stdout:2 2024-04-23T23:37:05.190 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 60cfa342-4270-4d01-b26b-4a9fabb8ff1f 3 2024-04-23T23:37:05.370 INFO:teuthology.orchestra.run.smithi170.stdout:3 2024-04-23T23:37:05.381 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new eba66f3c-1472-4e43-971d-bfc106e6533a 4 2024-04-23T23:37:05.401 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:05.412+0000 7fd624852040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T23:37:05.432 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.444+0000 7f96dea0f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T23:37:05.446 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:05.458+0000 7fd624852040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T23:37:05.523 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.535+0000 7f96dea0f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T23:37:05.561 INFO:teuthology.orchestra.run.smithi170.stdout:4 2024-04-23T23:37:05.567 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.580+0000 7f96dea0f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T23:37:05.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new bf8b21e7-277d-485b-a249-5739b1ea5e14 5 2024-04-23T23:37:05.741 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.753+0000 7f96dea0f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T23:37:05.752 INFO:teuthology.orchestra.run.smithi170.stdout:5 2024-04-23T23:37:05.764 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 9c77bfe9-4574-4be7-b13c-97352d0b36b4 6 2024-04-23T23:37:05.800 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.812+0000 7f96dea0f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T23:37:05.855 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.868+0000 7f96dea0f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T23:37:05.943 INFO:teuthology.orchestra.run.smithi170.stdout:6 2024-04-23T23:37:05.954 DEBUG:teuthology.orchestra.run.smithi170:> sudo ceph --cluster ceph osd new 6a7a0184-9708-4d0a-a230-722480d38bed 7 2024-04-23T23:37:05.973 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:05.985+0000 7f96dea0f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T23:37:06.128 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.140+0000 7fd624852040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T23:37:06.156 INFO:teuthology.orchestra.run.smithi170.stdout:7 2024-04-23T23:37:06.167 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T23:37:06.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-23T23:37:06.170 INFO:tasks.ceph.osd.0:Started 2024-04-23T23:37:06.170 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T23:37:06.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-23T23:37:06.172 INFO:tasks.ceph.osd.1:Started 2024-04-23T23:37:06.172 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T23:37:06.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-23T23:37:06.175 INFO:tasks.ceph.osd.2:Started 2024-04-23T23:37:06.175 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T23:37:06.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T23:37:06.177 INFO:tasks.ceph.osd.3:Started 2024-04-23T23:37:06.178 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-23T23:37:06.178 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-23T23:37:06.180 INFO:tasks.ceph.osd.4:Started 2024-04-23T23:37:06.180 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-23T23:37:06.180 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-23T23:37:06.181 INFO:tasks.ceph.osd.5:Started 2024-04-23T23:37:06.182 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-23T23:37:06.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-23T23:37:06.184 INFO:tasks.ceph.osd.6:Started 2024-04-23T23:37:06.184 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-23T23:37:06.184 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-23T23:37:06.186 INFO:tasks.ceph.osd.7:Started 2024-04-23T23:37:06.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T23:37:06.239 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.251+0000 7fd624852040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T23:37:06.312 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.324+0000 7fd624852040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T23:37:06.383 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:06.396+0000 7f96dea0f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T23:37:06.399 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:06.399 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:37:06.165727+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T23:37:06.165727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:37:06.410 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T23:37:06.411 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T23:37:06.488 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.500+0000 7fd624852040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T23:37:06.536 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.548+0000 7fd624852040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T23:37:06.589 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.601+0000 7fd624852040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T23:37:06.640 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:06.653+0000 7f96dea0f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T23:37:06.692 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:06.704+0000 7f96dea0f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T23:37:06.700 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:06.712+0000 7fd624852040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T23:37:06.772 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:06.783+0000 7f7aa07f8640 -1 Falling back to public interface 2024-04-23T23:37:06.776 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:06.788+0000 7efcc9205640 -1 Falling back to public interface 2024-04-23T23:37:06.779 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:06.791+0000 7fcff29a3640 -1 Falling back to public interface 2024-04-23T23:37:06.790 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:06.802+0000 7f8320e0c640 -1 Falling back to public interface 2024-04-23T23:37:06.790 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:06.802+0000 7fed86e0f640 -1 Falling back to public interface 2024-04-23T23:37:06.798 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:06.809+0000 7f9f2e823640 -1 Falling back to public interface 2024-04-23T23:37:06.800 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:06.813+0000 7f297600c640 -1 Falling back to public interface 2024-04-23T23:37:06.805 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:06.817+0000 7f1b89014640 -1 Falling back to public interface 2024-04-23T23:37:06.813 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:06.825+0000 7f96dea0f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T23:37:07.088 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:07.100+0000 7fd624852040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-23T23:37:07.092 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.104+0000 7f96dea0f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T23:37:07.138 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.151+0000 7f96dea0f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T23:37:07.214 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T23:37:07.292 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.305+0000 7f96dea0f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T23:37:07.354 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:07.366+0000 7fd624852040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T23:37:07.375 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-23T23:37:07.375 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:37:06.165727+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T23:37:06.165727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:37:07.385 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T23:37:07.409 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:07.421+0000 7fd624852040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T23:37:07.429 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.441+0000 7f96dea0f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T23:37:07.477 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.490+0000 7f96dea0f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T23:37:07.523 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:07.535+0000 7fd624852040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-23T23:37:07.547 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.560+0000 7f96dea0f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T23:37:07.592 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:07.604+0000 7f96dea0f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T23:37:07.798 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:07.810+0000 7fd624852040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T23:37:07.846 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:07.857+0000 7fd624852040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T23:37:08.002 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.014+0000 7fd624852040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T23:37:08.065 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:08.077+0000 7f96dea0f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T23:37:08.139 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.151+0000 7fd624852040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T23:37:08.181 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:08.193+0000 7f96dea0f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T23:37:08.192 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.204+0000 7fd624852040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T23:37:08.266 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.278+0000 7fd624852040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T23:37:08.311 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.323+0000 7fd624852040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T23:37:08.784 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.796+0000 7fd624852040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T23:37:08.900 INFO:tasks.ceph.mgr.y.smithi077.stderr:2024-04-23T23:37:08.911+0000 7fd624852040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T23:37:09.196 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:09.207+0000 7f967f3af640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-23T23:37:09.196 INFO:tasks.ceph.mgr.x.smithi170.stderr:2024-04-23T23:37:09.208+0000 7f967f3af640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-23T23:37:10.273 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:10.285+0000 7f7aa07f8640 -1 osd.0 0 log_to_monitors true 2024-04-23T23:37:10.289 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:10.301+0000 7fed86e0f640 -1 osd.1 0 log_to_monitors true 2024-04-23T23:37:10.290 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:10.302+0000 7efcc9205640 -1 osd.3 0 log_to_monitors true 2024-04-23T23:37:10.293 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:10.306+0000 7fcff29a3640 -1 osd.5 0 log_to_monitors true 2024-04-23T23:37:10.306 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:10.319+0000 7f297600c640 -1 osd.6 0 log_to_monitors true 2024-04-23T23:37:10.317 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:10.329+0000 7f9f2e823640 -1 osd.2 0 log_to_monitors true 2024-04-23T23:37:10.319 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:10.332+0000 7f1b89014640 -1 osd.4 0 log_to_monitors true 2024-04-23T23:37:10.332 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:10.344+0000 7f8320e0c640 -1 osd.7 0 log_to_monitors true 2024-04-23T23:37:13.606 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:13.617+0000 7fcfee116640 -1 osd.5 0 waiting for initial osdmap 2024-04-23T23:37:13.620 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:13.632+0000 7fcfe6748640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:13.651 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:13.663+0000 7f1b8425a640 -1 osd.4 0 waiting for initial osdmap 2024-04-23T23:37:13.667 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:13.680+0000 7f1b7c88c640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:13.689 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:13.702+0000 7f29729f4640 -1 osd.6 0 waiting for initial osdmap 2024-04-23T23:37:13.700 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:13.712+0000 7f831c052640 -1 osd.7 0 waiting for initial osdmap 2024-04-23T23:37:13.703 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:13.716+0000 7f29697ee640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:13.716 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:13.728+0000 7f8314684640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:14.192 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T23:37:14.354 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:14.366+0000 7efcc4978640 -1 osd.3 0 waiting for initial osdmap 2024-04-23T23:37:14.392 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:14.404+0000 7f7a9bf6b640 -1 osd.0 0 waiting for initial osdmap 2024-04-23T23:37:14.394 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:14.406+0000 7efcbcfaa640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:14.433 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:14.445+0000 7f7a9459d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:14.438 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:14.450+0000 7f9f29947640 -1 osd.2 0 waiting for initial osdmap 2024-04-23T23:37:14.471 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:14.483+0000 7f9f21f79640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:14.574 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-23T23:37:14.574 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":12,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:37:12.208960+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T23:37:06.165727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:37:14.589 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T23:37:14.696 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:14.708+0000 7fed837bf640 -1 osd.1 0 waiting for initial osdmap 2024-04-23T23:37:14.712 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:14.724+0000 7fed7a5b9640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:21.396 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T23:37:21.683 INFO:teuthology.misc.health.smithi077.stdout: 2024-04-23T23:37:21.683 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":17,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:37:18.724473+0000","last_up_change":"2024-04-23T23:37:15.711895+0000","last_in_change":"2024-04-23T23:37:06.165727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T23:37:16.233938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6801","nonce":1910915292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6803","nonce":1910915292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6807","nonce":1910915292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6805","nonce":1910915292}]},"public_addr":"172.21.15.77:6801/1910915292","cluster_addr":"172.21.15.77:6803/1910915292","heartbeat_back_addr":"172.21.15.77:6807/1910915292","heartbeat_front_addr":"172.21.15.77:6805/1910915292","state":["exists","up"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6817","nonce":2701012491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6819","nonce":2701012491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6823","nonce":2701012491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6821","nonce":2701012491}]},"public_addr":"172.21.15.77:6817/2701012491","cluster_addr":"172.21.15.77:6819/2701012491","heartbeat_back_addr":"172.21.15.77:6823/2701012491","heartbeat_front_addr":"172.21.15.77:6821/2701012491","state":["exists","up"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6825","nonce":14105002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6827","nonce":14105002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6831","nonce":14105002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6829","nonce":14105002}]},"public_addr":"172.21.15.77:6825/14105002","cluster_addr":"172.21.15.77:6827/14105002","heartbeat_back_addr":"172.21.15.77:6831/14105002","heartbeat_front_addr":"172.21.15.77:6829/14105002","state":["exists","up"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6809","nonce":4292713565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6811","nonce":4292713565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6815","nonce":4292713565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6813","nonce":4292713565}]},"public_addr":"172.21.15.77:6809/4292713565","cluster_addr":"172.21.15.77:6811/4292713565","heartbeat_back_addr":"172.21.15.77:6815/4292713565","heartbeat_front_addr":"172.21.15.77:6813/4292713565","state":["exists","up"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6825","nonce":1333725690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6827","nonce":1333725690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6831","nonce":1333725690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6829","nonce":1333725690}]},"public_addr":"172.21.15.170:6825/1333725690","cluster_addr":"172.21.15.170:6827/1333725690","heartbeat_back_addr":"172.21.15.170:6831/1333725690","heartbeat_front_addr":"172.21.15.170:6829/1333725690","state":["exists","up"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6801","nonce":2614189917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6803","nonce":2614189917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6807","nonce":2614189917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6805","nonce":2614189917}]},"public_addr":"172.21.15.170:6801/2614189917","cluster_addr":"172.21.15.170:6803/2614189917","heartbeat_back_addr":"172.21.15.170:6807/2614189917","heartbeat_front_addr":"172.21.15.170:6805/2614189917","state":["exists","up"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6817","nonce":1055419423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6819","nonce":1055419423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6823","nonce":1055419423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6821","nonce":1055419423}]},"public_addr":"172.21.15.170:6817/1055419423","cluster_addr":"172.21.15.170:6819/1055419423","heartbeat_back_addr":"172.21.15.170:6823/1055419423","heartbeat_front_addr":"172.21.15.170:6821/1055419423","state":["exists","up"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6809","nonce":2863840516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6811","nonce":2863840516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6815","nonce":2863840516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6813","nonce":2863840516}]},"public_addr":"172.21.15.170:6809/2863840516","cluster_addr":"172.21.15.170:6811/2863840516","heartbeat_back_addr":"172.21.15.170:6815/2863840516","heartbeat_front_addr":"172.21.15.170:6813/2863840516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.291145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.258527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.327333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.322206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.377293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.334347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.311178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.388211+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:37:21.695 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-23T23:37:21.695 INFO:tasks.ceph:Creating RBD pool 2024-04-23T23:37:21.695 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-23T23:37:22.734 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'rbd' created 2024-04-23T23:37:22.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-23T23:37:23.740 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-23T23:37:23.757 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T23:37:23.758 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T23:37:23.758 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T23:37:23.758 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T23:37:23.758 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T23:37:24.095 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:24.106 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6832","nonce":3552921691},{"type":"v1","addr":"172.21.15.170:6833","nonce":3552921691}]},"active_addr":"172.21.15.170:6833/3552921691","active_change":"2024-04-23T23:37:08.195872+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4112,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1523461219}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":3821296489}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":2229715387}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.170:0","nonce":1014024678}]}]} 2024-04-23T23:37:24.112 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T23:37:24.112 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T23:37:24.113 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T23:37:24.395 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:24.395 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:37:23.747576+0000","last_up_change":"2024-04-23T23:37:15.711895+0000","last_in_change":"2024-04-23T23:37:06.165727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T23:37:16.233938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T23:37:22.007673+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6801","nonce":1910915292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6803","nonce":1910915292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6807","nonce":1910915292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6805","nonce":1910915292}]},"public_addr":"172.21.15.77:6801/1910915292","cluster_addr":"172.21.15.77:6803/1910915292","heartbeat_back_addr":"172.21.15.77:6807/1910915292","heartbeat_front_addr":"172.21.15.77:6805/1910915292","state":["exists","up"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6817","nonce":2701012491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6819","nonce":2701012491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6823","nonce":2701012491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6821","nonce":2701012491}]},"public_addr":"172.21.15.77:6817/2701012491","cluster_addr":"172.21.15.77:6819/2701012491","heartbeat_back_addr":"172.21.15.77:6823/2701012491","heartbeat_front_addr":"172.21.15.77:6821/2701012491","state":["exists","up"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6825","nonce":14105002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6827","nonce":14105002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6831","nonce":14105002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6829","nonce":14105002}]},"public_addr":"172.21.15.77:6825/14105002","cluster_addr":"172.21.15.77:6827/14105002","heartbeat_back_addr":"172.21.15.77:6831/14105002","heartbeat_front_addr":"172.21.15.77:6829/14105002","state":["exists","up"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6809","nonce":4292713565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6811","nonce":4292713565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6815","nonce":4292713565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6813","nonce":4292713565}]},"public_addr":"172.21.15.77:6809/4292713565","cluster_addr":"172.21.15.77:6811/4292713565","heartbeat_back_addr":"172.21.15.77:6815/4292713565","heartbeat_front_addr":"172.21.15.77:6813/4292713565","state":["exists","up"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6825","nonce":1333725690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6827","nonce":1333725690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6831","nonce":1333725690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6829","nonce":1333725690}]},"public_addr":"172.21.15.170:6825/1333725690","cluster_addr":"172.21.15.170:6827/1333725690","heartbeat_back_addr":"172.21.15.170:6831/1333725690","heartbeat_front_addr":"172.21.15.170:6829/1333725690","state":["exists","up"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6801","nonce":2614189917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6803","nonce":2614189917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6807","nonce":2614189917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6805","nonce":2614189917}]},"public_addr":"172.21.15.170:6801/2614189917","cluster_addr":"172.21.15.170:6803/2614189917","heartbeat_back_addr":"172.21.15.170:6807/2614189917","heartbeat_front_addr":"172.21.15.170:6805/2614189917","state":["exists","up"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6817","nonce":1055419423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6819","nonce":1055419423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6823","nonce":1055419423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6821","nonce":1055419423}]},"public_addr":"172.21.15.170:6817/1055419423","cluster_addr":"172.21.15.170:6819/1055419423","heartbeat_back_addr":"172.21.15.170:6823/1055419423","heartbeat_front_addr":"172.21.15.170:6821/1055419423","state":["exists","up"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6809","nonce":2863840516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6811","nonce":2863840516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6815","nonce":2863840516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6813","nonce":2863840516}]},"public_addr":"172.21.15.170:6809/2863840516","cluster_addr":"172.21.15.170:6811/2863840516","heartbeat_back_addr":"172.21.15.170:6815/2863840516","heartbeat_front_addr":"172.21.15.170:6813/2863840516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.291145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.258527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.327333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.322206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.377293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.334347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.311178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.388211+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:37:24.408 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T23:37:24.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T23:37:24.687 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:24.687 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":19,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:37:23.747576+0000","last_up_change":"2024-04-23T23:37:15.711895+0000","last_in_change":"2024-04-23T23:37:06.165727+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T23:37:16.233938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T23:37:22.007673+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6801","nonce":1910915292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6803","nonce":1910915292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6807","nonce":1910915292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6805","nonce":1910915292}]},"public_addr":"172.21.15.77:6801/1910915292","cluster_addr":"172.21.15.77:6803/1910915292","heartbeat_back_addr":"172.21.15.77:6807/1910915292","heartbeat_front_addr":"172.21.15.77:6805/1910915292","state":["exists","up"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6817","nonce":2701012491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6819","nonce":2701012491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6823","nonce":2701012491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6821","nonce":2701012491}]},"public_addr":"172.21.15.77:6817/2701012491","cluster_addr":"172.21.15.77:6819/2701012491","heartbeat_back_addr":"172.21.15.77:6823/2701012491","heartbeat_front_addr":"172.21.15.77:6821/2701012491","state":["exists","up"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6825","nonce":14105002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6827","nonce":14105002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6831","nonce":14105002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6829","nonce":14105002}]},"public_addr":"172.21.15.77:6825/14105002","cluster_addr":"172.21.15.77:6827/14105002","heartbeat_back_addr":"172.21.15.77:6831/14105002","heartbeat_front_addr":"172.21.15.77:6829/14105002","state":["exists","up"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6809","nonce":4292713565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6811","nonce":4292713565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6815","nonce":4292713565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":4292713565},{"type":"v1","addr":"172.21.15.77:6813","nonce":4292713565}]},"public_addr":"172.21.15.77:6809/4292713565","cluster_addr":"172.21.15.77:6811/4292713565","heartbeat_back_addr":"172.21.15.77:6815/4292713565","heartbeat_front_addr":"172.21.15.77:6813/4292713565","state":["exists","up"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6825","nonce":1333725690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6827","nonce":1333725690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6831","nonce":1333725690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6829","nonce":1333725690}]},"public_addr":"172.21.15.170:6825/1333725690","cluster_addr":"172.21.15.170:6827/1333725690","heartbeat_back_addr":"172.21.15.170:6831/1333725690","heartbeat_front_addr":"172.21.15.170:6829/1333725690","state":["exists","up"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6801","nonce":2614189917}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6803","nonce":2614189917}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6807","nonce":2614189917}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2614189917},{"type":"v1","addr":"172.21.15.170:6805","nonce":2614189917}]},"public_addr":"172.21.15.170:6801/2614189917","cluster_addr":"172.21.15.170:6803/2614189917","heartbeat_back_addr":"172.21.15.170:6807/2614189917","heartbeat_front_addr":"172.21.15.170:6805/2614189917","state":["exists","up"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6817","nonce":1055419423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6819","nonce":1055419423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6823","nonce":1055419423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6821","nonce":1055419423}]},"public_addr":"172.21.15.170:6817/1055419423","cluster_addr":"172.21.15.170:6819/1055419423","heartbeat_back_addr":"172.21.15.170:6823/1055419423","heartbeat_front_addr":"172.21.15.170:6821/1055419423","state":["exists","up"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6809","nonce":2863840516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6811","nonce":2863840516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6815","nonce":2863840516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6813","nonce":2863840516}]},"public_addr":"172.21.15.170:6809/2863840516","cluster_addr":"172.21.15.170:6811/2863840516","heartbeat_back_addr":"172.21.15.170:6815/2863840516","heartbeat_front_addr":"172.21.15.170:6813/2863840516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.291145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.258527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.327333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.322206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.377293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.334347+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.311178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.388211+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:37:24.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T23:37:24.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T23:37:24.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T23:37:24.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T23:37:24.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T23:37:24.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T23:37:24.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T23:37:24.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T23:37:24.935 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2024-04-23T23:37:24.935 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T23:37:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:60129542148 2024-04-23T23:37:24.939 INFO:teuthology.orchestra.run.smithi077.stdout:55834574851 2024-04-23T23:37:24.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T23:37:24.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T23:37:24.943 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-23T23:37:24.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T23:37:24.948 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2024-04-23T23:37:24.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T23:37:24.951 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-23T23:37:24.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T23:37:24.954 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2024-04-23T23:37:24.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T23:37:24.955 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2024-04-23T23:37:24.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T23:37:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:60129542147 2024-04-23T23:37:25.521 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-23T23:37:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:55834574851 2024-04-23T23:37:25.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542147 for osd.1 2024-04-23T23:37:25.541 INFO:teuthology.orchestra.run.smithi077.stdout:55834574850 2024-04-23T23:37:25.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-23T23:37:25.549 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2024-04-23T23:37:25.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.5 2024-04-23T23:37:25.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.3 2024-04-23T23:37:25.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-04-23T23:37:25.567 INFO:teuthology.orchestra.run.smithi077.stdout:55834574851 2024-04-23T23:37:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:55834574851 2024-04-23T23:37:25.576 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2024-04-23T23:37:25.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-04-23T23:37:25.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-04-23T23:37:25.590 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-04-23T23:37:26.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T23:37:26.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T23:37:26.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T23:37:26.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T23:37:26.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T23:37:26.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T23:37:26.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T23:37:26.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T23:37:27.092 INFO:teuthology.orchestra.run.smithi077.stdout:60129542148 2024-04-23T23:37:27.112 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2024-04-23T23:37:27.113 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.136 INFO:teuthology.orchestra.run.smithi077.stdout:55834574855 2024-04-23T23:37:27.150 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2024-04-23T23:37:27.150 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.162 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2024-04-23T23:37:27.171 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-23T23:37:27.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-04-23T23:37:27.179 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.5 2024-04-23T23:37:27.186 INFO:teuthology.orchestra.run.smithi077.stdout:55834574852 2024-04-23T23:37:27.186 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.203 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.3 2024-04-23T23:37:27.204 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.218 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-23T23:37:27.228 INFO:teuthology.orchestra.run.smithi077.stdout:55834574854 2024-04-23T23:37:27.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.4 2024-04-23T23:37:27.231 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.238 INFO:teuthology.orchestra.run.smithi077.stdout:55834574853 2024-04-23T23:37:27.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2024-04-23T23:37:27.241 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574853 for osd.7 2024-04-23T23:37:27.251 DEBUG:teuthology.parallel:result is None 2024-04-23T23:37:27.251 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T23:37:27.251 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:37:27.571 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:27.571 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:37:27.583 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-23T23:37:26.203835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235524,"kb_used_data":2688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739196,"statfs":{"total":773094113280,"available":772852936704,"internally_reserved":0,"allocated":2752512,"data_stored":1685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000602"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.757299+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:37:23.757299+0000","last_peered":"2024-04-23T23:37:23.757299+0000","last_clean":"2024-04-23T23:37:23.757299+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:37:23.757299+0000","last_undegraded":"2024-04-23T23:37:23.757299+0000","last_fullsized":"2024-04-23T23:37:23.757299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:55.858873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.763967+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:37:24.763967+0000","last_peered":"2024-04-23T23:37:24.763967+0000","last_clean":"2024-04-23T23:37:24.763967+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:37:24.763967+0000","last_undegraded":"2024-04-23T23:37:24.763967+0000","last_fullsized":"2024-04-23T23:37:24.763967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.109969+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:37:24.109969+0000","last_peered":"2024-04-23T23:37:24.109969+0000","last_clean":"2024-04-23T23:37:24.109969+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:37:24.109969+0000","last_undegraded":"2024-04-23T23:37:24.109969+0000","last_fullsized":"2024-04-23T23:37:24.109969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:45.157867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.764095+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:37:24.764095+0000","last_peered":"2024-04-23T23:37:24.764095+0000","last_clean":"2024-04-23T23:37:24.764095+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:37:24.764095+0000","last_undegraded":"2024-04-23T23:37:24.764095+0000","last_fullsized":"2024-04-23T23:37:24.764095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.758671+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.758318+0000","last_became_peered":"2024-04-23T23:37:23.758318+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:31.374849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.768328+0000","last_change":"2024-04-23T23:37:23.757594+0000","last_active":"2024-04-23T23:37:24.768328+0000","last_peered":"2024-04-23T23:37:24.768328+0000","last_clean":"2024-04-23T23:37:24.768328+0000","last_became_active":"2024-04-23T23:37:23.757261+0000","last_became_peered":"2024-04-23T23:37:23.757261+0000","last_unstale":"2024-04-23T23:37:24.768328+0000","last_undegraded":"2024-04-23T23:37:24.768328+0000","last_fullsized":"2024-04-23T23:37:24.768328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:59.738962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.759330+0000","last_change":"2024-04-23T23:37:23.758766+0000","last_active":"2024-04-23T23:37:23.759330+0000","last_peered":"2024-04-23T23:37:23.759330+0000","last_clean":"2024-04-23T23:37:23.759330+0000","last_became_active":"2024-04-23T23:37:23.758418+0000","last_became_peered":"2024-04-23T23:37:23.758418+0000","last_unstale":"2024-04-23T23:37:23.759330+0000","last_undegraded":"2024-04-23T23:37:23.759330+0000","last_fullsized":"2024-04-23T23:37:23.759330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:34.312936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.756137+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.755788+0000","last_became_peered":"2024-04-23T23:37:23.755788+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:23.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.753784+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:37:23.753784+0000","last_peered":"2024-04-23T23:37:23.753784+0000","last_clean":"2024-04-23T23:37:23.753784+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:37:23.753784+0000","last_undegraded":"2024-04-23T23:37:23.753784+0000","last_fullsized":"2024-04-23T23:37:23.753784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":652075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:37:27.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:37:27.863 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:27.864 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:37:27.876 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-04-23T23:37:26.203835+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235524,"kb_used_data":2688,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739196,"statfs":{"total":773094113280,"available":772852936704,"internally_reserved":0,"allocated":2752512,"data_stored":1685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000602"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.757299+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:37:23.757299+0000","last_peered":"2024-04-23T23:37:23.757299+0000","last_clean":"2024-04-23T23:37:23.757299+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:37:23.757299+0000","last_undegraded":"2024-04-23T23:37:23.757299+0000","last_fullsized":"2024-04-23T23:37:23.757299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:55.858873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.763967+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:37:24.763967+0000","last_peered":"2024-04-23T23:37:24.763967+0000","last_clean":"2024-04-23T23:37:24.763967+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:37:24.763967+0000","last_undegraded":"2024-04-23T23:37:24.763967+0000","last_fullsized":"2024-04-23T23:37:24.763967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.109969+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:37:24.109969+0000","last_peered":"2024-04-23T23:37:24.109969+0000","last_clean":"2024-04-23T23:37:24.109969+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:37:24.109969+0000","last_undegraded":"2024-04-23T23:37:24.109969+0000","last_fullsized":"2024-04-23T23:37:24.109969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:45.157867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.764095+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:37:24.764095+0000","last_peered":"2024-04-23T23:37:24.764095+0000","last_clean":"2024-04-23T23:37:24.764095+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:37:24.764095+0000","last_undegraded":"2024-04-23T23:37:24.764095+0000","last_fullsized":"2024-04-23T23:37:24.764095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.758671+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.758318+0000","last_became_peered":"2024-04-23T23:37:23.758318+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:31.374849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.768328+0000","last_change":"2024-04-23T23:37:23.757594+0000","last_active":"2024-04-23T23:37:24.768328+0000","last_peered":"2024-04-23T23:37:24.768328+0000","last_clean":"2024-04-23T23:37:24.768328+0000","last_became_active":"2024-04-23T23:37:23.757261+0000","last_became_peered":"2024-04-23T23:37:23.757261+0000","last_unstale":"2024-04-23T23:37:24.768328+0000","last_undegraded":"2024-04-23T23:37:24.768328+0000","last_fullsized":"2024-04-23T23:37:24.768328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:59.738962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.759330+0000","last_change":"2024-04-23T23:37:23.758766+0000","last_active":"2024-04-23T23:37:23.759330+0000","last_peered":"2024-04-23T23:37:23.759330+0000","last_clean":"2024-04-23T23:37:23.759330+0000","last_became_active":"2024-04-23T23:37:23.758418+0000","last_became_peered":"2024-04-23T23:37:23.758418+0000","last_unstale":"2024-04-23T23:37:23.759330+0000","last_undegraded":"2024-04-23T23:37:23.759330+0000","last_fullsized":"2024-04-23T23:37:23.759330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:34.312936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.756137+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.755788+0000","last_became_peered":"2024-04-23T23:37:23.755788+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:23.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.753784+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:37:23.753784+0000","last_peered":"2024-04-23T23:37:23.753784+0000","last_clean":"2024-04-23T23:37:23.753784+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:37:23.753784+0000","last_undegraded":"2024-04-23T23:37:23.753784+0000","last_fullsized":"2024-04-23T23:37:23.753784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":652075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:37:27.876 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T23:37:27.877 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T23:37:27.877 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T23:37:27.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T23:37:28.195 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T23:37:28.208 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T23:37:28.209 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-23T23:37:28.301 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-23T23:37:28.301 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd cache': True, 'rbd cache policy': 'writearound'}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED'], 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b98aab6c00f483888c049d0d8e7bc507e115dd86'}} 2024-04-23T23:37:28.301 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-23T23:37:28.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-23T23:37:28.601 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-23T23:37:28.601 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T23:37:28.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:37:28.882 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:28.882 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:37:28.894 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-23T23:37:28.204218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235540,"kb_used_data":2700,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739180,"statfs":{"total":773094113280,"available":772852920320,"internally_reserved":0,"allocated":2764800,"data_stored":1691636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000985"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.757299+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:37:23.757299+0000","last_peered":"2024-04-23T23:37:23.757299+0000","last_clean":"2024-04-23T23:37:23.757299+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:37:23.757299+0000","last_undegraded":"2024-04-23T23:37:23.757299+0000","last_fullsized":"2024-04-23T23:37:23.757299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:55.858873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.763967+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:37:24.763967+0000","last_peered":"2024-04-23T23:37:24.763967+0000","last_clean":"2024-04-23T23:37:24.763967+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:37:24.763967+0000","last_undegraded":"2024-04-23T23:37:24.763967+0000","last_fullsized":"2024-04-23T23:37:24.763967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.109969+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:37:24.109969+0000","last_peered":"2024-04-23T23:37:24.109969+0000","last_clean":"2024-04-23T23:37:24.109969+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:37:24.109969+0000","last_undegraded":"2024-04-23T23:37:24.109969+0000","last_fullsized":"2024-04-23T23:37:24.109969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:45.157867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.764095+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:37:24.764095+0000","last_peered":"2024-04-23T23:37:24.764095+0000","last_clean":"2024-04-23T23:37:24.764095+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:37:24.764095+0000","last_undegraded":"2024-04-23T23:37:24.764095+0000","last_fullsized":"2024-04-23T23:37:24.764095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.758671+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.758318+0000","last_became_peered":"2024-04-23T23:37:23.758318+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:31.374849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.768328+0000","last_change":"2024-04-23T23:37:23.757594+0000","last_active":"2024-04-23T23:37:24.768328+0000","last_peered":"2024-04-23T23:37:24.768328+0000","last_clean":"2024-04-23T23:37:24.768328+0000","last_became_active":"2024-04-23T23:37:23.757261+0000","last_became_peered":"2024-04-23T23:37:23.757261+0000","last_unstale":"2024-04-23T23:37:24.768328+0000","last_undegraded":"2024-04-23T23:37:24.768328+0000","last_fullsized":"2024-04-23T23:37:24.768328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:59.738962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.759330+0000","last_change":"2024-04-23T23:37:23.758766+0000","last_active":"2024-04-23T23:37:23.759330+0000","last_peered":"2024-04-23T23:37:23.759330+0000","last_clean":"2024-04-23T23:37:23.759330+0000","last_became_active":"2024-04-23T23:37:23.758418+0000","last_became_peered":"2024-04-23T23:37:23.758418+0000","last_unstale":"2024-04-23T23:37:23.759330+0000","last_undegraded":"2024-04-23T23:37:23.759330+0000","last_fullsized":"2024-04-23T23:37:23.759330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:34.312936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.756137+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.755788+0000","last_became_peered":"2024-04-23T23:37:23.755788+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:23.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.753784+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:37:23.753784+0000","last_peered":"2024-04-23T23:37:23.753784+0000","last_clean":"2024-04-23T23:37:23.753784+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:37:23.753784+0000","last_undegraded":"2024-04-23T23:37:23.753784+0000","last_fullsized":"2024-04-23T23:37:23.753784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":652075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:37:28.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:37:29.173 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:29.173 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:37:29.184 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-23T23:37:28.204218+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235540,"kb_used_data":2700,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739180,"statfs":{"total":773094113280,"available":772852920320,"internally_reserved":0,"allocated":2764800,"data_stored":1691636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000985"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.757299+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:37:23.757299+0000","last_peered":"2024-04-23T23:37:23.757299+0000","last_clean":"2024-04-23T23:37:23.757299+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:37:23.757299+0000","last_undegraded":"2024-04-23T23:37:23.757299+0000","last_fullsized":"2024-04-23T23:37:23.757299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:55.858873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.763967+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:37:24.763967+0000","last_peered":"2024-04-23T23:37:24.763967+0000","last_clean":"2024-04-23T23:37:24.763967+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:37:24.763967+0000","last_undegraded":"2024-04-23T23:37:24.763967+0000","last_fullsized":"2024-04-23T23:37:24.763967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.109969+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:37:24.109969+0000","last_peered":"2024-04-23T23:37:24.109969+0000","last_clean":"2024-04-23T23:37:24.109969+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:37:24.109969+0000","last_undegraded":"2024-04-23T23:37:24.109969+0000","last_fullsized":"2024-04-23T23:37:24.109969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:45.157867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.764095+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:37:24.764095+0000","last_peered":"2024-04-23T23:37:24.764095+0000","last_clean":"2024-04-23T23:37:24.764095+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:37:24.764095+0000","last_undegraded":"2024-04-23T23:37:24.764095+0000","last_fullsized":"2024-04-23T23:37:24.764095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.758671+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.758318+0000","last_became_peered":"2024-04-23T23:37:23.758318+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:31.374849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.768328+0000","last_change":"2024-04-23T23:37:23.757594+0000","last_active":"2024-04-23T23:37:24.768328+0000","last_peered":"2024-04-23T23:37:24.768328+0000","last_clean":"2024-04-23T23:37:24.768328+0000","last_became_active":"2024-04-23T23:37:23.757261+0000","last_became_peered":"2024-04-23T23:37:23.757261+0000","last_unstale":"2024-04-23T23:37:24.768328+0000","last_undegraded":"2024-04-23T23:37:24.768328+0000","last_fullsized":"2024-04-23T23:37:24.768328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:59.738962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.759330+0000","last_change":"2024-04-23T23:37:23.758766+0000","last_active":"2024-04-23T23:37:23.759330+0000","last_peered":"2024-04-23T23:37:23.759330+0000","last_clean":"2024-04-23T23:37:23.759330+0000","last_became_active":"2024-04-23T23:37:23.758418+0000","last_became_peered":"2024-04-23T23:37:23.758418+0000","last_unstale":"2024-04-23T23:37:23.759330+0000","last_undegraded":"2024-04-23T23:37:23.759330+0000","last_fullsized":"2024-04-23T23:37:23.759330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:34.312936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.756137+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.755788+0000","last_became_peered":"2024-04-23T23:37:23.755788+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:23.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.753784+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:37:23.753784+0000","last_peered":"2024-04-23T23:37:23.753784+0000","last_clean":"2024-04-23T23:37:23.753784+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:37:23.753784+0000","last_undegraded":"2024-04-23T23:37:23.753784+0000","last_fullsized":"2024-04-23T23:37:23.753784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":652075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:37:29.185 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T23:37:29.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-23T23:37:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 20 2024-04-23T23:37:29.466 INFO:teuthology.orchestra.run.smithi077.stdout:fsid f73eea51-5002-4eee-8d85-f2db649bc1b5 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-04-23T23:37:04.013555+0000 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-04-23T23:37:24.754197+0000 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:crush_version 4 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:full_ratio 0.95 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:backfillfull_ratio 0.9 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:nearfull_ratio 0.85 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:require_min_compat_client luminous 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:min_compat_client jewel 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:require_osd_release squid 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:stretch_mode_enabled false 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:max_osd 8 2024-04-23T23:37:29.467 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6800/1910915292,v1:172.21.15.77:6801/1910915292] [v2:172.21.15.77:6802/1910915292,v1:172.21.15.77:6803/1910915292] exists,up 83bcc6ca-0a72-4e35-94f8-5e998f400255 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6816/2701012491,v1:172.21.15.77:6817/2701012491] [v2:172.21.15.77:6818/2701012491,v1:172.21.15.77:6819/2701012491] exists,up 1f301988-977e-4d44-8e15-1bb166701438 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6824/14105002,v1:172.21.15.77:6825/14105002] [v2:172.21.15.77:6826/14105002,v1:172.21.15.77:6827/14105002] exists,up 49ee3814-425e-4ec5-9f7c-b007d26b4249 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6808/4292713565,v1:172.21.15.77:6809/4292713565] [v2:172.21.15.77:6810/4292713565,v1:172.21.15.77:6811/4292713565] exists,up 60cfa342-4270-4d01-b26b-4a9fabb8ff1f 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6824/1333725690,v1:172.21.15.170:6825/1333725690] [v2:172.21.15.170:6826/1333725690,v1:172.21.15.170:6827/1333725690] exists,up eba66f3c-1472-4e43-971d-bfc106e6533a 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6800/2614189917,v1:172.21.15.170:6801/2614189917] [v2:172.21.15.170:6802/2614189917,v1:172.21.15.170:6803/2614189917] exists,up bf8b21e7-277d-485b-a249-5739b1ea5e14 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6816/1055419423,v1:172.21.15.170:6817/1055419423] [v2:172.21.15.170:6818/1055419423,v1:172.21.15.170:6819/1055419423] exists,up 9c77bfe9-4574-4be7-b13c-97352d0b36b4 2024-04-23T23:37:29.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6808/2863840516,v1:172.21.15.170:6809/2863840516] [v2:172.21.15.170:6810/2863840516,v1:172.21.15.170:6811/2863840516] exists,up 6a7a0184-9708-4d0a-a230-722480d38bed 2024-04-23T23:37:29.479 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6800/1910915292,v1:172.21.15.77:6801/1910915292] [v2:172.21.15.77:6802/1910915292,v1:172.21.15.77:6803/1910915292] exists,up 83bcc6ca-0a72-4e35-94f8-5e998f400255', 'osd.1 up in weight 1 up_from 14 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6816/2701012491,v1:172.21.15.77:6817/2701012491] [v2:172.21.15.77:6818/2701012491,v1:172.21.15.77:6819/2701012491] exists,up 1f301988-977e-4d44-8e15-1bb166701438', 'osd.2 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6824/14105002,v1:172.21.15.77:6825/14105002] [v2:172.21.15.77:6826/14105002,v1:172.21.15.77:6827/14105002] exists,up 49ee3814-425e-4ec5-9f7c-b007d26b4249', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6808/4292713565,v1:172.21.15.77:6809/4292713565] [v2:172.21.15.77:6810/4292713565,v1:172.21.15.77:6811/4292713565] exists,up 60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6824/1333725690,v1:172.21.15.170:6825/1333725690] [v2:172.21.15.170:6826/1333725690,v1:172.21.15.170:6827/1333725690] exists,up eba66f3c-1472-4e43-971d-bfc106e6533a', 'osd.5 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6800/2614189917,v1:172.21.15.170:6801/2614189917] [v2:172.21.15.170:6802/2614189917,v1:172.21.15.170:6803/2614189917] exists,up bf8b21e7-277d-485b-a249-5739b1ea5e14', 'osd.6 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6816/1055419423,v1:172.21.15.170:6817/1055419423] [v2:172.21.15.170:6818/1055419423,v1:172.21.15.170:6819/1055419423] exists,up 9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'osd.7 up in weight 1 up_from 13 up_thru 18 down_at 0 last_clean_interval [0,0) [v2:172.21.15.170:6808/2863840516,v1:172.21.15.170:6809/2863840516] [v2:172.21.15.170:6810/2863840516,v1:172.21.15.170:6811/2863840516] exists,up 6a7a0184-9708-4d0a-a230-722480d38bed'] 2024-04-23T23:37:29.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-23T23:37:29.576 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mon.a", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster": "ceph", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "admin_socket_mode": "", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_client_required": "cephx, none", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_cluster_required": "cephx", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_debug": "true", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_service_required": "cephx", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-23T23:37:29.577 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_supported": "cephx", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio": "true", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio_poll_ms": "250", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_aio_reap_max": "16", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_async_discard": "false", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_block_size": "4096", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_aio": "false", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_debug_inflight_ios": "false", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_enable_discard": "false", 2024-04-23T23:37:29.578 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_flock_retry": "3", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_inject_crash": "0", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_ioring": "false", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_ioring_hipri": "false", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bdev_type": "", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_alloc_size": "1048576", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_allocator": "hybrid", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_buffered_io": "true", 2024-04-23T23:37:29.579 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_check_for_zeros": "false", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_compact_log_sync": "false", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_max_log_runway": "4194304", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_max_prefetch": "1048576", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_min_flush_size": "524288", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_min_log_runway": "1048576", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_replay_recovery": "false", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-23T23:37:29.580 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluefs_sync_write": "false", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_allocation_from_file": "true", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_allocator": "hybrid", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-23T23:37:29.581 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_create": "true", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_db_create": "false", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_db_path": "", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_db_size": "0", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_path": "", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_preallocate_file": "false", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_size": "107374182400", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_wal_create": "false", 2024-04-23T23:37:29.582 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_wal_path": "", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_block_wal_size": "100663296", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs": "true", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-23T23:37:29.583 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_autotune": "true", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_size": "0", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-23T23:37:29.584 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cache_type": "2q", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_clone_cow": "true", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_mode": "none", 2024-04-23T23:37:29.585 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_csum_type": "crc32c", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_freelist": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-23T23:37:29.586 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_small_allocations": "0", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_default_buffered_read": "true", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_default_buffered_write": "false", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-23T23:37:29.587 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fail_eio": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mount": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_umount": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-23T23:37:29.588 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_ignore_data_csum": "false", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_log_op_age": "5.000000", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_alloc_size": "0", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_blob_size": "0", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-23T23:37:29.589 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_max_deferred_txc": "32", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_min_alloc_size": "0", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_nid_prealloc": "1024", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_retry_disk_reads": "3", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_cf": "true", 2024-04-23T23:37:29.590 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_spdk_mem": "512", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-23T23:37:29.591 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_tracing": "false", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "bluestore_zero_block_detection": "false", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-23T23:37:29.592 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_cluster_require_signatures": "false", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_cluster_require_version": "2", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_require_signatures": "false", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_require_version": "2", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_service_require_signatures": "false", 2024-04-23T23:37:29.593 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_service_require_version": "2", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "cephx_sign_messages": "true", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "chdir": "", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_acl_type": "", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_asio_thread_count": "2", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_cache_mid": "0.750000", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_cache_size": "16384", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_caps_release_delay": "5", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_check_pool_perm": "true", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_force_sync_read": "false", 2024-04-23T23:37:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_getattr_caps": "false", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_debug_inject_tick_delay": "0", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_die_on_failed_remount": "false", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_dirsize_rbytes": "true", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_force_lazyio": "false", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_fs": "", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_inject_release_failure": "false", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_max_inline_size": "4096", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mds_namespace": "", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_metadata": "", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mount_gid": "-1", 2024-04-23T23:37:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mount_timeout": "300", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mount_uid": "-1", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_mountpoint": "/", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_notify_timeout": "10", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc": "true", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_max_dirty": "104857600", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_max_objects": "1000", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_size": "209715200", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_oc_target_dirty": "8388608", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_permissions": "true", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_quota": "true", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_quota_df": "true", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_readahead_max_bytes": "0", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_readahead_max_periods": "4", 2024-04-23T23:37:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_readahead_min": "131072", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_reconnect_stale": "false", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_shutdown_timeout": "30", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_snapdir": ".snap", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_tick_interval": "1", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_trace": "", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_try_dentry_invalidate": "false", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_use_faked_inos": "false", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_use_random_mds": "false", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_graylog": "false", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_graylog_port": "12201", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_monitors": "default=true", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_syslog": "false", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-23T23:37:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "clog_to_syslog_level": "info", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "-", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_network": "", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_network_interface": "", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zlib_isal": "false", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zlib_level": "5", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zlib_winsize": "-15", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "compressor_zstd_level": "1", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_alien_op_num_threads": "6", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-23T23:37:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "crimson_seastar_cpu_cores": "", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_location": "", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_location_hook": "", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_location_hook_timeout": "10", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "daemonize": "false", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "daos_pool": "tank", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_alienstore": "0/5", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_allow_any_pool_priority": "false", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_asok": "1/5", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_asok_assert_abort": "false", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_asserts_on_shutdown": "true", 2024-04-23T23:37:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_auth": "20/20", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_bdev": "1/3", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_bluefs": "1/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_bluestore": "1/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_buffer": "0/1", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_ceph_exporter": "1/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_cephfs_mirror": "0/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_cephsqlite": "0/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_client": "0/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_compressor": "1/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_context": "0/1", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_crimson_interrupt": "0/5", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_crush": "1/1", 2024-04-23T23:37:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_crypto": "1/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_cyanstore": "0/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_deliberately_leak_memory": "false", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_disable_randomized_ping": "false", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_dpdk": "1/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_eventtrace": "1/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_filer": "0/1", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_filestore": "1/3", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_finisher": "1/1", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_fuse": "1/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_heartbeat_testing_span": "0", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_heartbeatmap": "1/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_javaclient": "1/5", 2024-04-23T23:37:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_journal": "1/3", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_journaler": "0/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_kstore": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_lockdep": "0/1", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mclock": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_balancer": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_locker": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_log": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_log_expire": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_migrator": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mds_quiesce": "3/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_memstore": "1/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mgr": "2/5", 2024-04-23T23:37:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mgrc": "1/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_mon": "20/20", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_monc": "0/10", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_ms": "1/1", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_none": "0/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_objclass": "0/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_objectcacher": "0/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_objecter": "0/1", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_optracker": "0/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_osd": "1/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_paxos": "20/20", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_perfcounter": "1/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_prioritycache": "1/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rados": "0/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd": "0/5", 2024-04-23T23:37:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd_mirror": "0/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd_pwl": "0/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rbd_replay": "0/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_refs": "0/0", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_reserver": "1/1", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_access": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_datacache": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_dbstore": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_flight": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rgw_sync": "1/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_rocksdb": "4/5", 2024-04-23T23:37:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_backref": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_cache": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_cleaner": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_device": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_epm": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_journal": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_lba": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_odata": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_omap": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_onode": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_t": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_seastore_tm": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_striper": "0/1", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_test": "0/5", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_throttle": "1/1", 2024-04-23T23:37:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_timer": "0/1", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_tp": "0/5", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "debug_trace": "1/5", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "device_failure_prediction_mode": "none", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_graylog": "false", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_journald": "false", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_stderr": "true", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "err_to_syslog": "false", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event_tracing": "false", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_addr": "0.0.0.0", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_http_port": "9926", 2024-04-23T23:37:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_prio_limit": "5", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_sort_metrics": "true", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "exporter_stats_period": "5", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "fake_statfs_for_testing": "0", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "fatal_signal_handlers": "true", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filer_max_purge_ops": "10", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filer_max_truncate_ops": "128", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_apply_finisher_threads": "1", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_blackhole": "false", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_btrfs_clone_range": "true", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_btrfs_snap": "true", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_caller_concurrency": "10", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_collect_device_partition_information": "true", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_commit_timeout": "600.000000", 2024-04-23T23:37:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_inject_read_err": "false", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_omap_check": "false", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_debug_verify_split": "false", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_dump_file": "", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fadvise": "true", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fail_eio": "true", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fd_cache_shards": "16", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fd_cache_size": "128", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fiemap": "false", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fiemap_threshold": "4096", 2024-04-23T23:37:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_inject_stall": "0", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_journal_parallel": "false", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_journal_trailing": "false", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_journal_writeahead": "false", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_kill_at": "0", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs": "0", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-23T23:37:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size": "0", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_merge_threshold": "-10", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_odsync_write": "false", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_omap_backend": "rocksdb", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_omap_backend_path": "", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-23T23:37:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_op_thread_timeout": "60", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_op_threads": "2", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_punch_hole": "false", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_queue_max_ops": "50", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-23T23:37:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_seek_data_hole": "false", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_sloppy_crc": "false", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_splice": "false", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_split_multiple": "2", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_split_rand_factor": "20", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_update_to": "1000", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-23T23:37:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_enable": "true", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_xfs_extsize": "false", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "filestore_zfs_snap": "false", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fio_dir": "/tmp/fio", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_allow_other": "true", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_atomic_o_trunc": "true", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_big_writes": "true", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_debug": "false", 2024-04-23T23:37:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_default_permissions": "false", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_disable_pagecache": "false", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_max_write": "0", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_multithreaded": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_require_active_mds": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_set_user_groups": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_splice_move": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_splice_read": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_splice_write": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "fuse_use_invalidate_cb": "true", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "gss_target_name": "ceph", 2024-04-23T23:37:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_file": "", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_inject_failure": "0", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_interval": "5", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "host": "smithi077", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-23T23:37:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "inject_early_sigterm": "false", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "jaeger_agent_port": "6799", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "jaeger_tracing_enable": "false", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_aio": "true", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_align_min_size": "65536", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_block_align": "true", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_block_size": "4096", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_dio": "true", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_discard": "false", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_force_aio": "false", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_ignore_corruption": "false", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_max_write_bytes": "10485760", 2024-04-23T23:37:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_max_write_entries": "100", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_replay_from": "0", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_write_header_frequency": "0", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journal_zero_on_create": "false", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journaler_prefetch_periods": "10", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journaler_prezero_periods": "5", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "journaler_write_head_interval": "15", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "keyfile": "", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-23T23:37:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_backend": "rocksdb", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_default_stripe_size": "65536", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_fsck_on_mount": "false", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_max_bytes": "67108864", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_max_ops": "512", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_nid_prealloc": "1024", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_onode_map_size": "1024", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_sync_submit_transaction": "false", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "kstore_sync_transaction": "false", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "librados_thread_count": "2", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "lockdep": "false", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "lockdep_force_backtrace": "false", 2024-04-23T23:37:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "log_coarse_timestamps": "true", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_flush_on_exit": "false", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_graylog_host": "127.0.0.1", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_graylog_port": "12201", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_max_new": "1000", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_max_recent": "10000", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_stderr_prefix": "", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_stop_at_utilization": "0.970000", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": "true", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_graylog": "false", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_journald": "false", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_stderr": "false", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_syslog": "false", 2024-04-23T23:37:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "max_rotating_auth_attempts": "10", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_action_on_write_error": "1", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_alternate_name_max": "8192", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_asio_thread_count": "2", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_export_pin": "true", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_dirs": "true", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_interval": "5", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_interval": "10", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_max": "-1", 2024-04-23T23:37:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_max_until": "-1", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_merge_size": "50", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_midchunk": "0.300000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_min_start": "0.200000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_minchunk": "0.001000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_mode": "0", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_need_max": "1.200000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_need_min": "0.800000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_overload_epochs": "2", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_bits": "3", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-23T23:37:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_size": "10000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_target_decay": "10.000000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_beacon_grace": "15.000000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_beacon_interval": "4.000000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_mid": "0.700000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_delay": "0", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-23T23:37:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_release_free_interval": "10", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_reservation": "0.050000", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_trim_interval": "1", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cache_trim_threshold": "262144", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_client_prealloc_inos": "1000", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_connect_bootstrapping": "false", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_damage_table_max_entries": "10000", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_auth_pins": "false", 2024-04-23T23:37:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_frag": "false", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_scatterstat": "false", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_debug_subtrees": "false", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_decay_halflife": "5.000000", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_default_dir_hash": "2", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_defer_session_stale": "true", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_deny_all_reconnect": "false", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_keys_per_op": "16384", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_max_commit_size": "10", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_max_entries": "0", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dir_prefetch": "true", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_on_map": "false", 2024-04-23T23:37:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_early_reply": "true", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_enable_op_tracker": "true", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_enforce_unique_name": "true", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_random": "true", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-23T23:37:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_health_summarize_threshold": "10", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_health_dummy": "false", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_migrator_session_race": "false", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_join_fs": "", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_journal_format": "1", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_create_at": "0", 2024-04-23T23:37:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_export_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_import_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_journal_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_journal_expire_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_journal_replay_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_link_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_mdstable_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_openc_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_rename_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_shutdown_at": "0", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_event_large_threshold": "524288", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_events_per_segment": "1024", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_max_events": "-1", 2024-04-23T23:37:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_max_segments": "128", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_pause": "false", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_segment_size": "0", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_trim_threshold": "128", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_log_warn_factor": "2.000000", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_caps_per_client": "1048576", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_completed_flushes": "100000", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_completed_requests": "100000", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_export_size": "20971520", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_file_recover": "32", 2024-04-23T23:37:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_purge_files": "64", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_purge_ops": "8192", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_max_snaps_per_dir": "100", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_metrics_update_interval": "2", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_min_caps_per_client": "100", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_min_caps_working_set": "10000", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_numa_node": "-1", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_complaint_time": "30.000000", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_duration": "600", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_size": "20", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_slow_op_size": "20", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-23T23:37:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_op_log_threshold": "5", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_ping_grace": "15", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_ping_interval": "5", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_max_caps": "30000", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_recall_warning_threshold": "262144", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_replay_interval": "1.000000", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-23T23:37:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_root_ino_gid": "0", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_root_ino_uid": "0", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_shutdown_check": "0", 2024-04-23T23:37:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_skip_ino": "0", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_snap_max_uid": "4294967294", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_snap_min_uid": "0", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_snap_rstat": "false", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_standby_replay_damaged": "false", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_symlink_recovery": "true", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_thrash_exports": "0", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_thrash_fragments": "0", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_tick_interval": "5.000000", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_valgrind_exit": "false", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_verify_backtrace": "1", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_verify_scatter": "false", 2024-04-23T23:37:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_wipe_sessions": "false", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mempool_debug": "false", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_device_bytes": "1073741824", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_page_set": "false", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "memstore_page_size": "65536", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_client_bytes": "134217728", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_client_messages": "512", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_disabled_modules": "", 2024-04-23T23:37:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_max_pg_num_change": "128", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mds_bytes": "134217728", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mds_messages": "128", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mon_bytes": "134217728", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_mon_messages": "128", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_osd_bytes": "536870912", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_osd_messages": "8192", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_pool": "true", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_standby_modules": "true", 2024-04-23T23:37:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_stats_period": "5", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_stats_threshold": "5", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_tick_period": "2", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_allow_pool_delete": "true", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_allow_pool_size_one": "true", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_auth_validate_all_caps": "true", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_bytes": "104857600", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_directed_command_retry": "5", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-23T23:37:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_hunt_parallel": "3", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_log_interval": "1.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_ping_interval": "10.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_client_target_rank": "-1", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_file_level": "debug", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_file": "true", 2024-04-23T23:37:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_journald": "false", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_compact_on_bootstrap": "false", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_compact_on_start": "false", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_compact_on_trim": "true", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-23T23:37:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_cpu_threads": "4", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_crush_min_required_version": "hammer", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_daemon_bytes": "419430400", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data_avail_crit": "5", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data_avail_warn": "5", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_data_size_warn": "16106127360", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_dump_json": "false", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_dump_transactions": "false", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_extra_checks": "false", 2024-04-23T23:37:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_require_reef": "false", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_no_require_squid": "false", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_down_mkfs_grace": "120", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_down_uptime_grace": "60", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_election_default_strategy": "1", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_election_timeout": "5.000000", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_elector_ping_divisor": "2", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-23T23:37:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_enable_op_tracker": "true", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_fake_pool_delete": "false", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_force_quorum_join": "false", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_globalid_prealloc": "10000", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_detail_to_clog": "false", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_log_update_period": "5", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_max_detail": "50", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_to_clog": "true", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_to_clog_interval": "600", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_host": "172.21.15.77,[v2:172.21.15.77:3301,v1:172.21.15.77:6790],172.21.15.170", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_host_override": "", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_initial_members": "", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-23T23:37:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_lease": "5.000000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_log_full_interval": "50", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_log_max": "10000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_log_max_summary": "50", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_log_epochs": "500", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_osd": "10000", 2024-04-23T23:37:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_pg_per_osd": "10000", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_pool_pg_num": "65536", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mds_force_trim_to": "0", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mds_skip_sanity": "false", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_memory_autotune": "true", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_memory_target": "2147483648", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_beacon_grace": "30", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_digest_period": "5", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_inactive_grace": "60", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-23T23:37:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_min_osdmap_epochs": "500", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_complaint_time": "30", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_duration": "600", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_size": "20", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_slow_op_size": "20", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_op_log_threshold": "5", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_auto_mark_in": "false", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-23T23:37:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_cache_size": "500", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_down_out_interval": "600", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_force_trim_to": "0", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-23T23:37:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_min_down_reporters": "2", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_report_timeout": "900", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-23T23:37:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_stuck_threshold": "60", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_probe_timeout": "2.000000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_max_change": "0.050000", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_max_osds": "4", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-23T23:37:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_interval": "86400", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_max_keys": "100", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_scrub_timeout": "300", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_session_timeout": "300", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_smart_report_timeout": "5", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stat_smooth_intervals": "6", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_pool_min_size": "2", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_pool_size": "4", 2024-04-23T23:37:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_debug": "false", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_provider_kill_at": "0", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_requester_kill_at": "0", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_sync_timeout": "60.000000", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_target_pg_per_osd": "100", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_tick_interval": "5", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_timecheck_interval": "300.000000", 2024-04-23T23:37:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_use_min_delay_socket": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_older_version_delay": "604800", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_misplaced": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_older_version": "true", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-23T23:37:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_pool_no_app": "false", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "monmap": "", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-23T23:37:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "motr_tracing_enabled": "false", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_op_threads": "3", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_cm": "false", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_device_name": "", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_dscp": "96", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_local_gid": "", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_port_num": "1", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-23T23:37:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_sl": "3", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_support_srq": "true", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_rdma_type": "ib", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_async_reap_threshold": "5", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_before_connect": "false", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_ipv4": "true", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_ipv6": "false", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_msgr1": "true", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_msgr2": "true", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_port_max": "7568", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_port_min": "6800", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_retry_count": "3", 2024-04-23T23:37:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_bind_retry_delay": "5", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_client": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_mds": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_mgr": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_mon": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_blackhole_osd": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_client_mode": "crc secure", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_cluster_mode": "crc secure", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_cluster_type": "", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_compress_secure": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_connection_idle_timeout": "900", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_connection_ready_timeout": "10", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_crc_data": "true", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_crc_header": "true", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_bad_msg": "false", 2024-04-23T23:37:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_bug": "true", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_old_message": "true", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_skipped_message": "false", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_coremask": "0xF", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_enable_tso": "true", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_hugepages": "", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-23T23:37:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_lro": "true", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_memory_channel": "4", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_pmd": "", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_port_id": "0", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_dump_on_send": "false", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_initial_backoff": "0.200000", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_delay_max": "1.000000", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_delay_type": "", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_network_congestion": "0", 2024-04-23T23:37:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_inject_socket_failures": "5000", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_learn_addr_from_peer": "true", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_max_accept_failures": "4", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_max_backoff": "15.000000", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_mon_client_mode": "secure crc", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_mon_service_mode": "secure crc", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_osd_compress_min_size": "1024", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_osd_compress_mode": "none", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_pq_min_cost": "65536", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_public_type": "", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_service_mode": "crc secure", 2024-04-23T23:37:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_listen_backlog": "512", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_nodelay": "true", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_tcp_rcvbuf": "0", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "ms_type": "async+posix", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "no_config_file": "false", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_completion_locks_per_session": "32", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_inflight_ops": "1024", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-23T23:37:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_tick_interval": "5.000000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "objecter_timeout": "10.000000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "objectstore_blackhole": "false", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "openssl_engine_opts": "", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_delay_time": "5.000000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_hist_halflife": "1000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_max_low_ops": "2", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_max_ops": "4", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_agent_slop": "0.020000", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_asio_thread_count": "2", 2024-04-23T23:37:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_async_recovery_min_cost": "100", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backfill_scan_max": "512", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backfill_scan_min": "64", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backoff_on_degraded": "false", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backoff_on_peering": "false", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_backoff_on_unfound": "true", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_beacon_report_interval": "300", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_duration": "30", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_max_block_size": "67108864", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_blkin_trace_all": "false", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-23T23:37:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_check_for_log_corruption": "false", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_class_update_on_start": "true", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_message_cap": "256", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_message_size_cap": "524288000", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_op_priority": "63", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_client_watch_timeout": "30", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_command_max_records": "256", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_compact_on_start": "false", 2024-04-23T23:37:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_update_on_start": "true", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_crush_update_weight_set": "true", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_feed_pullee": "-1", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-23T23:37:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_misdirected_ops": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_no_acting_change": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_no_purge_strays": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_op_order": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_shutdown": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_trim_objects": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-23T23:37:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_snaps": "false", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_keys": "1024", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_stride": "524288", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_default_notify_timeout": "30", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep": "0.000000", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-23T23:37:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_discard_disconnected_ops": "true", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_enable_op_tracker": "true", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_info": "true", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_shutdown": "true", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-23T23:37:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_function_tracing": "false", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_grace": "20", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_interval": "6", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_min_peers": "10", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_min_size": "2000", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_stale": "600", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_hit_set_max_size": "100000", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_hit_set_min_size": "1000", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-23T23:37:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_journal_size": "5120", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_kill_backfill_at": "0", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_cache_size": "50", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_dedup": "true", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_message_max": "40", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_map_share_max_epochs": "40", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_attr_name_len": "100", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_attr_size": "0", 2024-04-23T23:37:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_backfills": "1", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_markdown_count": "5", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_markdown_period": "600", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_object_name_len": "2048", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_object_namespace_len": "256", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_object_size": "134217728", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pg_blocked_by": "16", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pg_log_entries": "10000", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_pgls": "1024", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_push_cost": "8388608", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_push_objects": "10", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_scrubs": "3", 2024-04-23T23:37:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_trimming_pgs": "2", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_write_op_reply_len": "64", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_max_write_size": "90", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_profile": "balanced", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-23T23:37:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_base": "805306368", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_cache_min": "134217728", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_target": "4294967296", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_target_autotune": "false", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-23T23:37:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_min_pg_log_entries": "250", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_min_recovery_priority": "0", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_report_interval": "5", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_num_cache_shards": "32", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_num_op_tracker_shard": "32", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_numa_auto_affinity": "true", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_numa_node": "-1", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_numa_prefer_iface": "true", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objecter_finishers": "1", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore": "bluestore", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore_fuse": "false", 2024-04-23T23:37:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_objectstore_tracing": "false", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_complaint_time": "30.000000", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_duration": "600", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_size": "20", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_slow_op_size": "20", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_log_threshold": "5", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_shards": "0", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_shards_hdd": "5", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_shards_ssd": "8", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_pq_min_cost": "65536", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_queue_cut_off": "high", 2024-04-23T23:37:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_op_thread_timeout": "15", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_open_classes_on_start": "true", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_os_flags": "0", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_peering_op_priority": "255", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_delete_cost": "1048576", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_delete_priority": "5", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_log_trim_max": "10000", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_log_trim_min": "100", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-23T23:37:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_crimson": "false", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-23T23:37:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_flags": "0", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_min_size": "0", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_pg_num": "32", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_pgp_num": "0", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_read_ratio": "70", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_size": "2", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_default_type": "replicated", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_push_per_object_cost": "1000", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-23T23:37:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recover_clone_overlap": "true", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_cost": "20971520", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_active": "0", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_max_single_start": "1", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_op_priority": "3", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_priority": "5", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep": "0.000000", 2024-04-23T23:37:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_repair_during_recovery": "false", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_requested_scrub_priority": "120", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_auto_repair": "false", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_begin_hour": "0", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_begin_week_day": "0", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_chunk_max": "25", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_chunk_min": "5", 2024-04-23T23:37:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_cost": "52428800", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_disable_reservation_queuing": "true", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_during_recovery": "false", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_end_hour": "0", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_end_week_day": "0", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_event_cost": "4096", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_invalid_stats": "true", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_max_preemptions": "5", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_priority": "5", 2024-04-23T23:37:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_scrub_sleep": "0.000000", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_skip_data_digest": "false", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_smart_report_timeout": "5", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_cost": "1048576", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_priority": "5", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-23T23:37:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_target_transaction_size": "30", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-23T23:37:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_tracing": "false", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_use_stale_snap": "false", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "osdc_blkin_trace_all": "false", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_kill_at": "0", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_max_join_drift": "10", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_min": "500", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_min_wait": "0.050000", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_propose_interval": "1.000000", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_service_trim_max": "500", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_service_trim_min": "250", 2024-04-23T23:37:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_stash_full_interval": "25", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_trim_max": "500", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "paxos_trim_min": "250", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "perf": "true", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin_dir": "/usr/lib64/ceph", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "-", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrv": "", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "public_bind_addr": "-", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "public_network": "", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "public_network_interface": "", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "qat_compressor_enabled": "false", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "qat_compressor_session_max_number": "256", 2024-04-23T23:37:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "rados_mon_op_timeout": "0", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rados_osd_op_timeout": "0", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rados_tracing": "false", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_atime_update_interval": "60", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_balance_parent_reads": "false", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_balance_snap_reads": "false", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_blkin_trace_all": "false", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache": "true", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-23T23:37:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_policy": "writearound", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_size": "33554432", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_clone_copy_on_read": "false", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_compression_hint": "none", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_concurrent_management_ops": "10", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_clone_format": "auto", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_data_pool": "", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_features": "61", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_format": "2", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_map_options": "", 2024-04-23T23:37:29.684 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_order": "22", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_pool": "rbd", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_stripe_count": "0", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_default_stripe_unit": "0", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_enable_alloc_hint": "true", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_io_scheduler": "simple", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-23T23:37:29.685 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_order": "24", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_pool": "", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_journal_splay_width": "4", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_localize_parent_reads": "false", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_localize_snap_reads": "false", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-23T23:37:29.686 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-23T23:37:29.687 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_mtime_update_interval": "60", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_non_blocking_aio": "true", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_op_thread_timeout": "60", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_op_threads": "1", 2024-04-23T23:37:29.688 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_parent_cache_enabled": "false", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_plugins": "", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_bps_burst": "0", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_bps_limit": "0", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_exclude_ops": "0", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_iops_burst": "0", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_iops_limit": "0", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-23T23:37:29.689 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_read_from_replica_policy": "default", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-23T23:37:29.690 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_skip_partial_discard": "true", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_tracing": "false", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_validate_names": "true", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_validate_pool": "true", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "restapi_base_url": "", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "restapi_log_level": "", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_acl_grants_max_num": "100", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_admin_entry": "admin", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_backend_store": "rados", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_barbican_url": "", 2024-04-23T23:37:29.691 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_beast_enable_async": "true", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_counters_cache": "false", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cache_enabled": "true", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cache_expiry_interval": "900", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cache_lru_size": "10000", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_config_store": "rados", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_content_length_compat": "false", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_copy_obj_progress": "true", 2024-04-23T23:37:29.692 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cors_rules_max_num": "100", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_cross_domain_policy": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_addr": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_password": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_kmip_username": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_require_ssl": "true", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-23T23:37:29.693 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_addr": "", 2024-04-23T23:37:29.694 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_auth": "token", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_namespace": "", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_prefix": "", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_token_file": "", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_buffersize": "524288", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_low_speed_time": "300", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-23T23:37:29.695 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_d4n_port": "6379", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_changes_size": "1000", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_num_shards": "128", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-23T23:37:29.696 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_log_window": "30", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-23T23:37:29.697 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dns_name": "", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dns_s3website_name": "", 2024-04-23T23:37:29.698 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_dynamic_resharding": "true", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_gc_threads": "true", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_lc_threads": "true", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_ops_log": "false", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_quota_threads": "true", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_static_website": "false", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enable_usage_log": "false", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_enforce_swift_acls": "true", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_exit_timeout_secs": "120", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_expose_bucket": "false", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_extended_http_attrs": "", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_filter": "none", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-23T23:37:29.699 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_frontends": "beast port=7480", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_deferred": "50", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_objs": "32", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_gc_processor_period": "3600", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-23T23:37:29.700 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_init_timeout": "300", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_kafka_connection_idle": "300", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_domain": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_password": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_password_path": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_project": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_tenant": "", 2024-04-23T23:37:29.701 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_token": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_token_path": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_admin_user": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_api_version": "2", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_domain": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_password": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_project": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_barbican_user": "", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-23T23:37:29.702 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_url": "", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_debug_interval": "-1", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_lock_max_time": "90", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_objs": "32", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_rules": "1000", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_worker": "3", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lc_thread_delay": "0", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_dnattr": "uid", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_searchfilter": "", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-23T23:37:29.703 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ldap_uri": "", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_http_headers": "", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_log_object_name_utc": "false", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_attr_name_len": "0", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_attr_size": "0", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_chunk_size": "4194304", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-23T23:37:29.704 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_listing_results": "1000", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_notify_retries": "10", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_put_param_size": "1048576", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_put_size": "5368709120", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_max_slo_entries": "1000", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_md_log_max_shards": "64", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_mp_lock_max_time": "600", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-23T23:37:29.705 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_max_gc": "300", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-23T23:37:29.706 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_num_async_rados_threads": "32", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_num_control_oids": "8", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_numa_node": "-1", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_objexp_chunk_size": "100", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_objexp_gc_interval": "600", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_op_thread_timeout": "600", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_op_tracing": "false", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_opa_token": "", 2024-04-23T23:37:29.707 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_opa_url": "", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_opa_verify_ssl": "true", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_rados": "false", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_ops_log_socket_path": "", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_push_interval": "2.000000", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_lanes": "3", 2024-04-23T23:37:29.708 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_cache_partitions": "3", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_print_continue": "true", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rados_tracing": "false", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_realm": "", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_realm_id": "", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-23T23:37:29.709 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_region": "", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_request_uri": "", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_batch_size": "64", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_max_aio": "128", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_num_logs": "16", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_reshard_thread_interval": "600", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_resolve_cname": "false", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_run_sync_thread": "true", 2024-04-23T23:37:29.710 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_scheduler_type": "throttler", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_script_uri": "", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_service_provider_name": "", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_client_id": "", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_client_secret": "", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_entry": "sts", 2024-04-23T23:37:29.711 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_key": "sts", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_min_session_duration": "900", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sts_token_introspection_url": "", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_account_in_url": "false", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_auth_entry": "auth", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_auth_url": "", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_custom_header": "", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_need_stats": "true", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_tenant_name": "", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_token_expiration": "86400", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_url": "", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_url_prefix": "swift", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-23T23:37:29.712 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_lease_period": "120", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_thread_pool_size": "512", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-23T23:37:29.713 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_comment": "", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_createby": "", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_encoding": "", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_flag": "false", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_origin": "", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_torrent_tracker": "", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_trust_forwarded_https": "false", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-23T23:37:29.714 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_max_shards": "32", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_usage_max_user_shards": "1", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_use_opa_authz": "false", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_counters_cache": "false", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_max_buckets": "1000", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_policies_max_num": "100", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_user_unique_email": "true", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_verify_ssl": "true", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-23T23:37:29.715 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zone": "", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zone_id": "", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zonegroup": "", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zonegroup_id": "", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgwlc_auto_session_clear": "true", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_block_size": "4096", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_size": "536870912", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-23T23:37:29.716 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_index_type": "binary_search", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_partition_filters": "false", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_perf": "false", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-23T23:37:29.717 INFO:teuthology.orchestra.run.smithi077.stdout: "run_dir": "/var/run/ceph", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_block_create": "true", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_cache_lru_size": "67108864", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_default_max_object_size": "16777216", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_device_size": "53687091200", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_batch_capacity": "16", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_main_device_type": "SSD", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-23T23:37:29.718 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "seastore_segment_size": "67108864", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "set_keepcaps": "false", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "setgroup": "", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "setuser": "", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "setuser_match_path": "", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "thp": "false", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "threadpool_default_timeout": "60", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout: "throttler_perf_counter": "true" 2024-04-23T23:37:29.719 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:29.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-23T23:37:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:mon.a: {} 2024-04-23T23:37:29.833 INFO:teuthology.orchestra.run.smithi077.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T23:37:29.843 INFO:teuthology.orchestra.run.smithi077.stdout:mon.b: {} 2024-04-23T23:37:29.843 INFO:teuthology.orchestra.run.smithi077.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T23:37:29.851 INFO:teuthology.orchestra.run.smithi077.stdout:mon.c: {} 2024-04-23T23:37:29.851 INFO:teuthology.orchestra.run.smithi077.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T23:37:29.862 DEBUG:teuthology.orchestra.run.smithi170:> type ceph-objectstore-tool 2024-04-23T23:37:29.880 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-23T23:37:29.880 DEBUG:teuthology.orchestra.run.smithi077:> type ceph-objectstore-tool 2024-04-23T23:37:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-23T23:37:29.895 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-04-23T23:37:29.905 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-04-23T23:37:29.905 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-23T23:37:29.905 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T23:37:29.905 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:37:29.906 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-23T23:37:29.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:37:29.906 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-23T23:37:29.906 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-23T23:37:29.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:37:29.907 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-23T23:37:29.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:29.907 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-23T23:37:29.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:37:29.908 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-04-23T23:37:29.922 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:29.933+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:mapped writes DISABLED 2024-04-23T23:37:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:mapped reads DISABLED 2024-04-23T23:37:29.971 INFO:teuthology.orchestra.run.smithi077.stdout:Seed set to 1173 2024-04-23T23:37:30.008 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:30.020+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:30.059 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:30.059 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:30.059 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:30.059 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:30.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:30.077 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:30.077 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:30.096 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:30.109 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:30.121+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:30.112 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:30.112 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:30.130 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:30.148 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:30.148 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:30.166 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:37:30.166 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:37:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.173 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.182 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:30.184 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:30.184 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:30.204 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:30.205 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:30.210 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:30.222+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.290 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:30.307 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 20, 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:37:24.754197+0000", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:37:15.711895+0000", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:37:06.165727+0000", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5799936, 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:37:30.308 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 4, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 2, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "jewel", 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:37:30.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:37:30.310 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.311 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:37:30.312 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.313 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:37:30.314 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 8, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 8, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.25, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:37:30.315 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 1, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 1, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 1 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:37:30.316 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:37:30.317 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:37:30.318 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:37:30.319 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:37:30.320 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 1.9900000095367432, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.9900000095367432, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.87999999523162842, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 1.75, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.75, 2024-04-23T23:37:30.321 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 1, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 1, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 1 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.322 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 0, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.323 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:37:30.324 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:37:30.325 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.326 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 18, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.328 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.331 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:37:30.332 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.333 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 18, 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.334 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:37:30.335 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.336 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.337 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:37:30.338 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 0, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:37:30.339 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/4292713565", 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/4292713565", 2024-04-23T23:37:30.343 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/4292713565", 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/4292713565", 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.344 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 0, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.345 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.346 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.347 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:37:30.349 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.350 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 18, 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.351 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:37:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2614189917 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2614189917", 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2614189917", 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2614189917", 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2614189917", 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:37:30.355 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 18, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:37:30.356 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 18, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:37:30.362 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.363 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.364 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:37:30.365 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.366 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.367 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:37:30.368 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.369 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.370 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.371 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.372 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [], 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:37:30.373 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [], 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [], 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [], 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:37:30.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:30.377 INFO:tasks.thrashosds.thrasher:j is {'epoch': 20, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:37:24.754197+0000', 'last_up_change': '2024-04-23T23:37:15.711895+0000', 'last_in_change': '2024-04-23T23:37:06.165727+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 4292713565}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 4292713565}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 4292713565}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 4292713565}]}, 'public_addr': '172.21.15.77:6809/4292713565', 'cluster_addr': '172.21.15.77:6811/4292713565', 'heartbeat_back_addr': '172.21.15.77:6815/4292713565', 'heartbeat_front_addr': '172.21.15.77:6813/4292713565', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2614189917}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2614189917}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2614189917}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2614189917}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2614189917}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2614189917}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2614189917}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2614189917}]}, 'public_addr': '172.21.15.170:6801/2614189917', 'cluster_addr': '172.21.15.170:6803/2614189917', 'heartbeat_back_addr': '172.21.15.170:6807/2614189917', 'heartbeat_front_addr': '172.21.15.170:6805/2614189917', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 18, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:37:30.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:37:30.377 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:30.388+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.403 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.412 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:30.477 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:30.489+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:30.557 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.557 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:30.577 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:30.589+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:30.669 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.670 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:30.679 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:30.690+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:30.691 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:37:30.692 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:37:30.704 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-23T23:37:30.204649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":235540,"kb_used_data":2700,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739180,"statfs":{"total":773094113280,"available":772852920320,"internally_reserved":0,"allocated":2764800,"data_stored":1691636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.456493"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.757299+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:37:23.757299+0000","last_peered":"2024-04-23T23:37:23.757299+0000","last_clean":"2024-04-23T23:37:23.757299+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:37:23.757299+0000","last_undegraded":"2024-04-23T23:37:23.757299+0000","last_fullsized":"2024-04-23T23:37:23.757299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:39:55.858873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.763967+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:37:24.763967+0000","last_peered":"2024-04-23T23:37:24.763967+0000","last_clean":"2024-04-23T23:37:24.763967+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:37:24.763967+0000","last_undegraded":"2024-04-23T23:37:24.763967+0000","last_fullsized":"2024-04-23T23:37:24.763967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.109969+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:37:24.109969+0000","last_peered":"2024-04-23T23:37:24.109969+0000","last_clean":"2024-04-23T23:37:24.109969+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:37:24.109969+0000","last_undegraded":"2024-04-23T23:37:24.109969+0000","last_fullsized":"2024-04-23T23:37:24.109969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:45.157867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.764095+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:37:24.764095+0000","last_peered":"2024-04-23T23:37:24.764095+0000","last_clean":"2024-04-23T23:37:24.764095+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:37:24.764095+0000","last_undegraded":"2024-04-23T23:37:24.764095+0000","last_fullsized":"2024-04-23T23:37:24.764095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.758671+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.758318+0000","last_became_peered":"2024-04-23T23:37:23.758318+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:31.374849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.768328+0000","last_change":"2024-04-23T23:37:23.757594+0000","last_active":"2024-04-23T23:37:24.768328+0000","last_peered":"2024-04-23T23:37:24.768328+0000","last_clean":"2024-04-23T23:37:24.768328+0000","last_became_active":"2024-04-23T23:37:23.757261+0000","last_became_peered":"2024-04-23T23:37:23.757261+0000","last_unstale":"2024-04-23T23:37:24.768328+0000","last_undegraded":"2024-04-23T23:37:24.768328+0000","last_fullsized":"2024-04-23T23:37:24.768328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:37:59.738962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.759330+0000","last_change":"2024-04-23T23:37:23.758766+0000","last_active":"2024-04-23T23:37:23.759330+0000","last_peered":"2024-04-23T23:37:23.759330+0000","last_clean":"2024-04-23T23:37:23.759330+0000","last_became_active":"2024-04-23T23:37:23.758418+0000","last_became_peered":"2024-04-23T23:37:23.758418+0000","last_unstale":"2024-04-23T23:37:23.759330+0000","last_undegraded":"2024-04-23T23:37:23.759330+0000","last_fullsized":"2024-04-23T23:37:23.759330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:34.312936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-23T23:37:24.811148+0000","last_change":"2024-04-23T23:37:23.756137+0000","last_active":"2024-04-23T23:37:24.811148+0000","last_peered":"2024-04-23T23:37:24.811148+0000","last_clean":"2024-04-23T23:37:24.811148+0000","last_became_active":"2024-04-23T23:37:23.755788+0000","last_became_peered":"2024-04-23T23:37:23.755788+0000","last_unstale":"2024-04-23T23:37:24.811148+0000","last_undegraded":"2024-04-23T23:37:24.811148+0000","last_fullsized":"2024-04-23T23:37:24.811148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:23.404814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-23T23:37:23.753784+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:37:23.753784+0000","last_peered":"2024-04-23T23:37:23.753784+0000","last_clean":"2024-04-23T23:37:23.753784+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:37:23.753784+0000","last_undegraded":"2024-04-23T23:37:23.753784+0000","last_fullsized":"2024-04-23T23:37:23.753784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":652075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":192512,"data_stored":61707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:37:30.705 INFO:tasks.thrashosds.thrasher:Setting 2.3 to [2, 6] 2024-04-23T23:37:30.705 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.3', '2', '6'] 2024-04-23T23:37:30.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.3 2 6 2024-04-23T23:37:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:37:30.779 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:30.790+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:30.802 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.802 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:30.880 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:30.891+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:30.954 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:30.954 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:30.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:31.007 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:31.019+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.067 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:31.117 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:31.129+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:31.182 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:31.194+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:31.219 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.219 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:31.283 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:31.294+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:31.370 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.370 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:31.383 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:31.395+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:31.482 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.482 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.484 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:31.495+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:31.491 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:31.584 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:31.596+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:31.606 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.607 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.616 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:31.686 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:31.698+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:31.760 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.761 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.769 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:31.779 INFO:teuthology.orchestra.run.smithi077.stderr:set 2.3 pg_upmap mapping to [2,6] 2024-04-23T23:37:31.813 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:31.825+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:31.878 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:31.879 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:31.887 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:37:31.888 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:31.898+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:31.989 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:32.001+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:32.030 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:32.031 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:32.039 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:37:32.090 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:32.102+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:32.141 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:32.142 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:32.150 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:37:32.190 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:32.203+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:32.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:37:32.252 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:32.252 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:32.261 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:32.291 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:32.303+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:32.335 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:32.336 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:32.353 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:32.364 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:32.369 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:32.369 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:32.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:32.385 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:32.386 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:32.403 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:32.403 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:32.416 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:32.428+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:32.420 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:37:32.420 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:37:32.438 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:32.438 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:32.455 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:32.455 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:32.476 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:32.477 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:32.477 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:32.477 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:32.477 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:32.485 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:32.507 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:32.519+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:32.594 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:32.606+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:32.628 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [] 2024-04-23T23:37:32.629 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:32.637 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:32.695 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:32.707+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:32.780 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:32.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:32.781 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:32.781 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:32.790 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:32.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:37:32.796 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:32.808+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:32.894 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:32.894 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:32.894 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:32.894 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:32.895 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:32.896 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:32.909+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:32.903 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:32.998 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:33.009+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:33.008 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:33.008 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.291173693999999, 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.009 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:37:33.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:18 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.234648+0000", 2024-04-23T23:37:33.015 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.784483485999999, 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.005327114, 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 18 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234648+0000", 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234648+0000", 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234650+0000", 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0699999999999999e-06 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234655+0000", 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.164e-06 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234664+0000", 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2499999999999995e-06 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234669+0000", 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9930000000000003e-06 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235119+0000", 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00044995000000000001 2024-04-23T23:37:33.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235179+0000", 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9867999999999997e-05 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235285+0000", 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010623 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235777+0000", 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00049199699999999999 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.239913+0000", 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0041361999999999996 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.239947+0000", 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4028e-05 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.239976+0000", 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8364000000000002e-05 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.020 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:62 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [call lock.lock in=8b,cmpxattr striper.excl op 1 mode 1 in=12b,setxattr striper.excl (26) in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.281152+0000", 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.737980166, 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052999350000000004, 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.021 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 62 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281152+0000", 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281152+0000", 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281153+0000", 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6899999999999996e-07 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281157+0000", 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5480000000000003e-06 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281166+0000", 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2560000000000008e-06 2024-04-23T23:37:33.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281171+0000", 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8849999999999998e-06 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281211+0000", 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9264000000000002e-05 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281265+0000", 2024-04-23T23:37:33.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4548e-05 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281388+0000", 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000122559 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281838+0000", 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00045018499999999997 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.286305+0000", 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0044670960000000003 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.286396+0000", 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0984999999999997e-05 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.286452+0000", 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5840000000000001e-05 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.026 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.287856+0000", 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.731275752, 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0071761389999999998, 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 69 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.027 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287856+0000", 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287856+0000", 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287857+0000", 2024-04-23T23:37:33.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.06e-07 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287886+0000", 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9730000000000002e-05 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287892+0000", 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6550000000000001e-06 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287897+0000", 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4449999999999998e-06 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.288695+0000", 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079809200000000003 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.288744+0000", 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9673999999999999e-05 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.288827+0000", 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3133000000000005e-05 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289717+0000", 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00088932300000000002 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.294973+0000", 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052565240000000003 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295007+0000", 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3797000000000002e-05 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295032+0000", 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5259999999999999e-05 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.287905+0000", 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.731226795, 2024-04-23T23:37:33.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0072858159999999996, 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 70 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287905+0000", 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287905+0000", 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287906+0000", 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287908+0000", 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:37:33.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287911+0000", 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6789999999999998e-06 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287914+0000", 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7159999999999999e-06 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289325+0000", 2024-04-23T23:37:33.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014106279999999999 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289372+0000", 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6829000000000002e-05 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289445+0000", 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3669000000000002e-05 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289980+0000", 2024-04-23T23:37:33.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053461299999999997 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295143+0000", 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051635939999999996 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295170+0000", 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6718000000000001e-05 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295191+0000", 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0866999999999999e-05 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.526045123999999, 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0053856060000000002, 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.038 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 111 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:33.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.37e-07 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493092+0000", 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1409999999999998e-06 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493099+0000", 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4680000000000003e-06 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493105+0000", 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.614e-06 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.496478+0000", 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0033728230000000001 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.496528+0000", 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0547000000000002e-05 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.496663+0000", 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000134757 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498361+0000", 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001697811 2024-04-23T23:37:33.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498376+0000", 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5628e-05 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498431+0000", 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4512999999999998e-05 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498472+0000", 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1666999999999999e-05 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493118+0000", 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.526014077999999, 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0064051200000000003, 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.044 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 112 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493118+0000", 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493118+0000", 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493119+0000", 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4000000000000001e-07 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493199+0000", 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9997e-05 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493207+0000", 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7639999999999994e-06 2024-04-23T23:37:33.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493213+0000", 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7490000000000004e-06 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497336+0000", 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0041226780000000003 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497399+0000", 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2929999999999995e-05 2024-04-23T23:37:33.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497479+0000", 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0399000000000001e-05 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499422+0000", 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019427769999999999 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499461+0000", 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9326000000000003e-05 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499500+0000", 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8460000000000001e-05 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499523+0000", 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.34e-05 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.049 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493225+0000", 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.525906812000001, 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0073294600000000003, 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 113 2024-04-23T23:37:33.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493225+0000", 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493225+0000", 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493226+0000", 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493230+0000", 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1049999999999997e-06 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493236+0000", 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3489999999999997e-06 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493242+0000", 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497903+0000", 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0046609570000000003 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497963+0000", 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0207000000000001e-05 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498049+0000", 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6019000000000004e-05 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500006+0000", 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019574330000000002 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500440+0000", 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00043341400000000002 2024-04-23T23:37:33.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500514+0000", 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4177999999999994e-05 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500555+0000", 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0849000000000001e-05 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.055 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.525881330000001, 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0073968389999999997, 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 114 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:33.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493255+0000", 2024-04-23T23:37:33.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9949999999999999e-06 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493261+0000", 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1129999999999997e-06 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493266+0000", 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.87e-06 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498519+0000", 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052526830000000002 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498573+0000", 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3879999999999999e-05 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498658+0000", 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4956000000000004e-05 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500013+0000", 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001354952 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500594+0000", 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00058141300000000003 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500625+0000", 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0660000000000001e-05 2024-04-23T23:37:33.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500647+0000", 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2815000000000001e-05 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.525854990999999, 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0078613620000000002, 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.061 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493348+0000", 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0517000000000003e-05 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493356+0000", 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1710000000000002e-06 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493363+0000", 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9530000000000002e-06 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498916+0000", 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0055531529999999999 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498993+0000", 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6885000000000007e-05 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499070+0000", 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500567+0000", 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014968780000000001 2024-04-23T23:37:33.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501091+0000", 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052434599999999997 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501118+0000", 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6906999999999998e-05 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501138+0000", 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0088000000000001e-05 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.525757483, 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0078502050000000007, 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.06e-07 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493379+0000", 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2139999999999998e-06 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493386+0000", 2024-04-23T23:37:33.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6810000000000001e-06 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493391+0000", 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9150000000000004e-06 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499576+0000", 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0061849690000000002 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499658+0000", 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2583999999999994e-05 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499775+0000", 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117009 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500661+0000", 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00088579100000000003 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501165+0000", 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00050352000000000003 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501207+0000", 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1842999999999999e-05 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501225+0000", 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8073000000000001e-05 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.072 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493400+0000", 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.525732078000001, 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0088637309999999997, 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117 2024-04-23T23:37:33.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493400+0000", 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493400+0000", 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493401+0000", 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4000000000000001e-07 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493407+0000", 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7020000000000004e-06 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493413+0000", 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493418+0000", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3630000000000002e-06 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500046+0000", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0066278420000000001 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500096+0000", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9777999999999997e-05 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500190+0000", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3805000000000001e-05 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500668+0000", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00047838500000000001 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.502110+0000", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001441538 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.502198+0000", 2024-04-23T23:37:33.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8795000000000006e-05 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.502264+0000", 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5182e-05 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.110264416, 2024-04-23T23:37:33.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.005646369, 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 134 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908921+0000", 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3291999999999997e-05 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908928+0000", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.494e-06 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908934+0000", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1709999999999999e-06 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.911332+0000", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0023983490000000001 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.911381+0000", 2024-04-23T23:37:33.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8853999999999997e-05 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.911458+0000", 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6386999999999999e-05 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913297+0000", 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001839764 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914438+0000", 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011409020000000001 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914479+0000", 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0272000000000003e-05 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914514+0000", 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5358000000000003e-05 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.110187436, 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0056667870000000004, 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 135 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908950+0000", 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.938e-06 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908958+0000", 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4619999999999996e-06 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908962+0000", 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4999999999999999e-06 2024-04-23T23:37:33.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912086+0000", 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.003123902 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912134+0000", 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8004999999999999e-05 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912234+0000", 2024-04-23T23:37:33.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010058800000000001 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913300+0000", 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001065386 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914553+0000", 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001253384 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914587+0000", 2024-04-23T23:37:33.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4269e-05 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914611+0000", 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3852000000000001e-05 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908967+0000", 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.110164714, 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0057567310000000002, 2024-04-23T23:37:33.089 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 136 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908967+0000", 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908967+0000", 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908968+0000", 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9499999999999998e-07 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908971+0000", 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0450000000000001e-06 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908976+0000", 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5890000000000002e-06 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908981+0000", 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.023e-06 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912655+0000", 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0036738830000000002 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912734+0000", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8900999999999996e-05 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912809+0000", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4720000000000003e-05 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914620+0000", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018107990000000001 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914640+0000", 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0707999999999999e-05 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914688+0000", 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7667999999999998e-05 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914724+0000", 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6100000000000003e-05 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.110141978, 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0068256499999999999, 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 137 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7100000000000002e-07 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909062+0000", 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1987e-05 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909070+0000", 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7039999999999994e-06 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909082+0000", 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1378e-05 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913362+0000", 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0042799650000000002 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913421+0000", 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9648000000000002e-05 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913506+0000", 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4356000000000003e-05 2024-04-23T23:37:33.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914735+0000", 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00122955 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915743+0000", 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010084250000000001 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915776+0000", 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2997000000000003e-05 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915816+0000", 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9168999999999997e-05 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909097+0000", 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.110034916, 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0068193960000000001, 2024-04-23T23:37:33.100 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 138 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909097+0000", 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909097+0000", 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909098+0000", 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1600000000000001e-07 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909105+0000", 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4000000000000003e-06 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909116+0000", 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.059e-05 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909130+0000", 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4561e-05 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913996+0000", 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0048654529999999996 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914042+0000", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499000000000003e-05 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914127+0000", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4604999999999994e-05 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915715+0000", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001588307 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915862+0000", 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014710400000000001 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915892+0000", 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9674000000000001e-05 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915916+0000", 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4587e-05 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909153+0000", 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.109979028, 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0098869300000000004, 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 139 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.106 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909153+0000", 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909153+0000", 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909154+0000", 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:37:33.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909158+0000", 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909166+0000", 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5399999999999998e-06 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909172+0000", 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5220000000000004e-06 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914749+0000", 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0055764309999999997 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914794+0000", 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5376000000000001e-05 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914870+0000", 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6289000000000001e-05 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915925+0000", 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010548549999999999 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.918967+0000", 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0030417729999999998 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.918999+0000", 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1482000000000001e-05 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919040+0000", 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1366999999999999e-05 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909187+0000", 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.109944638, 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010263969, 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 140 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909187+0000", 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909187+0000", 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909188+0000", 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909268+0000", 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9665000000000004e-05 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909276+0000", 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7940000000000008e-06 2024-04-23T23:37:33.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909288+0000", 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1584e-05 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915141+0000", 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0058528729999999998 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915195+0000", 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3953000000000003e-05 2024-04-23T23:37:33.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915275+0000", 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0551999999999997e-05 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.916324+0000", 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001048142 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919386+0000", 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0030625140000000001 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919414+0000", 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7934000000000001e-05 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919451+0000", 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7348999999999998e-05 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:33.116 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.109830163, 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010387709, 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 141 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7199999999999998e-07 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909307+0000", 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8169999999999998e-06 2024-04-23T23:37:33.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909315+0000", 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2749999999999998e-06 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909322+0000", 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1690000000000003e-06 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915942+0000", 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0066203720000000002 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915989+0000", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6523999999999997e-05 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.916080+0000", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1215e-05 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.916593+0000", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00051334199999999996 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:33.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919632+0000", 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.003039155 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919665+0000", 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2218000000000002e-05 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919690+0000", 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.495e-05 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:33.122 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:33.122 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:33.123 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:33.135+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:33.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:33.224 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:33.236+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:33.226 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:33.226 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:33.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:33.325 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:33.337+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:33.377 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:33.377 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:33.377 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:33.377 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:33.377 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:33.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:33.429 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:33.441+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:17 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'7, mlcod=16'5)", 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.234946+0000", 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.265913889, 2024-04-23T23:37:33.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018680579999999999, 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234946+0000", 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234946+0000", 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234947+0000", 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5460000000000001e-06 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234959+0000", 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1094000000000001e-05 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235003+0000", 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4229e-05 2024-04-23T23:37:33.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235018+0000", 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5109999999999999e-05 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235145+0000", 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012705099999999999 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235164+0000", 2024-04-23T23:37:33.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9245e-05 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.236753+0000", 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001589147 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.236814+0000", 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0636e-05 2024-04-23T23:37:33.494 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:18 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'8, mlcod=16'5)", 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.235441+0000", 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.265418444, 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0041657949999999999, 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.495 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235441+0000", 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235441+0000", 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235442+0000", 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5799999999999998e-07 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235458+0000", 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6237000000000001e-05 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235471+0000", 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2975e-05 2024-04-23T23:37:33.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235477+0000", 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6670000000000001e-06 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235547+0000", 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9660999999999996e-05 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235561+0000", 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4089e-05 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.239568+0000", 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040074739999999996 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.239607+0000", 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8933999999999997e-05 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.499 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:20 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'10, mlcod=16'8)", 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.243071+0000", 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.257789062000001, 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017561269999999999, 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243071+0000", 2024-04-23T23:37:33.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243071+0000", 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243072+0000", 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4600000000000004e-07 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243190+0000", 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000118402 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243203+0000", 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2794e-05 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243210+0000", 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9029999999999998e-06 2024-04-23T23:37:33.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243259+0000", 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9132999999999999e-05 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.243273+0000", 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4143e-05 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.244775+0000", 2024-04-23T23:37:33.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015018329999999999 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.244827+0000", 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2172999999999997e-05 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'12)", 2024-04-23T23:37:33.504 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.253323089, 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020998950000000001, 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.06e-07 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247542+0000", 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2640000000000002e-06 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247553+0000", 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1226000000000001e-05 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247558+0000", 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5949999999999998e-06 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247609+0000", 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0562999999999997e-05 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247625+0000", 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5594999999999999e-05 2024-04-23T23:37:33.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.249604+0000", 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019791349999999999 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.249637+0000", 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2910999999999997e-05 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:25 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'15, mlcod=16'13)", 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.250477+0000", 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.250382709, 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017360089999999999, 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250477+0000", 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250477+0000", 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250478+0000", 2024-04-23T23:37:33.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1800000000000005e-07 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250483+0000", 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6389999999999997e-06 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250496+0000", 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.223e-05 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250504+0000", 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4290000000000001e-06 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250554+0000", 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0022999999999999e-05 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.250568+0000", 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4207e-05 2024-04-23T23:37:33.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.252180+0000", 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001611321 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.252213+0000", 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3442000000000003e-05 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.514 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:33 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'19, mlcod=16'14)", 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.255688+0000", 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.245171362000001, 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001834364, 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255688+0000", 2024-04-23T23:37:33.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255688+0000", 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255689+0000", 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1699999999999998e-07 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255695+0000", 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5999999999999997e-06 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255706+0000", 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1133e-05 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255713+0000", 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.498e-06 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255757+0000", 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4171000000000001e-05 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.255771+0000", 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3661e-05 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.257488+0000", 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017167560000000001 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.257523+0000", 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4928000000000002e-05 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:61 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'39, mlcod=16'37)", 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.22239328, 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002235791, 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.519 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:33.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0900000000000001e-07 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278472+0000", 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278484+0000", 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1654999999999999e-05 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278490+0000", 2024-04-23T23:37:33.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5230000000000003e-06 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278529+0000", 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9533000000000002e-05 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278548+0000", 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8621e-05 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.280663+0000", 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002115661 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.280702+0000", 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8899000000000001e-05 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:62 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'40, mlcod=16'38)", 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.281518+0000", 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.219341442999999, 2024-04-23T23:37:33.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044233880000000003, 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281518+0000", 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281518+0000", 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281519+0000", 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8100000000000002e-07 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281524+0000", 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1159999999999998e-06 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281536+0000", 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1477999999999999e-05 2024-04-23T23:37:33.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281541+0000", 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.356e-06 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281582+0000", 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1208999999999998e-05 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281601+0000", 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8788999999999999e-05 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.285898+0000", 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042973830000000001 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.285942+0000", 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3375999999999999e-05 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.212353335, 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036867240000000002, 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.85e-07 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288519+0000", 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1651000000000001e-05 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288528+0000", 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4050000000000006e-06 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288533+0000", 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9139999999999999e-06 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288628+0000", 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4469000000000006e-05 2024-04-23T23:37:33.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288654+0000", 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6299e-05 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.292159+0000", 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035049030000000002 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.292193+0000", 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4298000000000003e-05 2024-04-23T23:37:33.531 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.211904156999999, 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0057969629999999996, 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5799999999999999e-07 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289007+0000", 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0630000000000001e-05 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289017+0000", 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9860000000000006e-06 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289024+0000", 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6490000000000002e-06 2024-04-23T23:37:33.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289081+0000", 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7753000000000001e-05 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289096+0000", 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4171e-05 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.294711+0000", 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056157530000000002 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.294753+0000", 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1362999999999997e-05 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.211262098000001, 2024-04-23T23:37:33.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0054478469999999996, 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8400000000000004e-07 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289604+0000", 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1019999999999996e-06 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289615+0000", 2024-04-23T23:37:33.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1483e-05 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289620+0000", 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2599999999999996e-06 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.291875+0000", 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022550690000000002 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.291895+0000", 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9975000000000001e-05 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295014+0000", 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003118446 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295046+0000", 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1828000000000001e-05 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.540 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:71 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'45, mlcod=16'43)", 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.295666+0000", 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.205193585, 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022767799999999999, 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295666+0000", 2024-04-23T23:37:33.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295666+0000", 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295667+0000", 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4399999999999999e-07 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295706+0000", 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8637000000000003e-05 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295717+0000", 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1858999999999999e-05 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295727+0000", 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4849999999999998e-06 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295767+0000", 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9839999999999998e-05 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295786+0000", 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9635000000000001e-05 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.297905+0000", 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021181310000000001 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.297943+0000", 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8448999999999997e-05 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.296092+0000", 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.20476743, 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021310650000000001, 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.545 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296092+0000", 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296092+0000", 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296093+0000", 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296157+0000", 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3571999999999994e-05 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296165+0000", 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.755e-06 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296171+0000", 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5419999999999996e-06 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296210+0000", 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9059e-05 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296223+0000", 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.288e-05 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.298192+0000", 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001969232 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.298223+0000", 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1485000000000001e-05 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.549 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:76 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'50, mlcod=16'48)", 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.300212+0000", 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.200647634999999, 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022126120000000001, 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300212+0000", 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300212+0000", 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300213+0000", 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300217+0000", 2024-04-23T23:37:33.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9949999999999999e-06 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300228+0000", 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1226000000000001e-05 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300234+0000", 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5080000000000002e-06 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300272+0000", 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7555000000000002e-05 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300286+0000", 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3974999999999999e-05 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.302391+0000", 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021054759999999998 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.302425+0000", 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3349999999999997e-05 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'51, mlcod=16'49)", 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.303105+0000", 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.197754707, 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020249420000000001, 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.556 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303105+0000", 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303105+0000", 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303106+0000", 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303110+0000", 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2629999999999997e-06 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303119+0000", 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5380000000000008e-06 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303125+0000", 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303168+0000", 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3108999999999997e-05 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303188+0000", 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9964999999999999e-05 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.305096+0000", 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019072939999999999 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.305130+0000", 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4527000000000003e-05 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.560 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'72)", 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.499158+0000", 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.001701690000001, 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001788347, 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499158+0000", 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499158+0000", 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499159+0000", 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499225+0000", 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6449e-05 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499231+0000", 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3980000000000004e-06 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499235+0000", 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4979999999999998e-06 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499271+0000", 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6365000000000002e-05 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.499290+0000", 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8853999999999999e-05 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.500916+0000", 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0016259130000000001 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.500946+0000", 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0487000000000001e-05 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.564 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:135 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'93, mlcod=16'88)", 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.912297+0000", 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.588563090999999, 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018444780000000001, 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912297+0000", 2024-04-23T23:37:33.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912297+0000", 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912297+0000", 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912301+0000", 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.433e-06 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912310+0000", 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8139999999999995e-06 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912316+0000", 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1540000000000001e-06 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912355+0000", 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9749000000000002e-05 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.912369+0000", 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3635000000000001e-05 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914110+0000", 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001740906 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914141+0000", 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1340000000000001e-05 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'93)", 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.914937+0000", 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.585922397999999, 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0038834770000000002, 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.569 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914937+0000", 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914937+0000", 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914938+0000", 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4200000000000001e-07 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914941+0000", 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3569999999999998e-06 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914947+0000", 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914951+0000", 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4599999999999999e-06 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914986+0000", 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5862999999999999e-05 2024-04-23T23:37:33.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915005+0000", 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8692e-05 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918791+0000", 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037859479999999999 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918821+0000", 2024-04-23T23:37:33.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9887999999999999e-05 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:140 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'98, mlcod=16'93)", 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.915369+0000", 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.585490543000001, 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039059189999999999, 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915369+0000", 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915369+0000", 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915370+0000", 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:37:33.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915430+0000", 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0736999999999998e-05 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915437+0000", 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4169999999999997e-06 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915441+0000", 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7730000000000001e-06 2024-04-23T23:37:33.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915472+0000", 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1201000000000002e-05 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915487+0000", 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5384999999999999e-05 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919247+0000", 2024-04-23T23:37:33.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037595250000000001 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919275+0000", 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8462999999999998e-05 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'95)", 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.584708223, 2024-04-23T23:37:33.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033747130000000001, 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916156+0000", 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9720000000000003e-06 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916163+0000", 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3690000000000001e-06 2024-04-23T23:37:33.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916167+0000", 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.67e-06 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918850+0000", 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0026833349999999998 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918864+0000", 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.341e-05 2024-04-23T23:37:33.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919509+0000", 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000645478 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919526+0000", 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6969999999999998e-05 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:33.582 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:33.583 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:33.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:33.584 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:33.596+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:33.685 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:33.697+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:33.727 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:33.727 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:33.727 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:33.727 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:33.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:33.785 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:33.797+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:33.787 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:37:33.883 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:33.884 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:33.884 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:33.884 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:33.884 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:33.887 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:33.899+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:33.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:33.988 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:34.000+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:33.996 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:33.996 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:33.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7 3.1a e23/21 3:5cea7035:::rbd_info:head v 23'1, mlcod=0'0)", 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.2083616269999999, 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00076468599999999999, 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8799999999999999e-07 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801032+0000", 2024-04-23T23:37:33.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2289999999999997e-06 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801042+0000", 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5729999999999997e-06 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801051+0000", 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3929999999999997e-06 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801085+0000", 2024-04-23T23:37:33.999 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4066999999999998e-05 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801106+0000", 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0801e-05 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801756+0000", 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00065014800000000002 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:34.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801792+0000", 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6287e-05 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:9 3.1a e24/21 3:5cea7035:::rbd_info:head v 24'2, mlcod=0'0)", 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.202749607, 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00066598099999999995, 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.001 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5899999999999998e-07 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806646+0000", 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.677e-06 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806657+0000", 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806668+0000", 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0767e-05 2024-04-23T23:37:34.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806713+0000", 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5049999999999997e-05 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806728+0000", 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5378000000000001e-05 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:34.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.807263+0000", 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00053452000000000003 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.807306+0000", 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2704999999999999e-05 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:34.005 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:34.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:34.089 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:34.100+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:34.151 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:34.151 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:34.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:34.189 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:34.201+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:34.264 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:34.264 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:34.264 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:34.264 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:34.264 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:34.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:34.317 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:34.329+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:34.377 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:34.377 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:34.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:34.377 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:37:34.377 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:34.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:34.391 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:34.403+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:34.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:37:34.513 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:34.525+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:34.530 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:34.531 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:34.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:34.590 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:34.590 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:34.593 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:34.605+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:34.615 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:34.615 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:34.632 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:34.632 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:34.649 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:34.649 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:34.668 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:34.668 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:34.686 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:37:34.686 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:37:34.690 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:34.690 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:34.694 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:34.706+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:34.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:34.705 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:34.705 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:34.723 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:34.723 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:34.795 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:34.806+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:34.811 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:34.811 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:34.821 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:34.896 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:34.907+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:34.936 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:34.936 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:34.945 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:34.996 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:35.008+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:35.088 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.088 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.097 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:35.097 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:35.109+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:35.199 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.199 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.199 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:35.210+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:35.207 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:37:35.298 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:35.310+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:35.309 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.309 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.318 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:37:35.402 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:35.414+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:35.460 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.460 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.469 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:37:35.502 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:35.514+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:35.506 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0x9cdd529 2024-04-23T23:37:35.518 INFO:teuthology.orchestra.run.smithi077.stdout:2 trunc from 0x0 to 0x9cdd529 2024-04-23T23:37:35.524 INFO:teuthology.orchestra.run.smithi077.stdout:4 punch from 0x9954660 to 0x995fd85, (0xb725 bytes) 2024-04-23T23:37:35.525 INFO:teuthology.orchestra.run.smithi077.stdout:5 read 0x6ece65f thru 0x6ed7814 (0x91b6 bytes) 2024-04-23T23:37:35.525 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.525 INFO:teuthology.orchestra.run.smithi077.stdout:7 read 0x247701e thru 0x2483559 (0xc53c bytes) 2024-04-23T23:37:35.525 INFO:teuthology.orchestra.run.smithi077.stdout:9 read 0x7cc0c86 thru 0x7cc1b4e (0xec9 bytes) 2024-04-23T23:37:35.525 INFO:teuthology.orchestra.run.smithi077.stdout:10 read 0x38ee055 thru 0x38fd539 (0xf4e5 bytes) 2024-04-23T23:37:35.525 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.530 INFO:teuthology.orchestra.run.smithi077.stdout:12 writesame 0x9e0dc9c thru 0x9e0f013 data_size 0x8(0x1378 bytes) 2024-04-23T23:37:35.530 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.537 INFO:teuthology.orchestra.run.smithi077.stdout:14 trunc from 0x9e0f014 to 0x44821d1 2024-04-23T23:37:35.543 INFO:teuthology.orchestra.run.smithi077.stdout:16 read 0x21a77f2 thru 0x21abf75 (0x4784 bytes) 2024-04-23T23:37:35.544 INFO:teuthology.orchestra.run.smithi077.stdout:17 read 0x18a5f73 thru 0x18b0d06 (0xad94 bytes) 2024-04-23T23:37:35.544 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xb197872 2024-04-23T23:37:35.551 INFO:teuthology.orchestra.run.smithi077.stdout:18 trunc from 0x44821d1 to 0xb197872 2024-04-23T23:37:35.563 INFO:teuthology.orchestra.run.smithi077.stdout:19 trunc from 0xb197872 to 0x7946a29 2024-04-23T23:37:35.569 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.569 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.578 INFO:teuthology.orchestra.run.smithi077.stdout:24 writesame 0x9b83121 thru 0x9b924c3 data_size 0x1(0xf3a3 bytes) 2024-04-23T23:37:35.579 INFO:teuthology.orchestra.run.smithi077.stdout:25 write 0x445c7e6 thru 0x446aa24 (0xe23f bytes) 2024-04-23T23:37:35.582 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xc5f057f 2024-04-23T23:37:35.585 INFO:teuthology.orchestra.run.smithi077.stdout:27 trunc from 0x9b924c4 to 0xc5f057f 2024-04-23T23:37:35.591 INFO:teuthology.orchestra.run.smithi077.stdout:28 write 0x3bc53bf thru 0x3bcf1bc (0x9dfe bytes) 2024-04-23T23:37:35.603 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:35.615+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:35.606 INFO:teuthology.orchestra.run.smithi077.stdout:29 trunc from 0xc5f057f to 0x2ede03e 2024-04-23T23:37:35.618 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.619 INFO:teuthology.orchestra.run.smithi077.stdout:31 trunc from 0x2ede03e to 0x43a1939 2024-04-23T23:37:35.621 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.621 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.626 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.627 INFO:teuthology.orchestra.run.smithi077.stdout:35 trunc from 0x43a1939 to 0x504e4d1 2024-04-23T23:37:35.631 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.633 INFO:teuthology.orchestra.run.smithi077.stdout:38 writesame 0x62f9ad thru 0x638848 data_size 0x2(0x8e9c bytes) 2024-04-23T23:37:35.643 INFO:teuthology.orchestra.run.smithi077.stdout:40 read 0x4027d6b thru 0x402c6fc (0x4992 bytes) 2024-04-23T23:37:35.643 INFO:teuthology.orchestra.run.smithi077.stdout:41 read 0x1987284 thru 0x198fd8e (0x8b0b bytes) 2024-04-23T23:37:35.644 INFO:teuthology.orchestra.run.smithi077.stdout:43 trunc from 0x504e4d1 to 0x49494b7 2024-04-23T23:37:35.661 INFO:teuthology.orchestra.run.smithi077.stdout:44 writesame 0x83f792b thru 0x8400304 data_size 0x5(0x89da bytes) 2024-04-23T23:37:35.668 INFO:teuthology.orchestra.run.smithi077.stdout:45 writesame 0x8bd8a4a thru 0x8be6616 data_size 0x1(0xdbcd bytes) 2024-04-23T23:37:35.668 INFO:teuthology.orchestra.run.smithi077.stdout:46 write 0x701f102 thru 0x702e48d (0xf38c bytes) 2024-04-23T23:37:35.671 INFO:teuthology.orchestra.run.smithi077.stdout:47 writesame 0x64c1505 thru 0x64cf0df data_size 0x3(0xdbdb bytes) 2024-04-23T23:37:35.682 INFO:teuthology.orchestra.run.smithi077.stdout:48 write 0x7c528f9 thru 0x7c5c8b8 (0x9fc0 bytes) 2024-04-23T23:37:35.690 INFO:teuthology.orchestra.run.smithi077.stdout:49 trunc from 0x8be6617 to 0xc030b1d 2024-04-23T23:37:35.695 INFO:teuthology.orchestra.run.smithi077.stdout:50 write 0x5d418fa thru 0x5d4970e (0x7e15 bytes) 2024-04-23T23:37:35.698 INFO:teuthology.orchestra.run.smithi077.stdout:51 writesame 0x35dd699 thru 0x35e9de7 data_size 0x25(0xc74f bytes) 2024-04-23T23:37:35.704 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:35.716+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:35.713 INFO:teuthology.orchestra.run.smithi077.stdout:52 writesame 0xeb3b343 thru 0xeb3f44e data_size 0x2e(0x410c bytes) 2024-04-23T23:37:35.713 INFO:teuthology.orchestra.run.smithi077.stdout:53 write 0x17c7c8e thru 0x17cd5b0 (0x5923 bytes) 2024-04-23T23:37:35.718 INFO:teuthology.orchestra.run.smithi077.stdout:55 read 0x653ff04 thru 0x6544f77 (0x5074 bytes) 2024-04-23T23:37:35.718 INFO:teuthology.orchestra.run.smithi077.stdout:59 write 0xa498038 thru 0xa4a3cd8 (0xbca1 bytes) 2024-04-23T23:37:35.719 INFO:teuthology.orchestra.run.smithi077.stdout:60 punch from 0xadbfd8e to 0xadc18bf, (0x1b31 bytes) 2024-04-23T23:37:35.719 INFO:teuthology.orchestra.run.smithi077.stdout:62 writesame 0xc749210 thru 0xc74c19c data_size 0x25(0x2f8d bytes) 2024-04-23T23:37:35.724 INFO:teuthology.orchestra.run.smithi077.stdout:64 write 0x22231bb thru 0x2226fda (0x3e20 bytes) 2024-04-23T23:37:35.734 INFO:teuthology.orchestra.run.smithi077.stdout:65 trunc from 0xeb3f44f to 0x93bc8da 2024-04-23T23:37:35.744 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.745 INFO:teuthology.orchestra.run.smithi077.stdout:67 punch from 0x30f9177 to 0x30fea6b, (0x58f4 bytes) 2024-04-23T23:37:35.750 INFO:teuthology.orchestra.run.smithi077.stdout:70 writesame 0x98d4a09 thru 0x98e464d data_size 0x67(0xfc45 bytes) 2024-04-23T23:37:35.750 INFO:teuthology.orchestra.run.smithi077.stdout:71 read 0x20efb6d thru 0x20f5112 (0x55a6 bytes) 2024-04-23T23:37:35.751 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.751 INFO:teuthology.orchestra.run.smithi077.stdout:73 read 0x27a6ace thru 0x27ae850 (0x7d83 bytes) 2024-04-23T23:37:35.751 INFO:teuthology.orchestra.run.smithi077.stdout:75 punch from 0x5f49511 to 0x5f4cb4f, (0x363e bytes) 2024-04-23T23:37:35.751 INFO:teuthology.orchestra.run.smithi077.stdout:76 write 0x24506ee thru 0x2454531 (0x3e44 bytes) 2024-04-23T23:37:35.765 INFO:teuthology.orchestra.run.smithi077.stdout:77 write 0xea8c455 thru 0xea999c0 (0xd56c bytes) 2024-04-23T23:37:35.769 INFO:teuthology.orchestra.run.smithi077.stdout:78 writesame 0xe9ae7b7 thru 0xe9b70f1 data_size 0x1(0x893b bytes) 2024-04-23T23:37:35.780 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.781 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.785 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.785 INFO:teuthology.orchestra.run.smithi077.stdout:81 read 0xc071d5f thru 0xc074a91 (0x2d33 bytes) 2024-04-23T23:37:35.789 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:35.797 INFO:teuthology.orchestra.run.smithi077.stdout:82 trunc from 0xea999c1 to 0x4a8d1df 2024-04-23T23:37:35.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:37:35.809 INFO:teuthology.orchestra.run.smithi077.stdout:84 read 0x38c7c0 thru 0x397bff (0xb440 bytes) 2024-04-23T23:37:35.826 INFO:teuthology.orchestra.run.smithi077.stdout:85 write 0xe37bbac thru 0xe37c1dc (0x631 bytes) 2024-04-23T23:37:35.829 INFO:teuthology.orchestra.run.smithi077.stdout:86 read 0x3a3ae2e thru 0x3a4623c (0xb40f bytes) 2024-04-23T23:37:35.832 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:35.844+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:88 writesame 0xeca2fbb thru 0xeca8ab9 data_size 0x5(0x5aff bytes) 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:89 punch from 0x71e8c92 to 0x71f5f6a, (0xd2d8 bytes) 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:94 punch from 0x388de00 to 0x389b1d6, (0xd3d6 bytes) 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:98 punch from 0x5f09154 to 0x5f0cf54, (0x3e00 bytes) 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:102 read 0x98d693f thru 0x98e1134 (0xa7f6 bytes) 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:104 punch from 0x47e8546 to 0x47ed661, (0x511b bytes) 2024-04-23T23:37:35.835 INFO:teuthology.orchestra.run.smithi077.stdout:105 punch from 0x687c7c2 to 0x688b8fc, (0xf13a bytes) 2024-04-23T23:37:35.839 INFO:teuthology.orchestra.run.smithi077.stdout:106 trunc from 0xeca8aba to 0xb1e855c 2024-04-23T23:37:35.849 INFO:teuthology.orchestra.run.smithi077.stdout:108 write 0x811ed1c thru 0x8129876 (0xab5b bytes) 2024-04-23T23:37:35.852 INFO:teuthology.orchestra.run.smithi077.stdout:110 writesame 0x54f8e7d thru 0x54fcc26 data_size 0x9(0x3daa bytes) 2024-04-23T23:37:35.859 INFO:teuthology.orchestra.run.smithi077.stdout:111 trunc from 0xb1e855c to 0x79ba2e8 2024-04-23T23:37:35.875 INFO:teuthology.orchestra.run.smithi077.stdout:113 writesame 0x9518f93 thru 0x951ebdd data_size 0x1(0x5c4b bytes) 2024-04-23T23:37:35.879 INFO:teuthology.orchestra.run.smithi077.stdout:114 trunc from 0x951ebde to 0x5a75181 2024-04-23T23:37:35.899 INFO:teuthology.orchestra.run.smithi077.stdout:115 write 0xc23257e thru 0xc2420f6 (0xfb79 bytes) 2024-04-23T23:37:35.901 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:35.901 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:35.902 INFO:teuthology.orchestra.run.smithi077.stdout:118 read 0x4644cfe thru 0x464db26 (0x8e29 bytes) 2024-04-23T23:37:35.902 INFO:teuthology.orchestra.run.smithi077.stdout:119 write 0x3dda0ce thru 0x3de19b1 (0x78e4 bytes) 2024-04-23T23:37:35.905 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:35.917+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:35.911 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:35.911 INFO:teuthology.orchestra.run.smithi077.stdout:120 write 0xc35d18d thru 0xc36498f (0x7803 bytes) 2024-04-23T23:37:35.922 INFO:teuthology.orchestra.run.smithi077.stdout:122 trunc from 0xc364990 to 0x3d6567f 2024-04-23T23:37:35.933 INFO:teuthology.orchestra.run.smithi077.stdout:123 read 0x182957c thru 0x1836ffe (0xda83 bytes) 2024-04-23T23:37:35.933 INFO:teuthology.orchestra.run.smithi077.stdout:124 read 0x2b8c9e1 thru 0x2b92150 (0x5770 bytes) 2024-04-23T23:37:35.933 INFO:teuthology.orchestra.run.smithi077.stdout:125 read 0x2758ac7 thru 0x2765445 (0xc97f bytes) 2024-04-23T23:37:35.951 INFO:teuthology.orchestra.run.smithi077.stdout:126 write 0xe51ebbc thru 0xe52c382 (0xd7c7 bytes) 2024-04-23T23:37:35.954 INFO:teuthology.orchestra.run.smithi077.stdout:127 read 0xc4fcfd7 thru 0xc508781 (0xb7ab bytes) 2024-04-23T23:37:35.954 INFO:teuthology.orchestra.run.smithi077.stdout:128 writesame 0xd427551 thru 0xd42d922 data_size 0x3(0x63d2 bytes) 2024-04-23T23:37:35.959 INFO:teuthology.orchestra.run.smithi077.stdout:130 write 0x880f22b thru 0x88195f7 (0xa3cd bytes) 2024-04-23T23:37:35.963 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.963 INFO:teuthology.orchestra.run.smithi077.stdout:132 write 0x1e915af thru 0x1e9bbf8 (0xa64a bytes) 2024-04-23T23:37:35.966 INFO:teuthology.orchestra.run.smithi077.stdout:133 writesame 0x76c63db thru 0x76ca2dc data_size 0x1(0x3f02 bytes) 2024-04-23T23:37:35.976 INFO:teuthology.orchestra.run.smithi077.stdout:134 read 0x31c2b70 thru 0x31cb0a7 (0x8538 bytes) 2024-04-23T23:37:35.976 INFO:teuthology.orchestra.run.smithi077.stdout:135 write 0xb4bb6a6 thru 0xb4c3deb (0x8746 bytes) 2024-04-23T23:37:35.979 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:35.979 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xe17f6c6 2024-04-23T23:37:35.979 INFO:teuthology.orchestra.run.smithi077.stdout:138 trunc from 0xe52c383 to 0xe17f6c6 2024-04-23T23:37:35.988 INFO:teuthology.orchestra.run.smithi077.stdout:139 read 0xb7b9790 thru 0xb7bfe3a (0x66ab bytes) 2024-04-23T23:37:35.988 INFO:teuthology.orchestra.run.smithi077.stdout:141 write 0x441fc5c thru 0x442ea1a (0xedbf bytes) 2024-04-23T23:37:35.995 INFO:teuthology.orchestra.run.smithi077.stdout:142 trunc from 0xe17f6c6 to 0xaedacbb 2024-04-23T23:37:36.005 INFO:teuthology.orchestra.run.smithi077.stdout:144 punch from 0xab57b47 to 0xab67675, (0xfb2e bytes) 2024-04-23T23:37:36.005 INFO:teuthology.orchestra.run.smithi077.stdout:145 write 0x17c93bf thru 0x17d571b (0xc35d bytes) 2024-04-23T23:37:36.006 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:36.018+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:36.007 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.007 INFO:teuthology.orchestra.run.smithi077.stdout:148 read 0x888d989 thru 0x88981a3 (0xa81b bytes) 2024-04-23T23:37:36.007 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.007 INFO:teuthology.orchestra.run.smithi077.stdout:152 write 0x26151c0 thru 0x2621cfa (0xcb3b bytes) 2024-04-23T23:37:36.009 INFO:teuthology.orchestra.run.smithi077.stdout:153 write 0x957c4ab thru 0x958ba8b (0xf5e1 bytes) 2024-04-23T23:37:36.013 INFO:teuthology.orchestra.run.smithi077.stdout:156 read 0x8c47ef9 thru 0x8c4bc24 (0x3d2c bytes) 2024-04-23T23:37:36.013 INFO:teuthology.orchestra.run.smithi077.stdout:157 read 0xf9b567 thru 0xf9da21 (0x24bb bytes) 2024-04-23T23:37:36.014 INFO:teuthology.orchestra.run.smithi077.stdout:158 trunc from 0xaedacbb to 0x9895b47 2024-04-23T23:37:36.020 INFO:teuthology.orchestra.run.smithi077.stdout:159 write 0x17e841d thru 0x17eee85 (0x6a69 bytes) 2024-04-23T23:37:36.030 INFO:teuthology.orchestra.run.smithi077.stdout:160 trunc from 0x9895b47 to 0x48800ee 2024-04-23T23:37:36.049 INFO:teuthology.orchestra.run.smithi077.stdout:163 write 0x8701f17 thru 0x870fe86 (0xdf70 bytes) 2024-04-23T23:37:36.052 INFO:teuthology.orchestra.run.smithi077.stdout:165 write 0x1b5310c thru 0x1b57c80 (0x4b75 bytes) 2024-04-23T23:37:36.055 INFO:teuthology.orchestra.run.smithi077.stdout:168 read 0x1d7b5c4 thru 0x1d7d89f (0x22dc bytes) 2024-04-23T23:37:36.056 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.056 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.056 INFO:teuthology.orchestra.run.smithi077.stdout:171 read 0x2ca55cd thru 0x2ca6b8c (0x15c0 bytes) 2024-04-23T23:37:36.056 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xea049eb 2024-04-23T23:37:36.063 INFO:teuthology.orchestra.run.smithi077.stdout:173 trunc from 0x870fe87 to 0xea049eb 2024-04-23T23:37:36.064 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.064 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.068 INFO:teuthology.orchestra.run.smithi077.stdout:174 read 0x4f6bb6c thru 0x4f6dfc9 (0x245e bytes) 2024-04-23T23:37:36.068 INFO:teuthology.orchestra.run.smithi077.stdout:175 read 0x667aa77 thru 0x668296a (0x7ef4 bytes) 2024-04-23T23:37:36.068 INFO:teuthology.orchestra.run.smithi077.stdout:176 write 0x383a3fc thru 0x383b29c (0xea1 bytes) 2024-04-23T23:37:36.071 INFO:teuthology.orchestra.run.smithi077.stdout:177 write 0xad8bb23 thru 0xad97003 (0xb4e1 bytes) 2024-04-23T23:37:36.074 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:36.075 INFO:teuthology.orchestra.run.smithi077.stdout:178 read 0x42f414c thru 0x4300b07 (0xc9bc bytes) 2024-04-23T23:37:36.080 INFO:teuthology.orchestra.run.smithi077.stdout:181 trunc from 0xea049eb to 0x9d66ccf 2024-04-23T23:37:36.090 INFO:teuthology.orchestra.run.smithi077.stdout:182 read 0x455e686 thru 0x4566832 (0x81ad bytes) 2024-04-23T23:37:36.090 INFO:teuthology.orchestra.run.smithi077.stdout:183 write 0x40d02cc thru 0x40d1f41 (0x1c76 bytes) 2024-04-23T23:37:36.092 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.093 INFO:teuthology.orchestra.run.smithi077.stdout:185 write 0x3d91558 thru 0x3d92c04 (0x16ad bytes) 2024-04-23T23:37:36.094 INFO:teuthology.orchestra.run.smithi077.stdout:186 write 0x505a66d thru 0x5069691 (0xf025 bytes) 2024-04-23T23:37:36.097 INFO:teuthology.orchestra.run.smithi077.stdout:190 read 0x31ff0e2 thru 0x3208da7 (0x9cc6 bytes) 2024-04-23T23:37:36.097 INFO:teuthology.orchestra.run.smithi077.stdout:191 read 0x7da15dd thru 0x7da8f3e (0x7962 bytes) 2024-04-23T23:37:36.097 INFO:teuthology.orchestra.run.smithi077.stdout:192 read 0x4dd8520 thru 0x4de6e69 (0xe94a bytes) 2024-04-23T23:37:36.097 INFO:teuthology.orchestra.run.smithi077.stdout:193 read 0x9cd0647 thru 0x9cd202f (0x19e9 bytes) 2024-04-23T23:37:36.097 INFO:teuthology.orchestra.run.smithi077.stdout:194 writesame 0x4798ff4 thru 0x47a42f1 data_size 0x15(0xb2fe bytes) 2024-04-23T23:37:36.098 INFO:teuthology.orchestra.run.smithi077.stdout:195 punch from 0x73cdc5 to 0x73d709, (0x944 bytes) 2024-04-23T23:37:36.105 INFO:teuthology.orchestra.run.smithi077.stdout:196 trunc from 0x9d66ccf to 0x44b764c 2024-04-23T23:37:36.115 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:36.127+0000 7fcfef14d640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 31963) UID: 0 2024-04-23T23:37:36.132 INFO:teuthology.orchestra.run.smithi077.stdout:197 write 0xc60b121 thru 0xc615c34 (0xab14 bytes) 2024-04-23T23:37:36.135 INFO:teuthology.orchestra.run.smithi077.stdout:198 write 0x89cbde thru 0x8a5859 (0x8c7c bytes) 2024-04-23T23:37:36.138 INFO:teuthology.orchestra.run.smithi077.stdout:199 read 0x9b6119 thru 0x9b99de (0x38c6 bytes) 2024-04-23T23:37:36.139 INFO:teuthology.orchestra.run.smithi077.stdout:200 punch from 0x7144b11 to 0x7153cd0, (0xf1bf bytes) 2024-04-23T23:37:36.139 INFO:teuthology.orchestra.run.smithi077.stdout:201 write 0x31a407 thru 0x32178a (0x7384 bytes) 2024-04-23T23:37:36.142 INFO:teuthology.orchestra.run.smithi077.stdout:203 read 0x2a35490 thru 0x2a390cd (0x3c3e bytes) 2024-04-23T23:37:36.142 INFO:teuthology.orchestra.run.smithi077.stdout:206 read 0xf8c265 thru 0xf917c2 (0x555e bytes) 2024-04-23T23:37:36.143 INFO:teuthology.orchestra.run.smithi077.stdout:207 write 0xa52e2fc thru 0xa53133d (0x3042 bytes) 2024-04-23T23:37:36.152 INFO:teuthology.orchestra.run.smithi077.stdout:208 write 0xd931603 thru 0xd9332d4 (0x1cd2 bytes) 2024-04-23T23:37:36.156 INFO:teuthology.orchestra.run.smithi077.stdout:209 write 0x946548d thru 0x946cb18 (0x768c bytes) 2024-04-23T23:37:36.160 INFO:teuthology.orchestra.run.smithi077.stdout:210 punch from 0xd0ec234 to 0xd0f3bbc, (0x7988 bytes) 2024-04-23T23:37:36.160 INFO:teuthology.orchestra.run.smithi077.stdout:211 read 0x5c88016 thru 0x5c89ecc (0x1eb7 bytes) 2024-04-23T23:37:36.160 INFO:teuthology.orchestra.run.smithi077.stdout:212 punch from 0xf8a515 to 0xf8b096, (0xb81 bytes) 2024-04-23T23:37:36.160 INFO:teuthology.orchestra.run.smithi077.stdout:213 writesame 0x72c1ef3 thru 0x72c4605 data_size 0x1(0x2713 bytes) 2024-04-23T23:37:36.165 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.165 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.166 INFO:teuthology.orchestra.run.smithi077.stdout:217 punch from 0xcbb52c0 to 0xcbbfd80, (0xaac0 bytes) 2024-04-23T23:37:36.166 INFO:teuthology.orchestra.run.smithi077.stdout:219 writesame 0x7d75748 thru 0x7d8380a data_size 0x1(0xe0c3 bytes) 2024-04-23T23:37:36.194 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.207 INFO:teuthology.orchestra.run.smithi077.stdout:221 trunc from 0xd9332d5 to 0x1fc4546 2024-04-23T23:37:36.208 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:36.220+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:36.225 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.225 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.234 INFO:teuthology.orchestra.run.smithi077.stdout:223 write 0x828fe6a thru 0x829934e (0x94e5 bytes) 2024-04-23T23:37:36.235 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:36.238 INFO:teuthology.orchestra.run.smithi077.stdout:227 read 0x241db48 thru 0x242cf34 (0xf3ed bytes) 2024-04-23T23:37:36.238 INFO:teuthology.orchestra.run.smithi077.stdout:228 punch from 0x2596c9 to 0x25fd8e, (0x66c5 bytes) 2024-04-23T23:37:36.238 INFO:teuthology.orchestra.run.smithi077.stdout:229 read 0x730415b thru 0x7307567 (0x340d bytes) 2024-04-23T23:37:36.238 INFO:teuthology.orchestra.run.smithi077.stdout:231 write 0x6cc8987 thru 0x6cd87b2 (0xfe2c bytes) 2024-04-23T23:37:36.241 INFO:teuthology.orchestra.run.smithi077.stdout:232 read 0x59b8c26 thru 0x59c479c (0xbb77 bytes) 2024-04-23T23:37:36.241 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.241 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:36.241 INFO:teuthology.orchestra.run.smithi077.stdout:236 read 0x1a0f270 thru 0x1a1f1b1 (0xff42 bytes) 2024-04-23T23:37:36.249 INFO:teuthology.orchestra.run.smithi077.stdout:238 write 0x94087a0 thru 0x941420c (0xba6d bytes) 2024-04-23T23:37:36.252 INFO:teuthology.orchestra.run.smithi077.stdout:239 punch from 0xe6493b to 0xe73104, (0xe7c9 bytes) 2024-04-23T23:37:36.252 INFO:teuthology.orchestra.run.smithi077.stdout:240 write 0x2eaf767 thru 0x2eb781a (0x80b4 bytes) 2024-04-23T23:37:36.257 INFO:teuthology.orchestra.run.smithi077.stdout:245 trunc from 0x941420d to 0x7b3fcf6 2024-04-23T23:37:36.267 INFO:teuthology.orchestra.run.smithi077.stdout:247 read 0x2075239 thru 0x207693f (0x1707 bytes) 2024-04-23T23:37:36.267 INFO:teuthology.orchestra.run.smithi077.stdout:248 punch from 0x56f20d9 to 0x56f734f, (0x5276 bytes) 2024-04-23T23:37:36.267 INFO:teuthology.orchestra.run.smithi077.stdout:250 read 0x7a54acf thru 0x7a58dd4 (0x4306 bytes) 2024-04-23T23:37:36.282 INFO:teuthology.orchestra.run.smithi077.stdout:251 writesame 0xeb193ad thru 0xeb1b83c data_size 0x50(0x2490 bytes) 2024-04-23T23:37:36.282 INFO:teuthology.orchestra.run.smithi077.stdout:252 read 0x603fb44 thru 0x6043870 (0x3d2d bytes) 2024-04-23T23:37:36.282 INFO:teuthology.orchestra.run.smithi077.stdout:253 writesame 0x10feb3f thru 0x110830d data_size 0x1(0x97cf bytes) 2024-04-23T23:37:36.303 INFO:teuthology.orchestra.run.smithi077.stdout:255 write 0x36b2252 thru 0x36b666c (0x441b bytes) 2024-04-23T23:37:36.306 INFO:teuthology.orchestra.run.smithi077.stdout:256 read 0x76d3005 thru 0x76db43a (0x8436 bytes) 2024-04-23T23:37:36.306 INFO:teuthology.orchestra.run.smithi077.stdout:257 punch from 0x621bbf7 to 0x621d792, (0x1b9b bytes) 2024-04-23T23:37:36.306 INFO:teuthology.orchestra.run.smithi077.stdout:258 write 0xd7aaec0 thru 0xd7b858c (0xd6cd bytes) 2024-04-23T23:37:36.308 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:36.320+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:36.309 INFO:teuthology.orchestra.run.smithi077.stdout:259 write 0x4aa2495 thru 0x4aa4f4f (0x2abb bytes) 2024-04-23T23:37:36.326 INFO:teuthology.orchestra.run.smithi077.stdout:260 trunc from 0xeb1b83d to 0x21d050f 2024-04-23T23:37:36.337 INFO:teuthology.orchestra.run.smithi077.stdout:261 read 0x1882be5 thru 0x1884e9a (0x22b6 bytes) 2024-04-23T23:37:36.338 INFO:teuthology.orchestra.run.smithi077.stdout:262 read 0xcc26f3 thru 0xcc6d1c (0x462a bytes) 2024-04-23T23:37:36.344 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.344 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.348 INFO:teuthology.orchestra.run.smithi077.stdout:264 trunc from 0x21d050f to 0xac592c1 2024-04-23T23:37:36.354 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:36.366 INFO:teuthology.orchestra.run.smithi077.stdout:265 trunc from 0xac592c1 to 0x411ecb 2024-04-23T23:37:36.381 INFO:teuthology.orchestra.run.smithi077.stdout:266 read 0x31c23 thru 0x408ae (0xec8c bytes) 2024-04-23T23:37:36.382 INFO:teuthology.orchestra.run.smithi077.stdout:267 read 0x1b9246 thru 0x1c3b46 (0xa901 bytes) 2024-04-23T23:37:36.382 INFO:teuthology.orchestra.run.smithi077.stdout:268 read 0x35fa8c thru 0x36ef4f (0xf4c4 bytes) 2024-04-23T23:37:36.383 INFO:teuthology.orchestra.run.smithi077.stdout:269 punch from 0x383a47 to 0x38bf71, (0x852a bytes) 2024-04-23T23:37:36.383 INFO:teuthology.orchestra.run.smithi077.stdout:271 read 0x2b90d9 thru 0x2b9b05 (0xa2d bytes) 2024-04-23T23:37:36.404 INFO:teuthology.orchestra.run.smithi077.stdout:272 writesame 0xc15c48f thru 0xc15c764 data_size 0xb(0x2d6 bytes) 2024-04-23T23:37:36.404 INFO:teuthology.orchestra.run.smithi077.stdout:273 read 0x48623d5 thru 0x486d965 (0xb591 bytes) 2024-04-23T23:37:36.408 INFO:teuthology.orchestra.run.smithi077.stdout:274 trunc from 0xc15c765 to 0x7c1e7fe 2024-04-23T23:37:36.409 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:36.420+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:36.414 INFO:teuthology.orchestra.run.smithi077.stdout:275 punch from 0x27db1e5 to 0x27e6521, (0xb33c bytes) 2024-04-23T23:37:36.415 INFO:teuthology.orchestra.run.smithi077.stdout:276 write 0x2da9ca6 thru 0x2db7d00 (0xe05b bytes) 2024-04-23T23:37:36.418 INFO:teuthology.orchestra.run.smithi077.stdout:277 writesame 0x51eefa7 thru 0x51f88af data_size 0x9(0x9909 bytes) 2024-04-23T23:37:36.425 INFO:teuthology.orchestra.run.smithi077.stdout:279 read 0x41eb56a thru 0x41f4bd3 (0x966a bytes) 2024-04-23T23:37:36.425 INFO:teuthology.orchestra.run.smithi077.stdout:280 punch from 0x740c49e to 0x740df05, (0x1a67 bytes) 2024-04-23T23:37:36.425 INFO:teuthology.orchestra.run.smithi077.stdout:284 clone 1 order 25 su 8388608 sc 9 2024-04-23T23:37:36.461 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.462 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:36.514 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:36.526+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:36.573 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.573 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:36.611 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:36.623+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:36.712 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:36.724+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:36.724 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.724 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:36.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:37:36.797 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:37:36.801 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T23:37:36.801 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:37:36.801 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T23:37:36.802 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-23T23:37:36.802 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:37:36.812 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:36.824+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:36.828 INFO:tasks.ceph.osd.5:Stopped 2024-04-23T23:37:36.828 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2024-04-23T23:37:36.828 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:37:36.828 DEBUG:teuthology.orchestra.run.smithi170:> type ceph-objectstore-tool 2024-04-23T23:37:36.880 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:36.881 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:36.882 INFO:teuthology.orchestra.run.smithi170.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-23T23:37:36.882 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2024-04-23T23:37:36.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:36.895 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:36.896 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:36.913 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:36.925+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:36.914 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:36.915 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:36.932 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:36.932 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:36.949 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:36.949 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:36.967 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:36.967 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:36.995 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:36.995 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:36.995 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:36.995 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:37.014 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:37.025+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:37.115 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:37.127+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:37.146 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:37.147 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.155 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:37.239 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:37.251+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:37.297 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:37.297 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7 3.1a e23/21 3:5cea7035:::rbd_info:head v 23'1, mlcod=0'0)", 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5091993439999998, 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00076468599999999999, 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801028+0000", 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8799999999999999e-07 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801032+0000", 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2289999999999997e-06 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801042+0000", 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5729999999999997e-06 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801051+0000", 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3929999999999997e-06 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801085+0000", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4066999999999998e-05 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801106+0000", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0801e-05 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801756+0000", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00065014800000000002 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:37.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:32.801792+0000", 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6287e-05 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:9 3.1a e24/21 3:5cea7035:::rbd_info:head v 24'2, mlcod=0'0)", 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.5035873239999997, 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00066598099999999995, 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:37.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806640+0000", 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5899999999999998e-07 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806646+0000", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.677e-06 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806657+0000", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806668+0000", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0767e-05 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:37.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806713+0000", 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5049999999999997e-05 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.806728+0000", 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5378000000000001e-05 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.807263+0000", 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00053452000000000003 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:37.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.807306+0000", 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2704999999999999e-05 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:37.306 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:37.316 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:37.328+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:37.417 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:37.429+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:37.452 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:37.452 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:37.452 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:37.452 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:37.545 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:37.557+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:37.603 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:37.604 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:37.618 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:37.630+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:37.719 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:37.731+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:37.755 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:37.755 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:37.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:37.755 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:37:37.755 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:37.821 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:37.832+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:37.906 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:37.907 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:37.907 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:37.907 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:37.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:37.959 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:37.971+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:38.017 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:38.018 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:38.018 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:38.018 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:38.018 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:38.022 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:38.033+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:38.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.d 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.c 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.5 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.1d 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.1f 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.1c 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.17 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.16 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:3.2 2024-04-23T23:37:38.049 INFO:teuthology.orchestra.run.smithi170.stdout:2.2 2024-04-23T23:37:38.123 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:38.135+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:38.168 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:38.168 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:38.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:38.168 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:37:38.169 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:38.176 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:38.224 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:38.236+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:38.281 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:38.281 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:38.282 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:38.282 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:38.290 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:38.332 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:38.343+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:38.425 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:38.437+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:38.432 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:38.432 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:38.433 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:38.433 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:38.433 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:38.442 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:38.527 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:38.539+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:38.574 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op export --pgid 3.c --file /var/log/ceph/exp.3.c.5 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:7 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e23)", 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:32.798742+0000", 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.8002721800000003, 2024-04-23T23:37:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0032082780000000002, 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 7 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798742+0000", 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798742+0000", 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798744+0000", 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8300000000000001e-06 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798754+0000", 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8970000000000003e-06 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798770+0000", 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6203000000000001e-05 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798779+0000", 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9660000000000002e-06 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798828+0000", 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9289000000000002e-05 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op must wait for map", 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.798833+0000", 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3730000000000003e-06 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.800739+0000", 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019062739999999999 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.800825+0000", 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6118000000000005e-05 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.800913+0000", 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7878000000000001e-05 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801505+0000", 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00059266099999999997 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801897+0000", 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039121300000000001 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801925+0000", 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8322000000000001e-05 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801950+0000", 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5253999999999999e-05 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop_reply(client.4500.0:7 3.1a e23/21 ondisk, result = 0)", 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:32.801842+0000", 2024-04-23T23:37:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.7971722510000001, 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000115467, 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801842+0000", 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801842+0000", 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801843+0000", 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4300000000000003e-07 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801846+0000", 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7469999999999999e-06 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801854+0000", 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8630000000000008e-06 2024-04-23T23:37:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801861+0000", 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9650000000000002e-06 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801889+0000", 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8245000000000001e-05 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801894+0000", 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5179999999999998e-06 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:32.801957+0000", 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3485999999999995e-05 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:9 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:33.804189+0000", 2024-04-23T23:37:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7948254850000005, 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0033732459999999999, 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 9 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804189+0000", 2024-04-23T23:37:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804189+0000", 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804191+0000", 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2450000000000001e-06 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804200+0000", 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2890000000000003e-06 2024-04-23T23:37:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804221+0000", 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1246e-05 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804234+0000", 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2971e-05 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804327+0000", 2024-04-23T23:37:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2701000000000006e-05 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op must wait for map", 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.804332+0000", 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0139999999999998e-06 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.806317+0000", 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019847380000000002 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.806383+0000", 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6088999999999997e-05 2024-04-23T23:37:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.806499+0000", 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000116047 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807345+0000", 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00084571099999999997 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807500+0000", 2024-04-23T23:37:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015504900000000001 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807534+0000", 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4190999999999998e-05 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807562+0000", 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7954999999999999e-05 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop_reply(client.4500.0:9 3.1a e24/21 ondisk, result = 0)", 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:33.807413+0000", 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.791600753, 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015867, 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807413+0000", 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807413+0000", 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807414+0000", 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6000000000000002e-07 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807419+0000", 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807428+0000", 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9299999999999998e-06 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807441+0000", 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2833000000000001e-05 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807490+0000", 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.914e-05 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807496+0000", 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.665e-06 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.807572+0000", 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5969000000000004e-05 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop(client.4500.0:10 3.1c e24/21 3:3831950c:::rbd_directory:head v 24'1, mlcod=0'0)", 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:33.810706+0000", 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7883084470000004, 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079996500000000003, 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810706+0000", 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810706+0000", 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810706+0000", 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0100000000000001e-07 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810710+0000", 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2289999999999997e-06 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810722+0000", 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1362999999999999e-05 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810728+0000", 2024-04-23T23:37:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1940000000000003e-06 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810785+0000", 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7151999999999998e-05 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.810809+0000", 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4258000000000001e-05 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.811455+0000", 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064579800000000005 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.811506+0000", 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0769999999999997e-05 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop(client.4500.0:12 3.11 e24/21 3:8f04335d:::rbd_header.1194cc8350fc:head v 24'1, mlcod=0'0)", 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:33.826435+0000", 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7725794050000001, 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096848799999999999, 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826435+0000", 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826435+0000", 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826435+0000", 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3799999999999999e-07 2024-04-23T23:37:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826439+0000", 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826455+0000", 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5600999999999999e-05 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826475+0000", 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9590999999999999e-05 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826526+0000", 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1218000000000003e-05 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.826544+0000", 2024-04-23T23:37:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8442999999999999e-05 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.827351+0000", 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00080694800000000004 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.827403+0000", 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2079000000000001e-05 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:33.836147+0000", 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7628669959999996, 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000225205, 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836147+0000", 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836147+0000", 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836149+0000", 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.455e-06 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836155+0000", 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7440000000000001e-06 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836168+0000", 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2696e-05 2024-04-23T23:37:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836175+0000", 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9639999999999997e-06 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836226+0000", 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0881999999999998e-05 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836282+0000", 2024-04-23T23:37:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6391000000000003e-05 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.836372+0000", 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0073000000000003e-05 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop(client.4500.0:25 3.11 e24/21 3:8f04335d:::rbd_header.1194cc8350fc:head v 24'2, mlcod=0'0)", 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:33.837434+0000", 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7615803950000002, 2024-04-23T23:37:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00051235799999999998, 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837434+0000", 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837434+0000", 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837435+0000", 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1800000000000005e-07 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837441+0000", 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5749999999999997e-06 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837452+0000", 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1185999999999999e-05 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837460+0000", 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7870000000000002e-06 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837509+0000", 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999998e-05 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837530+0000", 2024-04-23T23:37:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0797000000000001e-05 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837909+0000", 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00037949400000000002 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:33.837946+0000", 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6801000000000002e-05 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:38.627 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:38.628 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:38.629 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:38.641+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:38.729 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:38.741+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:38.782 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:38.782 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:38.791 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:38.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:37:38.832 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:38.843+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:38.931 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:38.943+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:38.937 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:38.937 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:38.942 INFO:teuthology.orchestra.run.smithi077.stdout:287 read 0x69d49af thru 0x69dff72 (0xb5c4 bytes) 2024-04-23T23:37:38.943 INFO:teuthology.orchestra.run.smithi077.stdout:288 punch from 0x1032be8 to 0x104048c, (0xd8a4 bytes) 2024-04-23T23:37:38.949 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:38.953 INFO:teuthology.orchestra.run.smithi077.stdout:289 write 0x88058da thru 0x880bd77 (0x649e bytes) 2024-04-23T23:37:38.959 INFO:teuthology.orchestra.run.smithi077.stdout:290 read 0x71b2ef7 thru 0x71bee49 (0xbf53 bytes) 2024-04-23T23:37:38.960 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:38.963 INFO:teuthology.orchestra.run.smithi077.stdout:292 trunc from 0x880bd78 to 0x535ee12 2024-04-23T23:37:38.980 INFO:teuthology.orchestra.run.smithi077.stdout:293 read 0x11104df thru 0x111d1c8 (0xccea bytes) 2024-04-23T23:37:38.990 INFO:teuthology.orchestra.run.smithi077.stdout:295 write 0x8cbd6f7 thru 0x8cc66b1 (0x8fbb bytes) 2024-04-23T23:37:38.994 INFO:teuthology.orchestra.run.smithi077.stdout:296 trunc from 0x8cc66b2 to 0x6c29e5c 2024-04-23T23:37:39.004 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:39.019 INFO:teuthology.orchestra.run.smithi077.stdout:299 write 0xdb2f61a thru 0xdb37a2a (0x8411 bytes) 2024-04-23T23:37:39.023 INFO:teuthology.orchestra.run.smithi077.stdout:300 read 0xb54de9a thru 0xb55b02e (0xd195 bytes) 2024-04-23T23:37:39.023 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:39.024 INFO:teuthology.orchestra.run.smithi077.stdout:303 write 0xc44778c thru 0xc44bbea (0x445f bytes) 2024-04-23T23:37:39.025 INFO:teuthology.orchestra.run.smithi077.stdout:304 write 0x1a0eb18 thru 0x1a13c34 (0x511d bytes) 2024-04-23T23:37:39.029 INFO:teuthology.orchestra.run.smithi077.stdout:305 write 0xbde0cb0 thru 0xbde16eb (0xa3c bytes) 2024-04-23T23:37:39.031 INFO:teuthology.orchestra.run.smithi077.stdout:307 punch from 0x2b94b5d to 0x2b9ea23, (0x9ec6 bytes) 2024-04-23T23:37:39.031 INFO:teuthology.orchestra.run.smithi077.stdout:310 write 0x4e19852 thru 0x4e28089 (0xe838 bytes) 2024-04-23T23:37:39.032 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:39.032 INFO:teuthology.orchestra.run.smithi077.stdout:313 read 0x552ab01 thru 0x5535e06 (0xb306 bytes) 2024-04-23T23:37:39.033 INFO:teuthology.orchestra.run.smithi077.stdout:314 punch from 0x8e58ec8 to 0x8e61952, (0x8a8a bytes) 2024-04-23T23:37:39.033 INFO:teuthology.orchestra.run.smithi077.stdout:315 read 0x9221ccc thru 0x922fe90 (0xe1c5 bytes) 2024-04-23T23:37:39.033 INFO:teuthology.orchestra.run.smithi077.stdout:316 read 0x210167e thru 0x210cdd2 (0xb755 bytes) 2024-04-23T23:37:39.034 INFO:teuthology.orchestra.run.smithi077.stdout:317 read 0xaae4436 thru 0xaaebd50 (0x791b bytes) 2024-04-23T23:37:39.034 INFO:teuthology.orchestra.run.smithi077.stdout:318 read 0x2c5017e thru 0x2c5b1de (0xb061 bytes) 2024-04-23T23:37:39.034 INFO:teuthology.orchestra.run.smithi077.stdout:319 clone 2 order 19 su 16384 sc 14 2024-04-23T23:37:39.035 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:39.046+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:39.101 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:39.102 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:39.109 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:39.132 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:39.145+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:39.233 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:39.246+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:39.253 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:39.253 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:39.261 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:39.334 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:39.346+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:39.364 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:39.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:39.435 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:39.446+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:39.477 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:39.477 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:39.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:39.535 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:39.547+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:39.589 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:39.589 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:39.589 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:39.589 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:39.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:39.639 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:39.651+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:39.721 INFO:teuthology.orchestra.run.smithi170.stderr:Exporting 3.c info 3.c( v 24'6 (0'0,24'6] local-lis/les=21/22 n=0 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) 2024-04-23T23:37:39.726 INFO:teuthology.orchestra.run.smithi170.stderr:Export successful 2024-04-23T23:37:39.736 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:39.748+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:39.739 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:39.739 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:39.739 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:39.739 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:39.739 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:39.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:39.809 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:37:39.837 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:39.849+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:39.866 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone1 from 0xdb37a2b (overlap 0x535ee12) to 0x85649b 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:17 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'7, mlcod=16'5)", 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.234946+0000", 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.677092772000002, 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018680579999999999, 2024-04-23T23:37:39.901 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234946+0000", 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234946+0000", 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234947+0000", 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5460000000000001e-06 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.234959+0000", 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1094000000000001e-05 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235003+0000", 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4229e-05 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235018+0000", 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5109999999999999e-05 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235145+0000", 2024-04-23T23:37:39.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012705099999999999 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235164+0000", 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9245e-05 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.236753+0000", 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001589147 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.236814+0000", 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0636e-05 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:18 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'8, mlcod=16'5)", 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.235441+0000", 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.676597327, 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0041657949999999999, 2024-04-23T23:37:39.906 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235441+0000", 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235441+0000", 2024-04-23T23:37:39.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235442+0000", 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5799999999999998e-07 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235458+0000", 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6237000000000001e-05 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235471+0000", 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2975e-05 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235477+0000", 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6670000000000001e-06 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235547+0000", 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9660999999999996e-05 2024-04-23T23:37:39.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.235561+0000", 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4089e-05 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.239568+0000", 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040074739999999996 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.239607+0000", 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8933999999999997e-05 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:24 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'14, mlcod=16'12)", 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.664501972, 2024-04-23T23:37:39.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020998950000000001, 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247537+0000", 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.06e-07 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247542+0000", 2024-04-23T23:37:39.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2640000000000002e-06 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247553+0000", 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1226000000000001e-05 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247558+0000", 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5949999999999998e-06 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247609+0000", 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0562999999999997e-05 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.247625+0000", 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5594999999999999e-05 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.249604+0000", 2024-04-23T23:37:39.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019791349999999999 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.249637+0000", 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2910999999999997e-05 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.916 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:61 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'39, mlcod=16'37)", 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.633572163, 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002235791, 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278467+0000", 2024-04-23T23:37:39.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0900000000000001e-07 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278472+0000", 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278484+0000", 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1654999999999999e-05 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278490+0000", 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5230000000000003e-06 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278529+0000", 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9533000000000002e-05 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.278548+0000", 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8621e-05 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.280663+0000", 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002115661 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.280702+0000", 2024-04-23T23:37:39.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8899000000000001e-05 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:62 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'40, mlcod=16'38)", 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.281518+0000", 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.630520325999999, 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044233880000000003, 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.922 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281518+0000", 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281518+0000", 2024-04-23T23:37:39.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281519+0000", 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8100000000000002e-07 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281524+0000", 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1159999999999998e-06 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281536+0000", 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1477999999999999e-05 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281541+0000", 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.356e-06 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281582+0000", 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1208999999999998e-05 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.281601+0000", 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8788999999999999e-05 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.285898+0000", 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042973830000000001 2024-04-23T23:37:39.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.285942+0000", 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3375999999999999e-05 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:68 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'42, mlcod=16'39)", 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.623532218000001, 2024-04-23T23:37:39.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036867240000000002, 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288507+0000", 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.85e-07 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288519+0000", 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1651000000000001e-05 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288528+0000", 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4050000000000006e-06 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288533+0000", 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9139999999999999e-06 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288628+0000", 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4469000000000006e-05 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288654+0000", 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6299e-05 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.292159+0000", 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035049030000000002 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.292193+0000", 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4298000000000003e-05 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:69 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'43, mlcod=16'39)", 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.623083040000001, 2024-04-23T23:37:39.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0057969629999999996, 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.288956+0000", 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5799999999999999e-07 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289007+0000", 2024-04-23T23:37:39.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0630000000000001e-05 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289017+0000", 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9860000000000006e-06 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289024+0000", 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6490000000000002e-06 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289081+0000", 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7753000000000001e-05 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289096+0000", 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4171e-05 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.294711+0000", 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056157530000000002 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.294753+0000", 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1362999999999997e-05 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:70 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'44, mlcod=16'39)", 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.622440981, 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0054478469999999996, 2024-04-23T23:37:39.937 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289598+0000", 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8400000000000004e-07 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289604+0000", 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1019999999999996e-06 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289615+0000", 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1483e-05 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.289620+0000", 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2599999999999996e-06 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.291875+0000", 2024-04-23T23:37:39.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022550690000000002 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.291895+0000", 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9975000000000001e-05 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295014+0000", 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003118446 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295046+0000", 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1828000000000001e-05 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:71 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'45, mlcod=16'43)", 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.295666+0000", 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.616372468000002, 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022767799999999999, 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.942 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295666+0000", 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295666+0000", 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295667+0000", 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4399999999999999e-07 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295706+0000", 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8637000000000003e-05 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295717+0000", 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1858999999999999e-05 2024-04-23T23:37:39.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295727+0000", 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4849999999999998e-06 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295767+0000", 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9839999999999998e-05 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.295786+0000", 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9635000000000001e-05 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.297905+0000", 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021181310000000001 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.297943+0000", 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8448999999999997e-05 2024-04-23T23:37:39.946 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:72 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'46, mlcod=16'43)", 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.296092+0000", 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.615946312999998, 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021310650000000001, 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.947 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296092+0000", 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296092+0000", 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296093+0000", 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296157+0000", 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3571999999999994e-05 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296165+0000", 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.755e-06 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296171+0000", 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5419999999999996e-06 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296210+0000", 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9059e-05 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.296223+0000", 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.288e-05 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.298192+0000", 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001969232 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.298223+0000", 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1485000000000001e-05 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:76 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'50, mlcod=16'48)", 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.300212+0000", 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.611826518000001, 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022126120000000001, 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.953 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300212+0000", 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300212+0000", 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300213+0000", 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300217+0000", 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9949999999999999e-06 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300228+0000", 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1226000000000001e-05 2024-04-23T23:37:39.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300234+0000", 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5080000000000002e-06 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300272+0000", 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7555000000000002e-05 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.300286+0000", 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3974999999999999e-05 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.302391+0000", 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021054759999999998 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.302425+0000", 2024-04-23T23:37:39.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3349999999999997e-05 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:77 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'51, mlcod=16'49)", 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.303105+0000", 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.608933589999999, 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020249420000000001, 2024-04-23T23:37:39.958 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303105+0000", 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303105+0000", 2024-04-23T23:37:39.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303106+0000", 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303110+0000", 2024-04-23T23:37:39.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2629999999999997e-06 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303119+0000", 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5380000000000008e-06 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303125+0000", 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303168+0000", 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3108999999999997e-05 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.303188+0000", 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9964999999999999e-05 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.305096+0000", 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019072939999999999 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.305130+0000", 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4527000000000003e-05 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.963 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:139 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'97, mlcod=16'93)", 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.914937+0000", 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.997101280999999, 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0038834770000000002, 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914937+0000", 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914937+0000", 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914938+0000", 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4200000000000001e-07 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914941+0000", 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3569999999999998e-06 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914947+0000", 2024-04-23T23:37:39.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914951+0000", 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4599999999999999e-06 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.914986+0000", 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5862999999999999e-05 2024-04-23T23:37:39.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915005+0000", 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8692e-05 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918791+0000", 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037859479999999999 2024-04-23T23:37:39.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918821+0000", 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9887999999999999e-05 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:140 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'98, mlcod=16'93)", 2024-04-23T23:37:39.969 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.915369+0000", 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.996669426, 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039059189999999999, 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915369+0000", 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915369+0000", 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915370+0000", 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915430+0000", 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0736999999999998e-05 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915437+0000", 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4169999999999997e-06 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915441+0000", 2024-04-23T23:37:39.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7730000000000001e-06 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915472+0000", 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1201000000000002e-05 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.915487+0000", 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5384999999999999e-05 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919247+0000", 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037595250000000001 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919275+0000", 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8462999999999998e-05 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.974 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4201.0:141 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'99, mlcod=16'95)", 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.995887106000001, 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033747130000000001, 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916152+0000", 2024-04-23T23:37:39.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916156+0000", 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9720000000000003e-06 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916163+0000", 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3690000000000001e-06 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.916167+0000", 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.67e-06 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918850+0000", 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0026833349999999998 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.918864+0000", 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.341e-05 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919509+0000", 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000645478 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:18.919526+0000", 2024-04-23T23:37:39.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6969999999999998e-05 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:33.811915+0000", 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.1001237650000002, 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011546463999999999, 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.980 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 11 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.811915+0000", 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.981 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.811915+0000", 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.811917+0000", 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.795e-06 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.811927+0000", 2024-04-23T23:37:39.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0074999999999999e-05 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.811944+0000", 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7189000000000001e-05 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.811952+0000", 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0169999999999996e-06 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.983 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.812013+0000", 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0856999999999997e-05 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.812019+0000", 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.814222+0000", 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002203591 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.984 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.814368+0000", 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014592000000000001 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 5", 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.814566+0000", 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00019816699999999999 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.817514+0000", 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0029478019999999998 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.985 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.823387+0000", 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0058729689999999996 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.823432+0000", 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4920999999999999e-05 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.986 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.823461+0000", 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9436000000000001e-05 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop_reply(client.4500.0:11 3.1f e24/21 ondisk, result = 0)", 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:33.815443+0000", 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.0965956859999997, 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020773699999999998, 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.987 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.815443+0000", 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.815443+0000", 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.988 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.815444+0000", 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8100000000000002e-07 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.815448+0000", 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7120000000000002e-06 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.989 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.815457+0000", 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2979999999999997e-06 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.815463+0000", 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1340000000000001e-06 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.817504+0000", 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002040671 2024-04-23T23:37:39.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.817510+0000", 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5370000000000003e-06 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:33.817520+0000", 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0237e-05 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.991 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:711 3.6 3:64407af4:::rbd_object_map.1194cc8350fc.0000000000000003:head [writefull 0~42] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:38.823519+0000", 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.088519985, 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0027550819999999998, 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 711 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823519+0000", 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823519+0000", 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:39.993 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823520+0000", 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1009999999999999e-06 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823526+0000", 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5980000000000002e-06 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823537+0000", 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285000000000001e-05 2024-04-23T23:37:39.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823544+0000", 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2849999999999997e-06 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823589+0000", 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5092000000000001e-05 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:39.995 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823688+0000", 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9370999999999994e-05 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 1", 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.823775+0000", 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6774999999999995e-05 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.825237+0000", 2024-04-23T23:37:39.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014616550000000001 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.826210+0000", 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00097339099999999999 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.826245+0000", 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4326999999999998e-05 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.826274+0000", 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9201999999999999e-05 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:839 3.3 e27/21 3:c17c846b:::rbd_data.1194833257ef.0000000000000007:head v 27'9, mlcod=24'6)", 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:38.984811+0000", 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.92722765100000004, 2024-04-23T23:37:39.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0022148810000000001, 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984811+0000", 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:39.999 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984811+0000", 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984812+0000", 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984821+0000", 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6099999999999995e-06 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984832+0000", 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0562e-05 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984838+0000", 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4019999999999999e-06 2024-04-23T23:37:40.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984895+0000", 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.984916+0000", 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0835999999999998e-05 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.986989+0000", 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020729759999999998 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.987026+0000", 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7379000000000002e-05 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.003 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:840 3.b e27/21 3:d561a7b8:::rbd_data.1194833257ef.0000000000000001:head v 27'7, mlcod=24'5)", 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:38.985437+0000", 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.92660133499999997, 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001876129, 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985437+0000", 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985437+0000", 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985438+0000", 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985471+0000", 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3028000000000003e-05 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.006 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985481+0000", 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0243e-05 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985487+0000", 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985544+0000", 2024-04-23T23:37:40.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6400999999999998e-05 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.985562+0000", 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8641999999999999e-05 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.008 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.987290+0000", 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017276870000000001 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:38.987314+0000", 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3349999999999998e-05 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.009 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:40.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:40.012 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-04-23T23:37:40.012 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:40.023+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:40.065 INFO:teuthology.orchestra.run.smithi077.stdout:321 write 0x7eebc9f thru 0x7ef5d83 (0xa0e5 bytes) 2024-04-23T23:37:40.082 INFO:teuthology.orchestra.run.smithi077.stdout:323 writesame 0x2d2ac5e thru 0x2d341d1 data_size 0xa(0x9574 bytes) 2024-04-23T23:37:40.102 INFO:teuthology.orchestra.run.smithi077.stdout:324 punch from 0xc1866a9 to 0xc18d581, (0x6ed8 bytes) 2024-04-23T23:37:40.102 INFO:teuthology.orchestra.run.smithi077.stdout:325 write 0x10e31e7 thru 0x10ec90c (0x9726 bytes) 2024-04-23T23:37:40.112 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:40.124+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:40.118 INFO:teuthology.orchestra.run.smithi077.stdout:326 writesame 0x223d496 thru 0x224d256 data_size 0x13(0xfdc1 bytes) 2024-04-23T23:37:40.148 INFO:teuthology.orchestra.run.smithi077.stdout:327 write 0x4e2c4eb thru 0x4e393b6 (0xcecc bytes) 2024-04-23T23:37:40.173 INFO:teuthology.orchestra.run.smithi077.stdout:328 write 0xecfc917 thru 0xed01c1d (0x5307 bytes) 2024-04-23T23:37:40.178 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:40.179 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:40.180 INFO:teuthology.orchestra.run.smithi077.stdout:331 write 0xc266cfc thru 0xc2769a2 (0xfca7 bytes) 2024-04-23T23:37:40.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:40.201 INFO:teuthology.orchestra.run.smithi077.stdout:332 read 0x4200842 thru 0x4206603 (0x5dc2 bytes) 2024-04-23T23:37:40.202 INFO:teuthology.orchestra.run.smithi077.stdout:333 write 0xebd0dfa thru 0xebde841 (0xda48 bytes) 2024-04-23T23:37:40.210 INFO:teuthology.orchestra.run.smithi077.stdout:334 read 0x6d68d86 thru 0x6d6e62a (0x58a5 bytes) 2024-04-23T23:37:40.211 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.211 INFO:teuthology.orchestra.run.smithi077.stdout:338 write 0x2825652 thru 0x282e87e (0x922d bytes) 2024-04-23T23:37:40.212 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:40.224+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:40.227 INFO:teuthology.orchestra.run.smithi077.stdout:339 write 0x7f7a0ec thru 0x7f84669 (0xa57e bytes) 2024-04-23T23:37:40.243 INFO:teuthology.orchestra.run.smithi077.stdout:341 trunc from 0xed01c1e to 0xda9f64b 2024-04-23T23:37:40.251 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --force --op remove --pgid 3.c 2024-04-23T23:37:40.292 INFO:teuthology.orchestra.run.smithi077.stdout:342 write 0x1138b4d thru 0x113e4fe (0x59b2 bytes) 2024-04-23T23:37:40.302 INFO:teuthology.orchestra.run.smithi077.stdout:343 writesame 0x525f920 thru 0x526b44c data_size 0x1(0xbb2d bytes) 2024-04-23T23:37:40.313 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:40.325+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:40.319 INFO:teuthology.orchestra.run.smithi077.stdout:344 write 0x2c67d96 thru 0x2c6e5c9 (0x6834 bytes) 2024-04-23T23:37:40.330 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:40.330 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:40.330 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:40.330 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:40.330 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:40.337 INFO:teuthology.orchestra.run.smithi077.stdout:345 read 0x3a02bbb thru 0x3a0a4b1 (0x78f7 bytes) 2024-04-23T23:37:40.338 INFO:teuthology.orchestra.run.smithi077.stdout:347 read 0x6a2e07c thru 0x6a3d01b (0xefa0 bytes) 2024-04-23T23:37:40.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:40.340 INFO:teuthology.orchestra.run.smithi077.stdout:350 punch from 0xa6bd0b8 to 0xa6c519c, (0x80e4 bytes) 2024-04-23T23:37:40.340 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.340 INFO:teuthology.orchestra.run.smithi077.stdout:352 read 0x9188f6c thru 0x9195256 (0xc2eb bytes) 2024-04-23T23:37:40.341 INFO:teuthology.orchestra.run.smithi077.stdout:353 writesame 0x7fd3f51 thru 0x7fdf3a8 data_size 0x1d(0xb458 bytes) 2024-04-23T23:37:40.367 INFO:teuthology.orchestra.run.smithi077.stdout:354 trunc from 0xda9f64b to 0x17f7dea 2024-04-23T23:37:40.414 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:40.426+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:40.476 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:40.476 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:40.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:40.476 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1969 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20938752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.292044111, 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010883561, 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1969 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.477 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:40.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195332+0000", 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195335+0000", 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8990000000000001e-06 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195337+0000", 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3089999999999998e-06 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206119+0000", 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010781377 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206161+0000", 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2574999999999998e-05 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206214+0000", 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3273999999999998e-05 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1983 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 16826368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.292032766, 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010990613999999999, 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.481 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1983 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:40.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2499999999999999e-07 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195343+0000", 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0750000000000001e-06 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195347+0000", 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2279999999999998e-06 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195349+0000", 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3750000000000001e-06 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206239+0000", 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010889922 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206281+0000", 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2187000000000001e-05 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206333+0000", 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1601999999999998e-05 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1984 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17055744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29202288700000001, 2024-04-23T23:37:40.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011105459999999999, 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1984 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.41e-07 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195353+0000", 2024-04-23T23:37:40.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.540000000000001e-07 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195357+0000", 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5140000000000002e-06 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195360+0000", 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.653e-06 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.488 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206356+0000", 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010995823 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206394+0000", 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7790000000000002e-05 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206458+0000", 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3485000000000006e-05 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1985 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17285120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29200894500000002, 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011236217999999999, 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.490 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1985 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195368+0000", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7859999999999999e-06 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195374+0000", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1820000000000003e-06 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195386+0000", 2024-04-23T23:37:40.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1481000000000001e-05 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206487+0000", 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011101428 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206547+0000", 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9449e-05 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206602+0000", 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5408999999999998e-05 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1986 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17514496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.291982823, 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011350281, 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.494 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1986 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195394+0000", 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.759e-06 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195400+0000", 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9290000000000003e-06 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195404+0000", 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2899999999999996e-06 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206633+0000", 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011228804 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206692+0000", 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8556e-05 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206742+0000", 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0581999999999998e-05 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1987 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17743872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.291965007, 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011463825, 2024-04-23T23:37:40.498 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1987 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195412+0000", 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195418+0000", 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5979999999999996e-06 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195422+0000", 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4290000000000003e-06 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206767+0000", 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011344745 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206817+0000", 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9740000000000001e-05 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206874+0000", 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7138000000000001e-05 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.502 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1988 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17973248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29194712900000003, 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011660201, 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1988 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195430+0000", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195436+0000", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7350000000000001e-06 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195440+0000", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3059999999999999e-06 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206908+0000", 2024-04-23T23:37:40.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011467989 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206993+0000", 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4746999999999993e-05 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207088+0000", 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5391999999999997e-05 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1989 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18202624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.291929626, 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011792265999999999, 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1989 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195446+0000", 2024-04-23T23:37:40.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195447+0000", 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195453+0000", 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8830000000000003e-06 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195457+0000", 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0860000000000004e-06 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207122+0000", 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011664737 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207177+0000", 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4632000000000001e-05 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207238+0000", 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0859999999999997e-05 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29191045399999999, 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.511 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:37:40.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:40.515 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29188091900000002, 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:40.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:37:40.519 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29186114600000002, 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:37:40.520 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:37:40.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29184359999999998, 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:37:40.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:37:40.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29182608999999998, 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:37:40.529 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:37:40.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.533 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.291785552, 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:37:40.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29177198700000001, 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.538 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:37:40.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:37:40.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29176238900000001, 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.542 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:37:40.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:37:40.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29175182700000002, 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:37:40.546 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.550 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29174251000000001, 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:40.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:37:40.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.554 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29173332200000002, 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:40.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:37:40.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:37:40.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29171875000000003, 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:40.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:37:40.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:37:40.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.563 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:40.564 INFO:teuthology.orchestra.run.smithi077.stdout:355 read 0xa1f7b8 thru 0xa2668a (0x6ed3 bytes) 2024-04-23T23:37:40.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:357 write 0xa7aca48 thru 0xa7af2a0 (0x2859 bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:359 write 0x4a5c5b8 thru 0x4a620f8 (0x5b41 bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:360 read 0xa1eb9e0 thru 0xa1f6275 (0xa896 bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:361 read 0x66bb780 thru 0x66c8edb (0xd75c bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:362 read 0x9a2ae5b thru 0x9a300d4 (0x527a bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:364 write 0xcd32ec3 thru 0xcd3bc46 (0x8d84 bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:365 writesame 0x5b12daf thru 0x5b1691a data_size 0x2(0x3b6c bytes) 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:366 trunc from 0xcd3bc47 to 0xac42a56 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:367 trunc from 0xac42a56 to 0xd18430a 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:368 trunc from 0xd18430a to 0x91f0f72 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.567 INFO:teuthology.orchestra.run.smithi077.stdout:372 trunc from 0x91f0f72 to 0x7dfd9fd 2024-04-23T23:37:40.568 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:40.576+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:40.568 INFO:teuthology.orchestra.run.smithi077.stdout:373 write 0x134ece0 thru 0x1350c06 (0x1f27 bytes) 2024-04-23T23:37:40.570 INFO:teuthology.orchestra.run.smithi077.stdout:374 read 0x214a63f thru 0x21546cf (0xa091 bytes) 2024-04-23T23:37:40.571 INFO:teuthology.orchestra.run.smithi077.stdout:375 read 0x243eace thru 0x2440992 (0x1ec5 bytes) 2024-04-23T23:37:40.571 INFO:teuthology.orchestra.run.smithi077.stdout:376 read 0x553a087 thru 0x554937d (0xf2f7 bytes) 2024-04-23T23:37:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:377 writesame 0xd023c80 thru 0xd0263d1 data_size 0x7(0x2752 bytes) 2024-04-23T23:37:40.581 INFO:teuthology.orchestra.run.smithi077.stdout:378 write 0xa21b12d thru 0xa223aec (0x89c0 bytes) 2024-04-23T23:37:40.591 INFO:teuthology.orchestra.run.smithi077.stdout:379 write 0x55f85ff thru 0x5604b46 (0xc548 bytes) 2024-04-23T23:37:40.599 INFO:teuthology.orchestra.run.smithi077.stdout:382 read 0xa2aeec thru 0xa37501 (0xc616 bytes) 2024-04-23T23:37:40.599 INFO:teuthology.orchestra.run.smithi077.stdout:383 writesame 0xbd68d06 thru 0xbd7787d data_size 0x89(0xeb78 bytes) 2024-04-23T23:37:40.605 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.605 INFO:teuthology.orchestra.run.smithi077.stdout:388 write 0xb86c397 thru 0xb8727bf (0x6429 bytes) 2024-04-23T23:37:40.608 INFO:teuthology.orchestra.run.smithi077.stdout:389 write 0x6d3785e thru 0x6d3c529 (0x4ccc bytes) 2024-04-23T23:37:40.617 INFO:teuthology.orchestra.run.smithi077.stdout:390 write 0xd9c1a7d thru 0xd9cc37d (0xa901 bytes) 2024-04-23T23:37:40.624 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.631 INFO:teuthology.orchestra.run.smithi077.stdout:392 write 0xe5d07b7 thru 0xe5db414 (0xac5e bytes) 2024-04-23T23:37:40.650 INFO:teuthology.orchestra.run.smithi077.stdout:393 trunc from 0xe5db415 to 0x2bba22a 2024-04-23T23:37:40.665 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:40.677+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:40.677 INFO:teuthology.orchestra.run.smithi077.stdout:394 writesame 0x3990991 thru 0x399b2dd data_size 0x1(0xa94d bytes) 2024-04-23T23:37:40.677 INFO:teuthology.orchestra.run.smithi077.stdout:395 read 0x232dd49 thru 0x2337ed2 (0xa18a bytes) 2024-04-23T23:37:40.677 INFO:teuthology.orchestra.run.smithi077.stdout:397 read 0x23ed1b9 thru 0x23f472a (0x7572 bytes) 2024-04-23T23:37:40.677 INFO:teuthology.orchestra.run.smithi077.stdout:399 writesame 0x2f05b25 thru 0x2f11055 data_size 0x1(0xb531 bytes) 2024-04-23T23:37:40.692 INFO:teuthology.orchestra.run.smithi077.stdout:401 write 0xa2cf1a thru 0xa31861 (0x4948 bytes) 2024-04-23T23:37:40.693 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:40.693 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:40.693 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:40.693 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:40.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:40.704 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.712 INFO:teuthology.orchestra.run.smithi077.stdout:405 writesame 0x5f486dc thru 0x5f4da94 data_size 0x1(0x53b9 bytes) 2024-04-23T23:37:40.712 INFO:teuthology.orchestra.run.smithi077.stdout:406 write 0x2d82bce thru 0x2d923bf (0xf7f2 bytes) 2024-04-23T23:37:40.720 INFO:teuthology.orchestra.run.smithi077.stdout:407 read 0x3a4b7d2 thru 0x3a51bc5 (0x63f4 bytes) 2024-04-23T23:37:40.720 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.720 INFO:teuthology.orchestra.run.smithi077.stdout:409 punch from 0x44d608c to 0x44e5583, (0xf4f7 bytes) 2024-04-23T23:37:40.731 INFO:teuthology.orchestra.run.smithi077.stdout:410 write 0xb3c16c9 thru 0xb3c7eec (0x6824 bytes) 2024-04-23T23:37:40.742 INFO:teuthology.orchestra.run.smithi077.stdout:412 trunc from 0xb3c7eed to 0x62d15d1 2024-04-23T23:37:40.761 INFO:teuthology.orchestra.run.smithi077.stdout:413 write 0xa9da0d0 thru 0xa9e479b (0xa6cc bytes) 2024-04-23T23:37:40.766 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:40.778+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:40.767 INFO:teuthology.orchestra.run.smithi077.stdout:414 read 0x7eb6273 thru 0x7eb9cc8 (0x3a56 bytes) 2024-04-23T23:37:40.767 INFO:teuthology.orchestra.run.smithi077.stdout:416 punch from 0x191d0cf to 0x19215ae, (0x44df bytes) 2024-04-23T23:37:40.767 INFO:teuthology.orchestra.run.smithi077.stdout:417 punch from 0x86c1e77 to 0x86c896a, (0x6af3 bytes) 2024-04-23T23:37:40.767 INFO:teuthology.orchestra.run.smithi077.stdout:418 writesame 0x8f65dce thru 0x8f6990f data_size 0x29(0x3b42 bytes) 2024-04-23T23:37:40.770 INFO:teuthology.orchestra.run.smithi077.stdout:419 read 0x1fd0ca thru 0x1fec14 (0x1b4b bytes) 2024-04-23T23:37:40.771 INFO:teuthology.orchestra.run.smithi077.stdout:421 write 0xa348e86 thru 0xa352c0c (0x9d87 bytes) 2024-04-23T23:37:40.777 INFO:teuthology.orchestra.run.smithi077.stdout:422 read 0x659f48 thru 0x65a65d (0x716 bytes) 2024-04-23T23:37:40.777 INFO:teuthology.orchestra.run.smithi077.stdout:423 write 0x977b597 thru 0x97835d0 (0x803a bytes) 2024-04-23T23:37:40.782 INFO:teuthology.orchestra.run.smithi077.stdout:424 read 0x31a0714 thru 0x31a3442 (0x2d2f bytes) 2024-04-23T23:37:40.782 INFO:teuthology.orchestra.run.smithi077.stdout:425 punch from 0x25ae88 to 0x261937, (0x6aaf bytes) 2024-04-23T23:37:40.782 INFO:teuthology.orchestra.run.smithi077.stdout:427 write 0x456662b thru 0x45697bb (0x3191 bytes) 2024-04-23T23:37:40.795 INFO:teuthology.orchestra.run.smithi077.stdout:428 writesame 0xe1f6a5c thru 0xe2037b6 data_size 0x1(0xcd5b bytes) 2024-04-23T23:37:40.795 INFO:teuthology.orchestra.run.smithi077.stdout:429 read 0x8b44724 thru 0x8b4667f (0x1f5c bytes) 2024-04-23T23:37:40.795 INFO:teuthology.orchestra.run.smithi077.stdout:430 punch from 0x5ad3943 to 0x5adc886, (0x8f43 bytes) 2024-04-23T23:37:40.795 INFO:teuthology.orchestra.run.smithi077.stdout:431 read 0xc8bce5a thru 0xc8c95db (0xc782 bytes) 2024-04-23T23:37:40.795 INFO:teuthology.orchestra.run.smithi077.stdout:432 write 0xd142400 thru 0xd14a97d (0x857e bytes) 2024-04-23T23:37:40.799 INFO:teuthology.orchestra.run.smithi077.stdout:433 punch from 0x7c9b84 to 0x7d0df4, (0x7270 bytes) 2024-04-23T23:37:40.799 INFO:teuthology.orchestra.run.smithi077.stdout:434 write 0x19358a9 thru 0x1940759 (0xaeb1 bytes) 2024-04-23T23:37:40.805 INFO:teuthology.orchestra.run.smithi077.stdout:435 trunc from 0xe2037b7 to 0xaccdfef 2024-04-23T23:37:40.825 INFO:teuthology.orchestra.run.smithi077.stdout:436 writesame 0xd6fe36b thru 0xd70479c data_size 0x13(0x6432 bytes) 2024-04-23T23:37:40.826 INFO:teuthology.orchestra.run.smithi077.stdout:438 trunc from 0xd70479d to 0xe1c1cc7 2024-04-23T23:37:40.826 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:40.827 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:40.827 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:40.827 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:40.827 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:40.831 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:40.842 INFO:teuthology.orchestra.run.smithi077.stdout:440 trunc from 0xe1c1cc7 to 0x4ac0c36 2024-04-23T23:37:40.858 INFO:teuthology.orchestra.run.smithi077.stdout:442 trunc from 0x4ac0c36 to 0x9e8e505 2024-04-23T23:37:40.863 INFO:teuthology.orchestra.run.smithi077.stdout:443 writesame 0x59ae339 thru 0x59afadd data_size 0x1(0x17a5 bytes) 2024-04-23T23:37:40.867 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:40.879+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:40.868 INFO:teuthology.orchestra.run.smithi077.stdout:445 read 0x4c623f8 thru 0x4c71fd0 (0xfbd9 bytes) 2024-04-23T23:37:40.868 INFO:teuthology.orchestra.run.smithi077.stdout:447 writesame 0x6654138 thru 0x6661474 data_size 0x1(0xd33d bytes) 2024-04-23T23:37:40.881 INFO:teuthology.orchestra.run.smithi077.stdout:448 read 0x7df22c4 thru 0x7e013c2 (0xf0ff bytes) 2024-04-23T23:37:40.882 INFO:teuthology.orchestra.run.smithi077.stdout:449 write 0x3d557be thru 0x3d5dab2 (0x82f5 bytes) 2024-04-23T23:37:40.893 INFO:teuthology.orchestra.run.smithi077.stdout:450 write 0xae0d100 thru 0xae1957f (0xc480 bytes) 2024-04-23T23:37:40.899 INFO:teuthology.orchestra.run.smithi077.stdout:452 read 0x2c9f85c thru 0x2ca4e05 (0x55aa bytes) 2024-04-23T23:37:40.900 INFO:teuthology.orchestra.run.smithi077.stdout:453 read 0xac8be00 thru 0xac9b3b4 (0xf5b5 bytes) 2024-04-23T23:37:40.900 INFO:teuthology.orchestra.run.smithi077.stdout:454 write 0x7d8927b thru 0x7d97b49 (0xe8cf bytes) 2024-04-23T23:37:40.905 INFO:teuthology.orchestra.run.smithi077.stdout:455 read 0x61de670 thru 0x61e513b (0x6acc bytes) 2024-04-23T23:37:40.905 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.905 INFO:teuthology.orchestra.run.smithi077.stdout:458 write 0x90c5ed thru 0x90d30d (0xd21 bytes) 2024-04-23T23:37:40.913 INFO:teuthology.orchestra.run.smithi077.stdout:459 read 0x709baa1 thru 0x70aa29a (0xe7fa bytes) 2024-04-23T23:37:40.913 INFO:teuthology.orchestra.run.smithi077.stdout:460 writesame 0xaa8d1bc thru 0xaa93c97 data_size 0xe(0x6adc bytes) 2024-04-23T23:37:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:462 read 0x229b073 thru 0x229d075 (0x2003 bytes) 2024-04-23T23:37:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:463 write 0x619c87f thru 0x61ac3d7 (0xfb59 bytes) 2024-04-23T23:37:40.927 INFO:teuthology.orchestra.run.smithi077.stdout:464 write 0xa9ea89c thru 0xa9f768a (0xcdef bytes) 2024-04-23T23:37:40.930 INFO:teuthology.orchestra.run.smithi077.stdout:466 read 0x2db8e00 thru 0x2dbf784 (0x6985 bytes) 2024-04-23T23:37:40.938 INFO:teuthology.orchestra.run.smithi077.stdout:468 trunc from 0xae19580 to 0x46fadc0 2024-04-23T23:37:40.952 INFO:teuthology.orchestra.run.smithi077.stdout:469 write 0x4474b1c thru 0x44790cb (0x45b0 bytes) 2024-04-23T23:37:40.957 INFO:teuthology.orchestra.run.smithi077.stdout:470 punch from 0x96d1f9 to 0x97add8, (0xdbdf bytes) 2024-04-23T23:37:40.962 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:40.962 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:40.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:950 3.0 e28/21 3:04479396:::rbd_id.image_client.0-clone2:head v 28'5, mlcod=24'3)", 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:39.854045+0000", 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.119090951, 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00083679499999999999, 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854045+0000", 2024-04-23T23:37:40.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854045+0000", 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854046+0000", 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.381e-06 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854058+0000", 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1776e-05 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854076+0000", 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8241999999999999e-05 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854087+0000", 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0441999999999999e-05 2024-04-23T23:37:40.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854151+0000", 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3954000000000005e-05 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854171+0000", 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0503999999999999e-05 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854835+0000", 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00066408899999999998 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:39.854882+0000", 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6406999999999998e-05 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2770 3.0 e28/21 3:04638217:::rbd_data.1194137ed5d1.0000000000000103:head v 28'8, mlcod=28'6)", 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:40.967 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.61116055899999999, 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033753899999999998, 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361977+0000", 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.167e-06 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361992+0000", 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5685999999999999e-05 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362007+0000", 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4269e-05 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362015+0000", 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362070+0000", 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4750999999999998e-05 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362095+0000", 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4822999999999999e-05 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365317+0000", 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032223009999999999 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365351+0000", 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4029999999999998e-05 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2784 3.0 e28/21 3:05ebc6bc:::rbd_data.1194137ed5d1.000000000000005c:head v 28'9, mlcod=28'7)", 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.58905451200000003, 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031924290000000001, 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.972 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384083+0000", 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5510000000000001e-06 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384091+0000", 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.038e-06 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384108+0000", 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6833999999999998e-05 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384117+0000", 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.833e-06 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384190+0000", 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3208999999999997e-05 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384221+0000", 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1223000000000002e-05 2024-04-23T23:37:40.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.387229+0000", 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003008176 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.387274+0000", 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4564999999999998e-05 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2798 3.0 e28/21 3:04638217:::rbd_data.1194137ed5d1.0000000000000103:head v 28'10, mlcod=28'8)", 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.390665+0000", 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.58247147099999996, 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024500329999999999, 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390665+0000", 2024-04-23T23:37:40.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390665+0000", 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390666+0000", 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8899999999999998e-07 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390675+0000", 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9670000000000007e-06 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390689+0000", 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.446e-05 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390696+0000", 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390747+0000", 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0528999999999997e-05 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.390767+0000", 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0458999999999998e-05 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.393069+0000", 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0023014960000000001 2024-04-23T23:37:40.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.393115+0000", 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6010999999999997e-05 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2807 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'5, mlcod=28'3)", 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.58165283000000001, 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044721090000000002, 2024-04-23T23:37:40.981 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391484+0000", 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5199999999999996e-07 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391489+0000", 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.983 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391499+0000", 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9450000000000005e-06 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391505+0000", 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.331e-06 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391560+0000", 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5250000000000001e-05 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391579+0000", 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9049e-05 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395910+0000", 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043312419999999999 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395955+0000", 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4907000000000002e-05 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.985 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2816 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'11, mlcod=28'9)", 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.397782+0000", 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.57535371099999999, 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00089405300000000001, 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.986 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397782+0000", 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397782+0000", 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397783+0000", 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7300000000000005e-07 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.987 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397790+0000", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8059999999999997e-06 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397801+0000", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1449e-05 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397813+0000", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1613999999999999e-05 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397870+0000", 2024-04-23T23:37:40.988 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6922999999999997e-05 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.397886+0000", 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5713999999999999e-05 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.398633+0000", 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00074697200000000004 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.989 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.398676+0000", 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3801999999999998e-05 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3424 3.0 e28/21 3:079ae216:::rbd_data.1194137ed5d1.000000000000017a:head v 28'13, mlcod=28'11)", 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.615917+0000", 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.35721899200000001, 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014568129999999999, 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.990 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.615917+0000", 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.615917+0000", 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.991 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.615918+0000", 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.097e-06 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.615937+0000", 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8647999999999998e-05 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.615951+0000", 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.437e-05 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.992 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.615959+0000", 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1790000000000008e-06 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.616029+0000", 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9579000000000006e-05 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.616054+0000", 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5151e-05 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.993 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.617327+0000", 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0012734300000000001 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.617374+0000", 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6359000000000001e-05 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3435 3.4 e28/21 3:25c6761d:::rbd_data.1194137ed5d1.00000000000000d5:head v 28'7, mlcod=28'5)", 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.623410+0000", 2024-04-23T23:37:40.994 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.34972609900000001, 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00082312399999999995, 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623410+0000", 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623410+0000", 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:40.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623411+0000", 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0780000000000001e-06 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623420+0000", 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3319999999999998e-06 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623438+0000", 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8059000000000001e-05 2024-04-23T23:37:40.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623446+0000", 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5610000000000001e-06 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623503+0000", 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7414999999999998e-05 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.623528+0000", 2024-04-23T23:37:40.997 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4811999999999999e-05 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.624201+0000", 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00067233699999999996 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.624233+0000", 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2530000000000002e-05 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:40.998 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3453 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'14, mlcod=28'12)", 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.635206+0000", 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.33792966400000002, 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0023049809999999998, 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635206+0000", 2024-04-23T23:37:40.999 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635206+0000", 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635208+0000", 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.209e-06 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635224+0000", 2024-04-23T23:37:41.000 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6752000000000002e-05 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635244+0000", 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9395e-05 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635253+0000", 2024-04-23T23:37:41.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5789999999999993e-06 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635321+0000", 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8122999999999998e-05 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.635346+0000", 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4457999999999999e-05 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.637469+0000", 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002123373 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.637511+0000", 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2092000000000003e-05 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.003 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3468 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'10, mlcod=24'8)", 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.648234+0000", 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.32490181099999998, 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00082957500000000004, 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648234+0000", 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648234+0000", 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648235+0000", 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.071e-06 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648274+0000", 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8600999999999999e-05 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648288+0000", 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4107000000000001e-05 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648295+0000", 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6619999999999999e-06 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648340+0000", 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5748000000000003e-05 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.648357+0000", 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6371e-05 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.649036+0000", 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00067955700000000001 2024-04-23T23:37:41.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.649064+0000", 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7458e-05 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3479 3.4 e28/21 3:25c6761d:::rbd_data.1194137ed5d1.00000000000000d5:head v 28'8, mlcod=28'6)", 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.666145+0000", 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.30699091099999998, 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084730999999999999, 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.008 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666145+0000", 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666145+0000", 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.009 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666146+0000", 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2049999999999999e-06 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666155+0000", 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8060000000000001e-06 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666175+0000", 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9422000000000001e-05 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.010 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666185+0000", 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0641e-05 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666269+0000", 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3879000000000001e-05 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666293+0000", 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4281e-05 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.011 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666944+0000", 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00065037199999999997 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.666992+0000", 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8704e-05 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3487 3.0 e28/21 3:079ae216:::rbd_data.1194137ed5d1.000000000000017a:head v 28'15, mlcod=28'13)", 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.668751+0000", 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.30438490299999998, 2024-04-23T23:37:41.012 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011559980000000001, 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668751+0000", 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.013 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668751+0000", 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668752+0000", 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7499999999999999e-07 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668758+0000", 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2589999999999997e-06 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668772+0000", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3882e-05 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668779+0000", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.277e-06 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668832+0000", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3183999999999998e-05 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.015 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.668855+0000", 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2337e-05 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669871+0000", 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010166140000000001 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669907+0000", 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5670000000000002e-05 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.016 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3490 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'9, mlcod=28'7)", 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.30386076499999998, 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0028448990000000001, 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669276+0000", 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6199999999999998e-07 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669282+0000", 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7690000000000002e-06 2024-04-23T23:37:41.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669294+0000", 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1949e-05 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669300+0000", 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3060000000000003e-06 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669349+0000", 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9555000000000002e-05 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.019 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669367+0000", 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7965000000000002e-05 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.672090+0000", 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0027230829999999998 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.672120+0000", 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9709999999999998e-05 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3493 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'16, mlcod=28'13)", 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.303038908, 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047633190000000002, 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670098+0000", 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670103+0000", 2024-04-23T23:37:41.022 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670115+0000", 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.221e-05 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670126+0000", 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0216e-05 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670172+0000", 2024-04-23T23:37:41.023 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699000000000001e-05 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670190+0000", 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8074999999999999e-05 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674821+0000", 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046309300000000001 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.024 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674860+0000", 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9104999999999999e-05 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3496 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'11, mlcod=24'9)", 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.30264826, 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043762560000000002, 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.025 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:41.026 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3399999999999998e-07 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670495+0000", 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2349999999999996e-06 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670507+0000", 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2183e-05 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670515+0000", 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0369999999999995e-06 2024-04-23T23:37:41.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670573+0000", 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8009e-05 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670594+0000", 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0545000000000001e-05 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674832+0000", 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004238192 2024-04-23T23:37:41.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674864+0000", 2024-04-23T23:37:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2320999999999998e-05 2024-04-23T23:37:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.029 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.030 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.030 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.030 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.030 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3608 3.4 e28/21 3:21d47454:::rbd_data.1194137ed5d1.0000000000000058:head v 28'10, mlcod=28'8)", 2024-04-23T23:37:41.030 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.730556+0000", 2024-04-23T23:37:41.030 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.24257973799999999, 2024-04-23T23:37:41.031 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021314699999999999, 2024-04-23T23:37:41.031 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.031 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.031 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.031 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.032 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.032 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730556+0000", 2024-04-23T23:37:41.032 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.033 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.033 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730556+0000", 2024-04-23T23:37:41.033 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.033 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.033 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730558+0000", 2024-04-23T23:37:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2249999999999999e-06 2024-04-23T23:37:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.034 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.035 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730574+0000", 2024-04-23T23:37:41.035 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6643999999999999e-05 2024-04-23T23:37:41.035 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.035 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.035 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.035 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730593+0000", 2024-04-23T23:37:41.036 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8397999999999999e-05 2024-04-23T23:37:41.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.036 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.036 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.036 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730601+0000", 2024-04-23T23:37:41.036 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7660000000000004e-06 2024-04-23T23:37:41.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.037 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.037 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.037 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730666+0000", 2024-04-23T23:37:41.037 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4739000000000005e-05 2024-04-23T23:37:41.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.730691+0000", 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5191e-05 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.038 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.039 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.732656+0000", 2024-04-23T23:37:41.039 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001964829 2024-04-23T23:37:41.039 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.039 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.039 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.039 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.732688+0000", 2024-04-23T23:37:41.040 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1677999999999997e-05 2024-04-23T23:37:41.040 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.040 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.040 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.040 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.040 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.041 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3621 3.0 e28/21 3:031bcd6d:::rbd_data.1194137ed5d1.0000000000000169:head v 28'17, mlcod=28'15)", 2024-04-23T23:37:41.041 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.746836+0000", 2024-04-23T23:37:41.041 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.22629998500000001, 2024-04-23T23:37:41.041 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0021719769999999998, 2024-04-23T23:37:41.041 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.041 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.042 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.042 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.042 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.042 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.042 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746836+0000", 2024-04-23T23:37:41.043 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.043 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.043 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.043 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.043 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746836+0000", 2024-04-23T23:37:41.043 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746838+0000", 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5990000000000001e-06 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.044 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.045 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.045 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746867+0000", 2024-04-23T23:37:41.045 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8917000000000001e-05 2024-04-23T23:37:41.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.045 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.046 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.046 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746883+0000", 2024-04-23T23:37:41.046 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6439999999999998e-05 2024-04-23T23:37:41.046 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.046 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.046 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.047 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746892+0000", 2024-04-23T23:37:41.047 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2119999999999992e-06 2024-04-23T23:37:41.047 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.047 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.047 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.047 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746948+0000", 2024-04-23T23:37:41.048 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5424000000000003e-05 2024-04-23T23:37:41.048 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.048 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.048 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.048 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.746977+0000", 2024-04-23T23:37:41.048 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9164999999999999e-05 2024-04-23T23:37:41.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.049 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.049 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.049 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.748956+0000", 2024-04-23T23:37:41.049 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001979401 2024-04-23T23:37:41.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.050 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.050 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.050 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.749008+0000", 2024-04-23T23:37:41.050 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819e-05 2024-04-23T23:37:41.050 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.050 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3688 3.9 e28/21 3:9105c076:::rbd_data.1194137ed5d1.00000000000001a0:head v 28'12, mlcod=28'10)", 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.810867+0000", 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.162269371, 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000860332, 2024-04-23T23:37:41.051 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810867+0000", 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810867+0000", 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810868+0000", 2024-04-23T23:37:41.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8800000000000001e-07 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810902+0000", 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4406999999999998e-05 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810917+0000", 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5007999999999999e-05 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810926+0000", 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9109999999999999e-06 2024-04-23T23:37:41.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.810991+0000", 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4855000000000002e-05 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.811013+0000", 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2212999999999999e-05 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.811695+0000", 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00068166799999999997 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.811727+0000", 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2382000000000003e-05 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3696 3.9 e28/21 3:9105c076:::rbd_data.1194137ed5d1.00000000000001a0:head v 28'13, mlcod=28'11)", 2024-04-23T23:37:41.057 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.820679+0000", 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.152457023, 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00092133799999999995, 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820679+0000", 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820679+0000", 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820680+0000", 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2410000000000001e-06 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820689+0000", 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7970000000000006e-06 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820709+0000", 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9474e-05 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820717+0000", 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6680000000000007e-06 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820785+0000", 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7620999999999995e-05 2024-04-23T23:37:41.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.820806+0000", 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0958000000000002e-05 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.821557+0000", 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00075149799999999997 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.821600+0000", 2024-04-23T23:37:41.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3081000000000003e-05 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3700 3.4 e28/21 3:24fa3e4c:::rbd_data.1194137ed5d1.0000000000000158:head v 28'12, mlcod=28'10)", 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.823913+0000", 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.14922318800000001, 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001032767, 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.062 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.823913+0000", 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.823913+0000", 2024-04-23T23:37:41.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.823914+0000", 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5499999999999996e-07 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.823922+0000", 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7729999999999999e-06 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.823939+0000", 2024-04-23T23:37:41.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7496e-05 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.823947+0000", 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2959999999999999e-06 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.824022+0000", 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5043000000000006e-05 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.824052+0000", 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9201e-05 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.824900+0000", 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084870599999999996 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.824946+0000", 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5296999999999997e-05 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.067 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:41.068 INFO:teuthology.orchestra.run.smithi077.stdout:471 write 0x610ba23 thru 0x610d67d (0x1c5b bytes) 2024-04-23T23:37:41.068 INFO:teuthology.orchestra.run.smithi077.stdout:472 write 0xb0b579 thru 0xb187ec (0xd274 bytes) 2024-04-23T23:37:41.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:41.071 INFO:teuthology.orchestra.run.smithi077.stdout:473 read 0x560223d thru 0x56073c6 (0x518a bytes) 2024-04-23T23:37:41.071 INFO:teuthology.orchestra.run.smithi077.stdout:474 write 0x9b500c4 thru 0x9b565d1 (0x650e bytes) 2024-04-23T23:37:41.071 INFO:teuthology.orchestra.run.smithi077.stdout:476 trunc from 0x9b565d2 to 0x6ea4da6 2024-04-23T23:37:41.071 INFO:teuthology.orchestra.run.smithi077.stdout:478 write 0x8618201 thru 0x86242d5 (0xc0d5 bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:479 trunc from 0x86242d6 to 0x9ab7159 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:482 read 0x6ae2f21 thru 0x6af29f1 (0xfad1 bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:483 writesame 0x91bfce5 thru 0x91ce2fd data_size 0x15(0xe619 bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:486 writesame 0x239322b thru 0x239344c data_size 0x3(0x222 bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:487 writesame 0xd49e1ab thru 0xd4a094a data_size 0x10(0x27a0 bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:488 write 0x849e9ab thru 0x84a0f6a (0x25c0 bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:489 read 0xa392f1f thru 0xa39ace8 (0x7dca bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:491 write 0xbf5bc29 thru 0xbf5d0b3 (0x148b bytes) 2024-04-23T23:37:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:493 flatten 2024-04-23T23:37:41.072 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:41.080+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:41.169 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:41.180+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:41.181 INFO:teuthology.orchestra.run.smithi077.stdout:494 writesame 0x37a9025 thru 0x37abe3b data_size 0x1b(0x2e17 bytes) 2024-04-23T23:37:41.184 INFO:teuthology.orchestra.run.smithi077.stdout:495 punch from 0xbc2ad45 to 0xbc3a9ce, (0xfc89 bytes) 2024-04-23T23:37:41.184 INFO:teuthology.orchestra.run.smithi077.stdout:497 read 0x425eddb thru 0x4269a46 (0xac6c bytes) 2024-04-23T23:37:41.184 INFO:teuthology.orchestra.run.smithi077.stdout:499 read 0x3e3e842 thru 0x3e4afdc (0xc79b bytes) 2024-04-23T23:37:41.185 INFO:teuthology.orchestra.run.smithi077.stdout:500 write 0x94a6120 thru 0x94ae0ea (0x7fcb bytes) 2024-04-23T23:37:41.189 INFO:teuthology.orchestra.run.smithi077.stdout:502 write 0xc2bc1d8 thru 0xc2bc72c (0x555 bytes) 2024-04-23T23:37:41.192 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.192 INFO:teuthology.orchestra.run.smithi077.stdout:504 punch from 0x6250090 to 0x625e810, (0xe780 bytes) 2024-04-23T23:37:41.192 INFO:teuthology.orchestra.run.smithi077.stdout:505 read 0xe33ad8 thru 0xe3ea6f (0xaf98 bytes) 2024-04-23T23:37:41.192 INFO:teuthology.orchestra.run.smithi077.stdout:506 read 0x9b74da4 thru 0x9b7902e (0x428b bytes) 2024-04-23T23:37:41.192 INFO:teuthology.orchestra.run.smithi077.stdout:507 writesame 0x35ec1a7 thru 0x35eeddf data_size 0x1(0x2c39 bytes) 2024-04-23T23:37:41.197 INFO:teuthology.orchestra.run.smithi077.stdout:508 write 0x61efbd2 thru 0x61fe511 (0xe940 bytes) 2024-04-23T23:37:41.202 INFO:teuthology.orchestra.run.smithi077.stdout:509 write 0x2557878 thru 0x255d44a (0x5bd3 bytes) 2024-04-23T23:37:41.206 INFO:teuthology.orchestra.run.smithi077.stdout:510 read 0x4d99851 thru 0x4da6796 (0xcf46 bytes) 2024-04-23T23:37:41.207 INFO:teuthology.orchestra.run.smithi077.stdout:511 write 0x38c1a01 thru 0x38c6f0a (0x550a bytes) 2024-04-23T23:37:41.208 INFO:teuthology.orchestra.run.smithi077.stdout:513 writesame 0x9e0559a thru 0x9e0f7ea data_size 0x1b(0xa251 bytes) 2024-04-23T23:37:41.214 INFO:teuthology.orchestra.run.smithi077.stdout:514 punch from 0x37adb35 to 0x37aec67, (0x1132 bytes) 2024-04-23T23:37:41.214 INFO:teuthology.orchestra.run.smithi077.stdout:515 write 0xd07bb4 thru 0xd07d84 (0x1d1 bytes) 2024-04-23T23:37:41.215 INFO:teuthology.orchestra.run.smithi077.stdout:517 writesame 0xc2515ff thru 0xc257761 data_size 0x1(0x6163 bytes) 2024-04-23T23:37:41.228 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.230 INFO:teuthology.orchestra.run.smithi077.stdout:519 trunc from 0xd4a094b to 0xb0b878d 2024-04-23T23:37:41.238 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:41.238 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:41.238 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:41.238 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:41.240 INFO:teuthology.orchestra.run.smithi077.stdout:520 punch from 0x9d274e9 to 0x9d2e87a, (0x7391 bytes) 2024-04-23T23:37:41.240 INFO:teuthology.orchestra.run.smithi077.stdout:521 writesame 0x5fadd5a thru 0x5fb2d52 data_size 0x1(0x4ff9 bytes) 2024-04-23T23:37:41.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:523 read 0x3d9d8ef thru 0x3da6393 (0x8aa5 bytes) 2024-04-23T23:37:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:524 punch from 0x4de284c to 0x4de9408, (0x6bbc bytes) 2024-04-23T23:37:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:525 punch from 0x34a8916 to 0x34ac88d, (0x3f77 bytes) 2024-04-23T23:37:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:526 read 0x1ec56c4 thru 0x1ec9276 (0x3bb3 bytes) 2024-04-23T23:37:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.253 INFO:teuthology.orchestra.run.smithi077.stdout:528 read 0x749949a thru 0x749c198 (0x2cff bytes) 2024-04-23T23:37:41.259 INFO:teuthology.orchestra.run.smithi077.stdout:530 write 0xbe5e440 thru 0xbe65564 (0x7125 bytes) 2024-04-23T23:37:41.263 INFO:teuthology.orchestra.run.smithi077.stdout:532 read 0x479473a thru 0x4798a79 (0x4340 bytes) 2024-04-23T23:37:41.269 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:41.281+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:41.274 INFO:teuthology.orchestra.run.smithi077.stdout:533 trunc from 0xbe65565 to 0x2e4268e 2024-04-23T23:37:41.294 INFO:teuthology.orchestra.run.smithi077.stdout:534 read 0xd58473 thru 0xd60931 (0x84bf bytes) 2024-04-23T23:37:41.302 INFO:teuthology.orchestra.run.smithi077.stdout:535 write 0x55b92b5 thru 0x55c745a (0xe1a6 bytes) 2024-04-23T23:37:41.322 INFO:teuthology.orchestra.run.smithi077.stdout:536 write 0x85ca6d8 thru 0x85cec7b (0x45a4 bytes) 2024-04-23T23:37:41.331 INFO:teuthology.orchestra.run.smithi077.stdout:537 trunc from 0x85cec7c to 0x7eab0ab 2024-04-23T23:37:41.340 INFO:teuthology.orchestra.run.smithi077.stdout:538 read 0x5aa3a3e thru 0x5aacfd7 (0x959a bytes) 2024-04-23T23:37:41.341 INFO:teuthology.orchestra.run.smithi077.stdout:539 trunc from 0x7eab0ab to 0x6bcdc90 2024-04-23T23:37:41.359 INFO:teuthology.orchestra.run.smithi077.stdout:540 write 0xcae4c7c thru 0xcae9c91 (0x5016 bytes) 2024-04-23T23:37:41.363 INFO:teuthology.orchestra.run.smithi077.stdout:541 read 0x7e93592 thru 0x7e944e8 (0xf57 bytes) 2024-04-23T23:37:41.363 INFO:teuthology.orchestra.run.smithi077.stdout:542 write 0xa9913ee thru 0xa9a0398 (0xefab bytes) 2024-04-23T23:37:41.365 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:41.365 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:41.365 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:41.370 INFO:teuthology.orchestra.run.smithi077.stdout:543 write 0xc1ba567 thru 0xc1c5c87 (0xb721 bytes) 2024-04-23T23:37:41.370 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:41.382+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:41.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:41.380 INFO:teuthology.orchestra.run.smithi170.stdout: marking collection for removal 2024-04-23T23:37:41.380 INFO:teuthology.orchestra.run.smithi170.stdout:setting '_remove' omap key 2024-04-23T23:37:41.380 INFO:teuthology.orchestra.run.smithi170.stdout:finish_remove_pgs 3.c_head removing 3.c 2024-04-23T23:37:41.380 INFO:teuthology.orchestra.run.smithi170.stdout:Remove successful 2024-04-23T23:37:41.387 INFO:teuthology.orchestra.run.smithi077.stdout:544 trunc from 0xcae9c92 to 0x2b0dbe9 2024-04-23T23:37:41.406 INFO:teuthology.orchestra.run.smithi077.stdout:545 read 0xc13a6b thru 0xc17300 (0x3896 bytes) 2024-04-23T23:37:41.406 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.406 INFO:teuthology.orchestra.run.smithi077.stdout:548 trunc from 0x2b0dbe9 to 0x30a2480 2024-04-23T23:37:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:550 punch from 0x25fc233 to 0x25ff61a, (0x33e7 bytes) 2024-04-23T23:37:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:553 read 0x8d2e8d thru 0x8ddf3b (0xb0af bytes) 2024-04-23T23:37:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:554 punch from 0xe5c77 to 0xe7be5, (0x1f6e bytes) 2024-04-23T23:37:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.417 INFO:teuthology.orchestra.run.smithi077.stdout:558 trunc from 0x30a2480 to 0x8786c0c 2024-04-23T23:37:41.428 INFO:teuthology.orchestra.run.smithi077.stdout:559 trunc from 0x8786c0c to 0xd0bb436 2024-04-23T23:37:41.432 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.438 INFO:teuthology.orchestra.run.smithi077.stdout:561 write 0xd556ad8 thru 0xd55c9ab (0x5ed4 bytes) 2024-04-23T23:37:41.442 INFO:teuthology.orchestra.run.smithi077.stdout:562 writesame 0x7ab8b68 thru 0x7abc3dc data_size 0x1(0x3875 bytes) 2024-04-23T23:37:41.462 INFO:teuthology.orchestra.run.smithi077.stdout:564 trunc from 0xd55c9ac to 0x3de9286 2024-04-23T23:37:41.471 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:41.483+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:41.472 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.472 INFO:teuthology.orchestra.run.smithi077.stdout:569 read 0x3bec18f thru 0x3bf8f5e (0xcdd0 bytes) 2024-04-23T23:37:41.479 INFO:teuthology.orchestra.run.smithi077.stdout:570 write 0x545352a thru 0x5458ba8 (0x567f bytes) 2024-04-23T23:37:41.496 INFO:teuthology.orchestra.run.smithi077.stdout:572 writesame 0xaefdbe5 thru 0xaf04fdf data_size 0x3(0x73fb bytes) 2024-04-23T23:37:41.496 INFO:teuthology.orchestra.run.smithi077.stdout:573 read 0x557b96 thru 0x56790e (0xfd79 bytes) 2024-04-23T23:37:41.496 INFO:teuthology.orchestra.run.smithi077.stdout:574 punch from 0x8714797 to 0x872446b, (0xfcd4 bytes) 2024-04-23T23:37:41.496 INFO:teuthology.orchestra.run.smithi077.stdout:575 punch from 0x994f740 to 0x995b8d6, (0xc196 bytes) 2024-04-23T23:37:41.496 INFO:teuthology.orchestra.run.smithi077.stdout:576 read 0x779453a thru 0x779afc1 (0x6a88 bytes) 2024-04-23T23:37:41.496 INFO:teuthology.orchestra.run.smithi077.stdout:577 punch from 0xa48bbc5 to 0xa497cc3, (0xc0fe bytes) 2024-04-23T23:37:41.497 INFO:teuthology.orchestra.run.smithi077.stdout:578 read 0x3521427 thru 0x352b227 (0x9e01 bytes) 2024-04-23T23:37:41.504 INFO:teuthology.orchestra.run.smithi077.stdout:580 write 0xd3ed705 thru 0xd3fca3e (0xf33a bytes) 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3238 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4161536~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0636125729999999, 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029291145000000001, 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.505 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3238 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452574+0000", 2024-04-23T23:37:41.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452582+0000", 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8930000000000005e-06 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452587+0000", 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3000000000000001e-06 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481755+0000", 2024-04-23T23:37:41.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029167226000000001 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481797+0000", 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2651999999999998e-05 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481863+0000", 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5685999999999994e-05 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.509 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3252 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 49152~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0635901940000001, 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029578383999999999, 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3252 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452595+0000", 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452597+0000", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452604+0000", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2660000000000004e-06 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452610+0000", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8429999999999998e-06 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481898+0000", 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029288338000000001 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482013+0000", 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000114746 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482172+0000", 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015978300000000001 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3253 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 278528~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0635684299999999, 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029686714999999999, 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3253 2024-04-23T23:37:41.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452618+0000", 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1210000000000001e-06 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452627+0000", 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3489999999999992e-06 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452632+0000", 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1479999999999997e-06 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482187+0000", 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029555272 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482230+0000", 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2750999999999998e-05 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482303+0000", 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2669000000000005e-05 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3254 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 507904~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.063545733, 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029953305999999999, 2024-04-23T23:37:41.518 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3254 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452641+0000", 2024-04-23T23:37:41.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1459999999999999e-06 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452647+0000", 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2620000000000004e-06 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452652+0000", 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482338+0000", 2024-04-23T23:37:41.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029685554999999999 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482432+0000", 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4643999999999997e-05 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482592+0000", 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015951100000000001 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3255 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 737280~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0635256230000001, 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030178470999999998, 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3255 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452661+0000", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452667+0000", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2639999999999997e-06 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452672+0000", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.848e-06 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482635+0000", 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029962494999999999 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482709+0000", 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4445999999999998e-05 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482837+0000", 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012805100000000001 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3256 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 966656~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0634905640000001, 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030449868000000001, 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3256 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3900000000000004e-07 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452697+0000", 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:37:41.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452704+0000", 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.362e-06 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452710+0000", 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5609999999999998e-06 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482891+0000", 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030181050000000001 2024-04-23T23:37:41.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482991+0000", 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9586000000000005e-05 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483144+0000", 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015305000000000001 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3257 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1196032~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0634671019999999, 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030595397999999999, 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3257 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452718+0000", 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452724+0000", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452730+0000", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5320000000000003e-06 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452738+0000", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7579999999999992e-06 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483178+0000", 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030439931 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483232+0000", 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3695e-05 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483313+0000", 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0858000000000004e-05 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3258 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1425408~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.063438485, 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030867680000000002, 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3258 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452748+0000", 2024-04-23T23:37:41.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452765+0000", 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7003e-05 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452771+0000", 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483351+0000", 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030579967999999999 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483453+0000", 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010173100000000001 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483613+0000", 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016066400000000001 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.538 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3259 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1654784~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0634062259999999, 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031145740000000002, 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3259 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452779+0000", 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452781+0000", 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0360000000000001e-06 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452787+0000", 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2809999999999997e-06 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452793+0000", 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0870000000000003e-06 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483651+0000", 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030858239999999999 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483759+0000", 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107533 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483924+0000", 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016508199999999999 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3260 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1884160~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0633830879999999, 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031422796000000003, 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3260 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452802+0000", 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.72e-07 2024-04-23T23:37:41.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452804+0000", 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.979e-06 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452811+0000", 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0319999999999998e-06 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452816+0000", 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483962+0000", 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031146258999999999 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484069+0000", 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106846 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484224+0000", 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015536799999999999 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.546 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3261 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2113536~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.063362986, 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031579572, 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3261 2024-04-23T23:37:41.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452822+0000", 2024-04-23T23:37:41.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452824+0000", 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8419999999999999e-06 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452829+0000", 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7089999999999999e-06 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452835+0000", 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3120000000000001e-06 2024-04-23T23:37:41.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484254+0000", 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031419152999999998 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484305+0000", 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1363000000000003e-05 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484401+0000", 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5784000000000003e-05 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3262 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2342912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.063343618, 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031829887000000001, 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3262 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452843+0000", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452852+0000", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5189999999999992e-06 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452857+0000", 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1259999999999997e-06 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484440+0000", 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031583133999999999 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484537+0000", 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7248000000000001e-05 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484671+0000", 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013340800000000001 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3263 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2572288~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0633188650000001, 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032059593999999997, 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3263 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452866+0000", 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452868+0000", 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1560000000000002e-06 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452875+0000", 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5209999999999999e-06 2024-04-23T23:37:41.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452879+0000", 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484704+0000", 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031825141000000001 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484797+0000", 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3107000000000002e-05 2024-04-23T23:37:41.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484925+0000", 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000127711 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3264 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2801664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.063292041, 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032190086, 2024-04-23T23:37:41.559 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3264 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452893+0000", 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452895+0000", 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.367e-06 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452902+0000", 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1919999999999999e-06 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452908+0000", 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.152e-06 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484951+0000", 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032043673000000002 2024-04-23T23:37:41.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485011+0000", 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9840999999999998e-05 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485082+0000", 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1308000000000002e-05 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3265 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3031040~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0632699370000001, 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032433114999999998, 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3265 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452915+0000", 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9399999999999995e-07 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452917+0000", 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0650000000000001e-06 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452923+0000", 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5010000000000001e-06 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452928+0000", 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.746e-06 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485122+0000", 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032193745000000003 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485218+0000", 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6427000000000004e-05 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485347+0000", 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012913700000000001 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.567 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3266 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3260416~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.063250121, 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032550864999999998, 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.568 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3266 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452935+0000", 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452937+0000", 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452943+0000", 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0630000000000002e-06 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452947+0000", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7079999999999996e-06 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485376+0000", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032428750999999999 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485423+0000", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6597999999999997e-05 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485485+0000", 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2297000000000003e-05 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3267 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3489792~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0632311169999999, 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032811840000000002, 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.572 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3267 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452954+0000", 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452955+0000", 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.877e-06 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452962+0000", 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6760000000000001e-06 2024-04-23T23:37:41.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452966+0000", 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3089999999999997e-06 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485525+0000", 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032558746 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485632+0000", 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107179 2024-04-23T23:37:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485765+0000", 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013261600000000001 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3268 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3719168~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0632070490000001, 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032909676999999998, 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.576 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3268 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452978+0000", 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452980+0000", 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2290000000000002e-06 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452987+0000", 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5869999999999998e-06 2024-04-23T23:37:41.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452992+0000", 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9949999999999996e-06 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485780+0000", 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032788386000000003 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485826+0000", 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5744000000000001e-05 2024-04-23T23:37:41.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485887+0000", 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1254999999999995e-05 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3269 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3948544~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0631852079999999, 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033158813000000002, 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.580 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3269 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:41.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453000+0000", 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453007+0000", 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2320000000000004e-06 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453015+0000", 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453020+0000", 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485924+0000", 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032904299999999997 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486025+0000", 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101184 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486158+0000", 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000132521 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.584 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3270 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4177920~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.0631576309999999, 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033252354999999997, 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3270 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:41.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:37:41.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453029+0000", 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0430000000000002e-06 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453036+0000", 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.545e-06 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453040+0000", 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6450000000000004e-06 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486175+0000", 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033134469999999999 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486220+0000", 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000001e-05 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486279+0000", 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9021999999999998e-05 2024-04-23T23:37:41.588 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.589 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.589 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.589 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:41.589 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:41.589 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:41.590 INFO:teuthology.orchestra.run.smithi077.stdout:582 read 0x7fab7e7 thru 0x7fb5d45 (0xa55f bytes) 2024-04-23T23:37:41.590 INFO:teuthology.orchestra.run.smithi077.stdout:583 punch from 0x6be0ab6 to 0x6be1711, (0xc5b bytes) 2024-04-23T23:37:41.590 INFO:teuthology.orchestra.run.smithi077.stdout:585 trunc from 0xd3fca3f to 0xc27aaa9 2024-04-23T23:37:41.591 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:586 punch from 0xa157618 to 0xa165bad, (0xe595 bytes) 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:587 trunc from 0xc27aaa9 to 0xc91b238 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:588 trunc from 0xc91b238 to 0x8d5e3f7 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:589 write 0xce46d1c thru 0xce4978b (0x2a70 bytes) 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:597 punch from 0x1e23e to 0x275a4, (0x9366 bytes) 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:598 writesame 0x6a04fb9 thru 0x6a12e83 data_size 0x55(0xdecb bytes) 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:600 read 0x95af347 thru 0x95bd191 (0xde4b bytes) 2024-04-23T23:37:41.593 INFO:teuthology.orchestra.run.smithi077.stdout:602 punch from 0x3d0403e to 0x3d1296e, (0xe930 bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:603 write 0x9f19976 thru 0x9f23625 (0x9cb0 bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:604 read 0x8c37513 thru 0x8c39819 (0x2307 bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:605 write 0x2c9e13a thru 0x2ca82dd (0xa1a4 bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:606 read 0x80fbe88 thru 0x8109e6e (0xdfe7 bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:607 writesame 0x4fe75af thru 0x4fed193 data_size 0x5(0x5be5 bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:608 trunc from 0xce4978c to 0x53c1c6d 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:609 write 0x1b3bf02 thru 0x1b434bb (0x75ba bytes) 2024-04-23T23:37:41.594 INFO:teuthology.orchestra.run.smithi077.stdout:610 read 0x409e3c0 thru 0x40a810d (0x9d4e bytes) 2024-04-23T23:37:41.594 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:41.602+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:41.595 INFO:teuthology.orchestra.run.smithi077.stdout:611 write 0x71b9878 thru 0x71c5f13 (0xc69c bytes) 2024-04-23T23:37:41.615 INFO:teuthology.orchestra.run.smithi077.stdout:612 write 0xdc06fc5 thru 0xdc11d61 (0xad9d bytes) 2024-04-23T23:37:41.624 INFO:teuthology.orchestra.run.smithi077.stdout:613 read 0x10dffbb thru 0x10eabaf (0xabf5 bytes) 2024-04-23T23:37:41.634 INFO:teuthology.orchestra.run.smithi077.stdout:614 trunc from 0xdc11d62 to 0x639c171 2024-04-23T23:37:41.648 INFO:teuthology.orchestra.run.smithi077.stdout:615 read 0x3a48ce6 thru 0x3a56b33 (0xde4e bytes) 2024-04-23T23:37:41.648 INFO:teuthology.orchestra.run.smithi077.stdout:616 punch from 0x695f7a to 0x69a80a, (0x4890 bytes) 2024-04-23T23:37:41.663 INFO:teuthology.orchestra.run.smithi077.stdout:620 writesame 0xd73f056 thru 0xd74af42 data_size 0x1(0xbeed bytes) 2024-04-23T23:37:41.663 INFO:teuthology.orchestra.run.smithi077.stdout:622 punch from 0x871f329 to 0x8721168, (0x1e3f bytes) 2024-04-23T23:37:41.664 INFO:teuthology.orchestra.run.smithi077.stdout:623 write 0x3ec00dc thru 0x3ecd74b (0xd670 bytes) 2024-04-23T23:37:41.673 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.673 INFO:teuthology.orchestra.run.smithi077.stdout:625 read 0xa0a3bae thru 0xa0ad7d2 (0x9c25 bytes) 2024-04-23T23:37:41.673 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.685 INFO:teuthology.orchestra.run.smithi077.stdout:627 trunc from 0xd74af43 to 0x2e37c00 2024-04-23T23:37:41.691 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:41.702+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:41.704 INFO:teuthology.orchestra.run.smithi077.stdout:629 trunc from 0x2e37c00 to 0xd3a199 2024-04-23T23:37:41.704 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:41.704 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:41.704 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:41.704 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:41.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:41.744 INFO:teuthology.orchestra.run.smithi077.stdout:630 writesame 0xc6b778c thru 0xc6c6387 data_size 0x16(0xebfc bytes) 2024-04-23T23:37:41.744 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.744 INFO:teuthology.orchestra.run.smithi077.stdout:633 write 0x52a1bba thru 0x52a55d1 (0x3a18 bytes) 2024-04-23T23:37:41.750 INFO:teuthology.orchestra.run.smithi077.stdout:634 trunc from 0xc6c6388 to 0xa416704 2024-04-23T23:37:41.755 INFO:teuthology.orchestra.run.smithi077.stdout:635 punch from 0x78387c2 to 0x78467da, (0xe018 bytes) 2024-04-23T23:37:41.755 INFO:teuthology.orchestra.run.smithi077.stdout:639 writesame 0x5be20c0 thru 0x5bebb26 data_size 0x1d(0x9a67 bytes) 2024-04-23T23:37:41.774 INFO:teuthology.orchestra.run.smithi077.stdout:641 trunc from 0xa416704 to 0x248881f 2024-04-23T23:37:41.788 INFO:teuthology.orchestra.run.smithi077.stdout:642 read 0x3bbb23 thru 0x3c07e6 (0x4cc4 bytes) 2024-04-23T23:37:41.792 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:41.804+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:41.797 INFO:teuthology.orchestra.run.smithi077.stdout:645 write 0x4464e7e thru 0x447052a (0xb6ad bytes) 2024-04-23T23:37:41.822 INFO:teuthology.orchestra.run.smithi077.stdout:646 writesame 0xd58366f thru 0xd587e6e data_size 0x24(0x4800 bytes) 2024-04-23T23:37:41.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:37:41.835 INFO:teuthology.orchestra.run.smithi077.stdout:647 trunc from 0xd587e6f to 0x21db8b1 2024-04-23T23:37:41.845 INFO:teuthology.orchestra.run.smithi077.stdout:649 trunc from 0x21db8b1 to 0x275f22c 2024-04-23T23:37:41.855 INFO:teuthology.orchestra.run.smithi077.stdout:651 writesame 0x34aed56 thru 0x34afbeb data_size 0x1(0xe96 bytes) 2024-04-23T23:37:41.863 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:41.863 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:41.863 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:41.863 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:41.864 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:41.869 INFO:teuthology.orchestra.run.smithi077.stdout:652 write 0xac84114 thru 0xac86724 (0x2611 bytes) 2024-04-23T23:37:41.872 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.872 INFO:teuthology.orchestra.run.smithi077.stdout:655 punch from 0x8608b5b to 0x8618a50, (0xfef5 bytes) 2024-04-23T23:37:41.873 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:41.877 INFO:teuthology.orchestra.run.smithi077.stdout:658 trunc from 0xac86725 to 0xe64e22e 2024-04-23T23:37:41.877 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-04-23T23:37:41.882 INFO:teuthology.orchestra.run.smithi077.stdout:659 write 0xe58e20b thru 0xe59cf72 (0xed68 bytes) 2024-04-23T23:37:41.892 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:41.904+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:41.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --op import --file /var/log/ceph/exp.3.c.5 2024-04-23T23:37:41.901 INFO:teuthology.orchestra.run.smithi077.stdout:661 trunc from 0xe64e22e to 0x5625616 2024-04-23T23:37:41.905 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:41.905 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:41.910 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.910 INFO:teuthology.orchestra.run.smithi077.stdout:664 read 0x10ba628 thru 0x10c5ba5 (0xb57e bytes) 2024-04-23T23:37:41.917 INFO:teuthology.orchestra.run.smithi077.stdout:665 write 0x6991016 thru 0x69943cf (0x33ba bytes) 2024-04-23T23:37:41.925 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:41.926 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:41.928 INFO:teuthology.orchestra.run.smithi077.stdout:666 write 0x7ba0242 thru 0x7ba2a4f (0x280e bytes) 2024-04-23T23:37:41.929 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:37:41.929 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:37:41.931 INFO:teuthology.orchestra.run.smithi077.stdout:667 punch from 0x1460641 to 0x146602c, (0x59eb bytes) 2024-04-23T23:37:41.931 INFO:teuthology.orchestra.run.smithi077.stdout:668 read 0x7b09aa0 thru 0x7b11dc2 (0x8323 bytes) 2024-04-23T23:37:41.931 INFO:teuthology.orchestra.run.smithi077.stdout:670 read 0x778989b thru 0x778a585 (0xceb bytes) 2024-04-23T23:37:41.931 INFO:teuthology.orchestra.run.smithi077.stdout:671 read 0x63ff4b7 thru 0x640ccbb (0xd805 bytes) 2024-04-23T23:37:41.931 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.938 INFO:teuthology.orchestra.run.smithi077.stdout:674 trunc from 0x7ba2a50 to 0xe55a8d5 2024-04-23T23:37:41.944 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:41.944 INFO:teuthology.orchestra.run.smithi077.stdout:678 read 0x3364149 thru 0x33707ea (0xc6a2 bytes) 2024-04-23T23:37:41.944 INFO:teuthology.orchestra.run.smithi077.stdout:681 read 0x7bdfb24 thru 0x7be68ec (0x6dc9 bytes) 2024-04-23T23:37:41.944 INFO:teuthology.orchestra.run.smithi077.stdout:685 writesame 0x75d1aa3 thru 0x75d24bb data_size 0xb(0xa19 bytes) 2024-04-23T23:37:41.947 INFO:teuthology.orchestra.run.smithi077.stdout:686 punch from 0x2cf47da to 0x2cf6507, (0x1d2d bytes) 2024-04-23T23:37:41.948 INFO:teuthology.orchestra.run.smithi077.stdout:688 read 0xbba84a2 thru 0xbba9b36 (0x1695 bytes) 2024-04-23T23:37:41.948 INFO:teuthology.orchestra.run.smithi077.stdout:689 write 0x11d7e37 thru 0x11e0d8d (0x8f57 bytes) 2024-04-23T23:37:41.952 INFO:teuthology.orchestra.run.smithi077.stdout:691 read 0x75a2679 thru 0x75adad5 (0xb45d bytes) 2024-04-23T23:37:41.953 INFO:teuthology.orchestra.run.smithi077.stdout:692 writesame 0xbac0c42 thru 0xbac8fd2 data_size 0x67(0x8391 bytes) 2024-04-23T23:37:41.956 INFO:teuthology.orchestra.run.smithi077.stdout:693 read 0x65b46c0 thru 0x65c0d92 (0xc6d3 bytes) 2024-04-23T23:37:41.957 INFO:teuthology.orchestra.run.smithi077.stdout:696 write 0x6416705 thru 0x641b379 (0x4c75 bytes) 2024-04-23T23:37:41.960 INFO:teuthology.orchestra.run.smithi077.stdout:698 clone 3 order 18 su 1024 sc 11 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3213 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 6815744~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418838+0000", 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5790547880000001, 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016152616000000002, 2024-04-23T23:37:41.987 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3213 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418838+0000", 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418838+0000", 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418838+0000", 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418840+0000", 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.331e-06 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418843+0000", 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7730000000000001e-06 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418846+0000", 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8040000000000002e-06 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.434909+0000", 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016062654999999999 2024-04-23T23:37:41.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.434952+0000", 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2892000000000002e-05 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:41.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.434990+0000", 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8729000000000001e-05 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3214 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7045120~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418860+0000", 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5790331069999999, 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016244720000000001, 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:41.992 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3214 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418860+0000", 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:41.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418860+0000", 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418860+0000", 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418861+0000", 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3e-06 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418865+0000", 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4910000000000001e-06 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418867+0000", 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6860000000000002e-06 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:41.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435014+0000", 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016147004999999999 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435059+0000", 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4687000000000001e-05 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435104+0000", 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.511e-05 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3215 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7274496~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418875+0000", 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.579017546, 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016336685, 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:41.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3215 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:41.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418875+0000", 2024-04-23T23:37:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418875+0000", 2024-04-23T23:37:42.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418875+0000", 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.72e-07 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418880+0000", 2024-04-23T23:37:42.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3270000000000002e-06 2024-04-23T23:37:42.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418886+0000", 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9490000000000001e-06 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418889+0000", 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.948e-06 2024-04-23T23:37:42.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435128+0000", 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016239581999999999 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435171+0000", 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3109999999999999e-05 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435212+0000", 2024-04-23T23:37:42.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0497000000000002e-05 2024-04-23T23:37:42.006 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.006 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.006 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.006 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3216 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7503872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418897+0000", 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5789957779999999, 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016426957999999998, 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.007 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3216 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418897+0000", 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418897+0000", 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418897+0000", 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5400000000000002e-07 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418899+0000", 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.297e-06 2024-04-23T23:37:42.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418902+0000", 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3519999999999998e-06 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418908+0000", 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435235+0000", 2024-04-23T23:37:42.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016327352999999999 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435280+0000", 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4944999999999997e-05 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435324+0000", 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3627000000000001e-05 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.011 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3217 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7733248~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418917+0000", 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5789760560000001, 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0165071, 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3217 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418917+0000", 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418917+0000", 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418917+0000", 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418920+0000", 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0620000000000001e-06 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418923+0000", 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4400000000000001e-06 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418926+0000", 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8820000000000001e-06 2024-04-23T23:37:42.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435338+0000", 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016411555000000001 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435381+0000", 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3492000000000003e-05 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435424+0000", 2024-04-23T23:37:42.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2234000000000003e-05 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3218 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7962624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418938+0000", 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578954819, 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016603592, 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3218 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418938+0000", 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418938+0000", 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418938+0000", 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.58e-07 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418940+0000", 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3060000000000001e-06 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418943+0000", 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.687e-06 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418946+0000", 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7199999999999998e-06 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435447+0000", 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016501194 2024-04-23T23:37:42.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435498+0000", 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0529999999999999e-05 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435541+0000", 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3696999999999999e-05 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.020 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3219 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 8192000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418949+0000", 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5789433850000001, 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016700566, 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.021 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3219 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418949+0000", 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418949+0000", 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418950+0000", 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.58e-07 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418951+0000", 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6800000000000009e-07 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418953+0000", 2024-04-23T23:37:42.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9390000000000002e-06 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418956+0000", 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.615e-06 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435566+0000", 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016610099999999999 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435609+0000", 2024-04-23T23:37:42.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2789e-05 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435650+0000", 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0797000000000003e-05 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.025 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3239 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 5455872~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418959+0000", 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5789336469999999, 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016800874, 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3239 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418959+0000", 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418959+0000", 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418959+0000", 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0699999999999999e-07 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418960+0000", 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4099999999999997e-07 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418963+0000", 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2720000000000002e-06 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418966+0000", 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6410000000000002e-06 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435672+0000", 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016705725000000001 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435716+0000", 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4348999999999998e-05 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435760+0000", 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3739000000000003e-05 2024-04-23T23:37:42.029 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3240 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 5685248~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.418979+0000", 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578913502, 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016891659999999999, 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.030 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3240 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418979+0000", 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418979+0000", 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418980+0000", 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0200000000000003e-07 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418981+0000", 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0210000000000001e-06 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418984+0000", 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1370000000000002e-06 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.418986+0000", 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.632e-06 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435785+0000", 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016798559000000001 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435828+0000", 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3222000000000001e-05 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435871+0000", 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2687e-05 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3241 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 5914624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419001+0000", 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578891482, 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016981545000000001, 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.034 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3241 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419001+0000", 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419001+0000", 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419002+0000", 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419003+0000", 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0139999999999999e-06 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419006+0000", 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.128e-06 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419008+0000", 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.554e-06 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435892+0000", 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016884122000000001 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435938+0000", 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6050999999999997e-05 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.435983+0000", 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4277000000000003e-05 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3242 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 6144000~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419015+0000", 2024-04-23T23:37:42.038 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578877812, 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017077636, 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3242 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419015+0000", 2024-04-23T23:37:42.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419015+0000", 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419015+0000", 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419016+0000", 2024-04-23T23:37:42.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9800000000000002e-07 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419020+0000", 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6370000000000001e-06 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419022+0000", 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.525e-06 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436008+0000", 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016985238999999999 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436051+0000", 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3494000000000001e-05 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436092+0000", 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1352e-05 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.042 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3243 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 6373376~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419025+0000", 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578867118, 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017179091, 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3243 2024-04-23T23:37:42.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419025+0000", 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419025+0000", 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419026+0000", 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:37:42.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419027+0000", 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5099999999999998e-07 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419030+0000", 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9189999999999999e-06 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419032+0000", 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5320000000000001e-06 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436116+0000", 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017083853999999999 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436161+0000", 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5011e-05 2024-04-23T23:37:42.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436205+0000", 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3578999999999997e-05 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3244 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 6602752~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419035+0000", 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5788575300000001, 2024-04-23T23:37:42.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017278549000000001, 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3244 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419035+0000", 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419035+0000", 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419035+0000", 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:37:42.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419036+0000", 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3399999999999997e-07 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419039+0000", 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8650000000000001e-06 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419049+0000", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4609999999999997e-06 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436230+0000", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017181194 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436275+0000", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4805000000000002e-05 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436314+0000", 2024-04-23T23:37:42.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8940999999999999e-05 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3245 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 6832128~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419065+0000", 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578827652, 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017362826000000001, 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3245 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419065+0000", 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419065+0000", 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419065+0000", 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419070+0000", 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0980000000000004e-06 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419076+0000", 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8650000000000003e-06 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419079+0000", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.931e-06 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436337+0000", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017258044 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436383+0000", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5871000000000002e-05 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436428+0000", 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4567000000000002e-05 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3246 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7061504~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419086+0000", 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5788068499999999, 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017455875999999999, 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3246 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419086+0000", 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419086+0000", 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419086+0000", 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419087+0000", 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.052e-06 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419090+0000", 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1990000000000002e-06 2024-04-23T23:37:42.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419093+0000", 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6840000000000001e-06 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436453+0000", 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017359596000000001 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436500+0000", 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6866000000000002e-05 2024-04-23T23:37:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436542+0000", 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2103e-05 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3247 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7290880~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419110+0000", 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5787827810000001, 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017545364000000001, 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.060 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3247 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419110+0000", 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419110+0000", 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419110+0000", 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5699999999999998e-07 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419112+0000", 2024-04-23T23:37:42.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.226e-06 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419115+0000", 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7589999999999999e-06 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419118+0000", 2024-04-23T23:37:42.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6979999999999998e-06 2024-04-23T23:37:42.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436566+0000", 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017447654999999999 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436611+0000", 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5445999999999998e-05 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436655+0000", 2024-04-23T23:37:42.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4122999999999998e-05 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3248 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7520256~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419133+0000", 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578759735, 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017629133000000002, 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3248 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419133+0000", 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419133+0000", 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419133+0000", 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419136+0000", 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0079999999999998e-06 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419140+0000", 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3950000000000001e-06 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419144+0000", 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1670000000000001e-06 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436679+0000", 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017535471 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436722+0000", 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:37:42.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436762+0000", 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0080000000000003e-05 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3249 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7749632~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419154+0000", 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5787388419999999, 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017756628, 2024-04-23T23:37:42.070 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3249 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419154+0000", 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419154+0000", 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419154+0000", 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419156+0000", 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.308e-06 2024-04-23T23:37:42.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419159+0000", 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.799e-06 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419162+0000", 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7030000000000002e-06 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436785+0000", 2024-04-23T23:37:42.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017623178 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436829+0000", 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4058999999999999e-05 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436910+0000", 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1118999999999994e-05 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3250 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 7979008~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419176+0000", 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.5787168, 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017926114, 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3250 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419176+0000", 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419176+0000", 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419176+0000", 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3799999999999998e-07 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419178+0000", 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419181+0000", 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6500000000000002e-06 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419184+0000", 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7250000000000002e-06 2024-04-23T23:37:42.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.436947+0000", 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017762613999999999 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.437025+0000", 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8528000000000004e-05 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.437102+0000", 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6891999999999995e-05 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:3251 3.3 3:c5883756:::rbd_data.1194833257ef.0000000000000002:4 [read 8208384~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:40.419200+0000", 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.578692591, 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.018021088000000001, 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:42.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 3251 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419200+0000", 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419200+0000", 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419200+0000", 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419202+0000", 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2359999999999999e-06 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419205+0000", 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3799999999999998e-06 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.419208+0000", 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4000000000000001e-06 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.437126+0000", 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017917959000000001 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.437176+0000", 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9826e-05 2024-04-23T23:37:42.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:40.437221+0000", 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4842000000000002e-05 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.083 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:42.085 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:42.096+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:42.185 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:42.198+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:42.229 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:42.229 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.238 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:42.286 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:42.299+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:42.350 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:42.350 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:42.388 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:42.400+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:42.463 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:42.463 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop(client.4500.0:5856 3.1e e28/21 3:78f5d015:::rbd_data.1194137ed5d1.0000000000000023:head v 28'27, mlcod=28'25)", 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:41.964289+0000", 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.51154159600000004, 2024-04-23T23:37:42.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00080805099999999995, 2024-04-23T23:37:42.465 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.465 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.465 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.465 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964289+0000", 2024-04-23T23:37:42.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964289+0000", 2024-04-23T23:37:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964291+0000", 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.37e-06 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964299+0000", 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0830000000000004e-06 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964314+0000", 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4827000000000001e-05 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964320+0000", 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6810000000000001e-06 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964388+0000", 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8101000000000004e-05 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.964412+0000", 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.317e-05 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.965049+0000", 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00063794500000000001 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:41.965097+0000", 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7874000000000003e-05 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.472 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.473 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.473 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.473 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.473 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.475 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:42.520 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:42.531+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:42.579 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:42.579 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:42.579 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:42.579 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.589 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:42.630 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:42.641+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:42.691 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:42.703+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:42.731 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:42.731 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:42.731 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:42.732 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:42.732 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:42.792 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:42.803+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:42.817 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:37:42.852 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 25.135113531999998, 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.853 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:37:42.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:18 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.234648+0000", 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.628423324, 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.005327114, 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.859 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 18 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234648+0000", 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234648+0000", 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234650+0000", 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0699999999999999e-06 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234655+0000", 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.164e-06 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234664+0000", 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2499999999999995e-06 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.234669+0000", 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9930000000000003e-06 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235119+0000", 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00044995000000000001 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235179+0000", 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9867999999999997e-05 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235285+0000", 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010623 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.235777+0000", 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00049199699999999999 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.239913+0000", 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0041361999999999996 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.239947+0000", 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4028e-05 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.239976+0000", 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8364000000000002e-05 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:62 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [call lock.lock in=8b,cmpxattr striper.excl op 1 mode 1 in=12b,setxattr striper.excl (26) in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.281152+0000", 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.581920004000001, 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052999350000000004, 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 62 2024-04-23T23:37:42.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281152+0000", 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281152+0000", 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281153+0000", 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6899999999999996e-07 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281157+0000", 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5480000000000003e-06 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281166+0000", 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2560000000000008e-06 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281171+0000", 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8849999999999998e-06 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281211+0000", 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9264000000000002e-05 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281265+0000", 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4548e-05 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281388+0000", 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000122559 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.281838+0000", 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00045018499999999997 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.286305+0000", 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0044670960000000003 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.286396+0000", 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0984999999999997e-05 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.286452+0000", 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5840000000000001e-05 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.287856+0000", 2024-04-23T23:37:42.870 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.575215589999999, 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0071761389999999998, 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 69 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287856+0000", 2024-04-23T23:37:42.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287856+0000", 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287857+0000", 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.06e-07 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287886+0000", 2024-04-23T23:37:42.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9730000000000002e-05 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287892+0000", 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6550000000000001e-06 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287897+0000", 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4449999999999998e-06 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.288695+0000", 2024-04-23T23:37:42.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079809200000000003 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.288744+0000", 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9673999999999999e-05 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.288827+0000", 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3133000000000005e-05 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289717+0000", 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00088932300000000002 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.294973+0000", 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052565240000000003 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295007+0000", 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3797000000000002e-05 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295032+0000", 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5259999999999999e-05 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.287905+0000", 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.575166632999998, 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0072858159999999996, 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 70 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287905+0000", 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287905+0000", 2024-04-23T23:37:42.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287906+0000", 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287908+0000", 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287911+0000", 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6789999999999998e-06 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.287914+0000", 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7159999999999999e-06 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289325+0000", 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014106279999999999 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289372+0000", 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6829000000000002e-05 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289445+0000", 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3669000000000002e-05 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.289980+0000", 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053461299999999997 2024-04-23T23:37:42.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295143+0000", 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051635939999999996 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295170+0000", 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6718000000000001e-05 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.295191+0000", 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0866999999999999e-05 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.881 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369984962, 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0053856060000000002, 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 111 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493087+0000", 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.37e-07 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493092+0000", 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1409999999999998e-06 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493099+0000", 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4680000000000003e-06 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493105+0000", 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.614e-06 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.496478+0000", 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0033728230000000001 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.496528+0000", 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0547000000000002e-05 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.496663+0000", 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000134757 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498361+0000", 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001697811 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498376+0000", 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5628e-05 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498431+0000", 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4512999999999998e-05 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498472+0000", 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1666999999999999e-05 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.887 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493118+0000", 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369953916, 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0064051200000000003, 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 112 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493118+0000", 2024-04-23T23:37:42.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493118+0000", 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493119+0000", 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4000000000000001e-07 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493199+0000", 2024-04-23T23:37:42.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9997e-05 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493207+0000", 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7639999999999994e-06 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493213+0000", 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7490000000000004e-06 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497336+0000", 2024-04-23T23:37:42.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0041226780000000003 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497399+0000", 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2929999999999995e-05 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497479+0000", 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0399000000000001e-05 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499422+0000", 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019427769999999999 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499461+0000", 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9326000000000003e-05 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499500+0000", 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8460000000000001e-05 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499523+0000", 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.34e-05 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493225+0000", 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369846649999999, 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0073294600000000003, 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 113 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493225+0000", 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493225+0000", 2024-04-23T23:37:42.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493226+0000", 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493230+0000", 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1049999999999997e-06 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493236+0000", 2024-04-23T23:37:42.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3489999999999997e-06 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493242+0000", 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497903+0000", 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0046609570000000003 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.497963+0000", 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0207000000000001e-05 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498049+0000", 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6019000000000004e-05 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500006+0000", 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019574330000000002 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500440+0000", 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00043341400000000002 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500514+0000", 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4177999999999994e-05 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500555+0000", 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0849000000000001e-05 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.898 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369821168000001, 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0073968389999999997, 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.899 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 114 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493251+0000", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493255+0000", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9949999999999999e-06 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493261+0000", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1129999999999997e-06 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493266+0000", 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.87e-06 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498519+0000", 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052526830000000002 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498573+0000", 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3879999999999999e-05 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498658+0000", 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4956000000000004e-05 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500013+0000", 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001354952 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500594+0000", 2024-04-23T23:37:42.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00058141300000000003 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500625+0000", 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0660000000000001e-05 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500647+0000", 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2815000000000001e-05 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369794829, 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0078613620000000002, 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493277+0000", 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493348+0000", 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0517000000000003e-05 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493356+0000", 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1710000000000002e-06 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493363+0000", 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9530000000000002e-06 2024-04-23T23:37:42.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498916+0000", 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0055531529999999999 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.498993+0000", 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6885000000000007e-05 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499070+0000", 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:37:42.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500567+0000", 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014968780000000001 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501091+0000", 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052434599999999997 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501118+0000", 2024-04-23T23:37:42.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6906999999999998e-05 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501138+0000", 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0088000000000001e-05 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:42.910 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369697321, 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0078502050000000007, 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:42.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493375+0000", 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.06e-07 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493379+0000", 2024-04-23T23:37:42.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2139999999999998e-06 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493386+0000", 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6810000000000001e-06 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493391+0000", 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9150000000000004e-06 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499576+0000", 2024-04-23T23:37:42.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0061849690000000002 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499658+0000", 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2583999999999994e-05 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.499775+0000", 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117009 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500661+0000", 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00088579100000000003 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501165+0000", 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00050352000000000003 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501207+0000", 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1842999999999999e-05 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.501225+0000", 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8073000000000001e-05 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.493400+0000", 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.369671916000001, 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0088637309999999997, 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493400+0000", 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493400+0000", 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493401+0000", 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4000000000000001e-07 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493407+0000", 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7020000000000004e-06 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493413+0000", 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:37:42.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.493418+0000", 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3630000000000002e-06 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500046+0000", 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0066278420000000001 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500096+0000", 2024-04-23T23:37:42.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9777999999999997e-05 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500190+0000", 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3805000000000001e-05 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.500668+0000", 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00047838500000000001 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.502110+0000", 2024-04-23T23:37:42.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001441538 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.502198+0000", 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8795000000000006e-05 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.502264+0000", 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5182e-05 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:134 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.954204254, 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.005646369, 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 134 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908868+0000", 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908921+0000", 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3291999999999997e-05 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908928+0000", 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.494e-06 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908934+0000", 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1709999999999999e-06 2024-04-23T23:37:42.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.911332+0000", 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0023983490000000001 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.911381+0000", 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8853999999999997e-05 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.911458+0000", 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6386999999999999e-05 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913297+0000", 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001839764 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914438+0000", 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011409020000000001 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914479+0000", 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0272000000000003e-05 2024-04-23T23:37:42.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914514+0000", 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5358000000000003e-05 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:135 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.954127274000001, 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0056667870000000004, 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.927 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 135 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908945+0000", 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908950+0000", 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.938e-06 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908958+0000", 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4619999999999996e-06 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908962+0000", 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4999999999999999e-06 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912086+0000", 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.003123902 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912134+0000", 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8004999999999999e-05 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912234+0000", 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010058800000000001 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913300+0000", 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001065386 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914553+0000", 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001253384 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914587+0000", 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4269e-05 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914611+0000", 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3852000000000001e-05 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.932 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908967+0000", 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.954104552, 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0057567310000000002, 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.933 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 136 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908967+0000", 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908967+0000", 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908968+0000", 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9499999999999998e-07 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908971+0000", 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0450000000000001e-06 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908976+0000", 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5890000000000002e-06 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908981+0000", 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.023e-06 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912655+0000", 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0036738830000000002 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912734+0000", 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8900999999999996e-05 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.912809+0000", 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4720000000000003e-05 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914620+0000", 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018107990000000001 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914640+0000", 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0707999999999999e-05 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914688+0000", 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7667999999999998e-05 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914724+0000", 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6100000000000003e-05 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.938 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.954081815999999, 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0068256499999999999, 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 137 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:42.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.908990+0000", 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7100000000000002e-07 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909062+0000", 2024-04-23T23:37:42.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1987e-05 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909070+0000", 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7039999999999994e-06 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909082+0000", 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1378e-05 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913362+0000", 2024-04-23T23:37:42.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0042799650000000002 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913421+0000", 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9648000000000002e-05 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913506+0000", 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4356000000000003e-05 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914735+0000", 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00122955 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915743+0000", 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010084250000000001 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915776+0000", 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2997000000000003e-05 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915816+0000", 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9168999999999997e-05 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909097+0000", 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.953974754000001, 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0068193960000000001, 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.944 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 138 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909097+0000", 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909097+0000", 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909098+0000", 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1600000000000001e-07 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909105+0000", 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4000000000000003e-06 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909116+0000", 2024-04-23T23:37:42.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.059e-05 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909130+0000", 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4561e-05 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.913996+0000", 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0048654529999999996 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914042+0000", 2024-04-23T23:37:42.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499000000000003e-05 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914127+0000", 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4604999999999994e-05 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915715+0000", 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001588307 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915862+0000", 2024-04-23T23:37:42.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014710400000000001 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915892+0000", 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9674000000000001e-05 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915916+0000", 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4587e-05 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909153+0000", 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.953918865999999, 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0098869300000000004, 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 139 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909153+0000", 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909153+0000", 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909154+0000", 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:37:42.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909158+0000", 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909166+0000", 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5399999999999998e-06 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909172+0000", 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5220000000000004e-06 2024-04-23T23:37:42.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914749+0000", 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0055764309999999997 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914794+0000", 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5376000000000001e-05 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.914870+0000", 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6289000000000001e-05 2024-04-23T23:37:42.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915925+0000", 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010548549999999999 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.918967+0000", 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0030417729999999998 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.918999+0000", 2024-04-23T23:37:42.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1482000000000001e-05 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919040+0000", 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1366999999999999e-05 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909187+0000", 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.953884475999999, 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010263969, 2024-04-23T23:37:42.955 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 140 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909187+0000", 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909187+0000", 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909188+0000", 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909268+0000", 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9665000000000004e-05 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909276+0000", 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7940000000000008e-06 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909288+0000", 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1584e-05 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915141+0000", 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0058528729999999998 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915195+0000", 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3953000000000003e-05 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915275+0000", 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0551999999999997e-05 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.916324+0000", 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001048142 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919386+0000", 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0030625140000000001 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919414+0000", 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7934000000000001e-05 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919451+0000", 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7348999999999998e-05 2024-04-23T23:37:42.960 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.953770000999999, 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010387709, 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 141 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909302+0000", 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7199999999999998e-07 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909307+0000", 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8169999999999998e-06 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909315+0000", 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2749999999999998e-06 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.909322+0000", 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1690000000000003e-06 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915942+0000", 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0066203720000000002 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.915989+0000", 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6523999999999997e-05 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.916080+0000", 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1215e-05 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.916593+0000", 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00051334199999999996 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919632+0000", 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.003039155 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919665+0000", 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2218000000000002e-05 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.919690+0000", 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.495e-05 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:42.966 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:42.968 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:42.980+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:42.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:43.028 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-04-23T23:37:43.040 INFO:teuthology.orchestra.run.smithi077.stdout:699 write 0x2cbc787 thru 0x2cc9540 (0xcdba bytes) 2024-04-23T23:37:43.061 INFO:teuthology.orchestra.run.smithi077.stdout:702 write 0xe1a144f thru 0xe1aaa3e (0x95f0 bytes) 2024-04-23T23:37:43.062 INFO:teuthology.orchestra.run.smithi170.stdout:get_pg_num_history pg_num_history pg_num_history(e24 pg_nums {1={15=1},2={18=8},3={21=32}} deleted_pools ) 2024-04-23T23:37:43.062 INFO:teuthology.orchestra.run.smithi170.stdout:Importing pgid 3.c 2024-04-23T23:37:43.062 INFO:teuthology.orchestra.run.smithi170.stdout:write_pg epoch 24 info 3.c( v 24'6 (0'0,24'6] local-lis/les=21/22 n=0 ec=21/21 lis/c=21/21 les/c/f=22/22/0 sis=21) 2024-04-23T23:37:43.063 INFO:teuthology.orchestra.run.smithi170.stdout:Import successful 2024-04-23T23:37:43.069 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:43.080+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:43.076 INFO:teuthology.orchestra.run.smithi077.stdout:704 read 0x7b37bca thru 0x7b3f5c2 (0x79f9 bytes) 2024-04-23T23:37:43.076 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:43.076 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:43.076 INFO:teuthology.orchestra.run.smithi077.stdout:707 writesame 0x4ba3f17 thru 0x4bb2674 data_size 0x5(0xe75e bytes) 2024-04-23T23:37:43.092 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:43.092 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:43.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:6072 3.1b 3:d912c1ed:::rbd_data.1194ccf776f2.0000000000000132:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,write 132096~5120 in=5120b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.101173+0000", 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0040293400000000002, 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040539149999999999, 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 6072 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101173+0000", 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101173+0000", 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101174+0000", 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4399999999999998e-07 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101182+0000", 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5879999999999998e-06 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101194+0000", 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1426e-05 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101200+0000", 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1040000000000003e-06 2024-04-23T23:37:43.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101263+0000", 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2974999999999999e-05 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101399+0000", 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013599799999999999 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 4", 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.101610+0000", 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000211647 2024-04-23T23:37:43.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.102392+0000", 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00078137900000000001 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:6073 3.1 3:8284a441:::rbd_data.1194ccf776f2.0000000000000133:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,write 132096~5120 in=5120b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.103555+0000", 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0016467529999999999, 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001736095, 2024-04-23T23:37:43.097 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 6073 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103555+0000", 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103555+0000", 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103556+0000", 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1200000000000002e-07 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103562+0000", 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4989999999999999e-06 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103572+0000", 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1980000000000007e-06 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103577+0000", 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.074e-06 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103614+0000", 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500999999999999e-05 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103689+0000", 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5315000000000007e-05 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 4", 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.103801+0000", 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011135499999999999 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.104635+0000", 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00083429999999999995 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.102 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.102 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:37:43.102 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 2 2024-04-23T23:37:43.102 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:43.102 INFO:teuthology.orchestra.run.smithi077.stdout:708 read 0xb33a37d thru 0xb34490e (0xa592 bytes) 2024-04-23T23:37:43.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:43.106 INFO:teuthology.orchestra.run.smithi077.stdout:709 trunc from 0xe55a8d5 to 0x5c4fc3d 2024-04-23T23:37:43.141 INFO:teuthology.orchestra.run.smithi077.stdout:711 writesame 0x914b8e1 thru 0x9159abc data_size 0x62(0xe1dc bytes) 2024-04-23T23:37:43.151 INFO:teuthology.orchestra.run.smithi077.stdout:712 write 0xc60ac71 thru 0xc615ff3 (0xb383 bytes) 2024-04-23T23:37:43.166 INFO:teuthology.orchestra.run.smithi077.stdout:713 write 0xc4d2fb4 thru 0xc4e163e (0xe68b bytes) 2024-04-23T23:37:43.170 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:43.182+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:43.179 INFO:teuthology.orchestra.run.smithi077.stdout:716 read 0xbc7c674 thru 0xbc89a9b (0xd428 bytes) 2024-04-23T23:37:43.179 INFO:teuthology.orchestra.run.smithi077.stdout:717 read 0x8323db4 thru 0x832e307 (0xa554 bytes) 2024-04-23T23:37:43.179 INFO:teuthology.orchestra.run.smithi077.stdout:720 read 0x9965fb5 thru 0x9967343 (0x138f bytes) 2024-04-23T23:37:43.185 INFO:teuthology.orchestra.run.smithi077.stdout:722 write 0xd2e0563 thru 0xd2f0386 (0xfe24 bytes) 2024-04-23T23:37:43.198 INFO:teuthology.orchestra.run.smithi077.stdout:723 read 0x9c469fa thru 0x9c55725 (0xed2c bytes) 2024-04-23T23:37:43.199 INFO:teuthology.orchestra.run.smithi077.stdout:724 read 0x5798a92 thru 0x57a6b18 (0xe087 bytes) 2024-04-23T23:37:43.199 INFO:teuthology.orchestra.run.smithi077.stdout:726 read 0x2556aa4 thru 0x2565f2a (0xf487 bytes) 2024-04-23T23:37:43.199 INFO:teuthology.orchestra.run.smithi077.stdout:727 read 0x98b82d7 thru 0x98bd905 (0x562f bytes) 2024-04-23T23:37:43.199 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:43.199 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:43.199 INFO:teuthology.orchestra.run.smithi077.stdout:730 writesame 0xc6e9eab thru 0xc6f2fee data_size 0x12(0x9144 bytes) 2024-04-23T23:37:43.207 INFO:teuthology.orchestra.run.smithi077.stdout:731 trunc from 0xd2f0387 to 0x8eb3104 2024-04-23T23:37:43.225 INFO:teuthology.orchestra.run.smithi077.stdout:732 trunc from 0x8eb3104 to 0x522a52e 2024-04-23T23:37:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:43.232 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:43.232 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:43.232 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:43.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:43.257 INFO:teuthology.orchestra.run.smithi077.stdout:733 punch from 0x9d5ae7 to 0x9e27fc, (0xcd15 bytes) 2024-04-23T23:37:43.262 INFO:teuthology.orchestra.run.smithi077.stdout:734 trunc from 0x522a52e to 0x9126836 2024-04-23T23:37:43.271 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:43.283+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:43.278 INFO:teuthology.orchestra.run.smithi077.stdout:737 write 0xdea83b5 thru 0xdeaf4ed (0x7139 bytes) 2024-04-23T23:37:43.294 INFO:teuthology.orchestra.run.smithi077.stdout:738 write 0x103466d thru 0x1044599 (0xff2d bytes) 2024-04-23T23:37:43.353 INFO:teuthology.orchestra.run.smithi077.stdout:739 write 0x366a1d2 thru 0x36770eb (0xcf1a bytes) 2024-04-23T23:37:43.368 INFO:teuthology.orchestra.run.smithi077.stdout:740 read 0x7309b13 thru 0x73156f4 (0xbbe2 bytes) 2024-04-23T23:37:43.371 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:43.383+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:43.379 INFO:teuthology.orchestra.run.smithi077.stdout:741 trunc from 0xdeaf4ee to 0x4acf6ec 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2951675030000001, 2024-04-23T23:37:43.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:37:43.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2951538579999999, 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.398 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:43.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:37:43.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:37:43.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2951408080000002, 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.404 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:37:43.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2951297889999998, 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:37:43.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:37:43.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2951207139999998, 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:37:43.412 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.416 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2951087700000001, 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:43.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2950996589999999, 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.421 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:37:43.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:37:43.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:37:43.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2934542869999999, 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:37:43.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2934420380000002, 2024-04-23T23:37:43.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:37:43.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4540 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.433 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892735559999999, 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053214760999999999, 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4540 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2599999999999998e-07 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115188+0000", 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.085e-06 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115191+0000", 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.033e-06 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115194+0000", 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.909e-06 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168391+0000", 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053197041 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168402+0000", 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0366999999999999e-05 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.437 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.289263445, 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:43.441 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892516629999999, 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:43.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:37:43.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:37:43.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892415939999999, 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:37:43.445 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892299349999998, 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.449 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:43.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892206150000001, 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.453 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:37:43.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:37:43.456 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892101029999998, 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.457 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:43.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:37:43.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2892006629999999, 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.461 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:37:43.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.28900557, 2024-04-23T23:37:43.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:37:43.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:37:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:37:43.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2889845370000002, 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.470 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.473 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.2889706470000002, 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:37:43.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:37:43.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.477 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.478 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:43.479 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:43.490+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:43.480 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:43.480 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:744 read 0x44a1637 thru 0x44a9b95 (0x855f bytes) 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:745 trunc from 0x4acf6ec to 0xb2ea4ba 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:747 read 0x5d5e450 thru 0x5d5edd4 (0x985 bytes) 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:748 punch from 0x71c663d to 0x71ce190, (0x7b53 bytes) 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:749 write 0x371d0df thru 0x371d1f4 (0x116 bytes) 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:750 write 0x9d4156f thru 0x9d5113f (0xfbd1 bytes) 2024-04-23T23:37:43.481 INFO:teuthology.orchestra.run.smithi077.stdout:751 write 0xd9e190 thru 0xd9ff85 (0x1df6 bytes) 2024-04-23T23:37:43.492 INFO:teuthology.orchestra.run.smithi077.stdout:752 read 0x865814b thru 0x8665cc0 (0xdb76 bytes) 2024-04-23T23:37:43.492 INFO:teuthology.orchestra.run.smithi077.stdout:753 write 0x9062994 thru 0x90685ff (0x5c6c bytes) 2024-04-23T23:37:43.503 INFO:teuthology.orchestra.run.smithi077.stdout:755 read 0x6e5a64e thru 0x6e670b7 (0xca6a bytes) 2024-04-23T23:37:43.503 INFO:teuthology.orchestra.run.smithi077.stdout:756 writesame 0x82e9235 thru 0x82f4ede data_size 0x3e(0xbcaa bytes) 2024-04-23T23:37:43.515 INFO:teuthology.orchestra.run.smithi077.stdout:758 punch from 0x60d590d to 0x60e49b5, (0xf0a8 bytes) 2024-04-23T23:37:43.515 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:43.515 INFO:teuthology.orchestra.run.smithi077.stdout:762 write 0x7bd4f9b thru 0x7bdac2d (0x5c93 bytes) 2024-04-23T23:37:43.530 INFO:teuthology.orchestra.run.smithi077.stdout:763 write 0x62b56da thru 0x62c2a3b (0xd362 bytes) 2024-04-23T23:37:43.545 INFO:teuthology.orchestra.run.smithi077.stdout:766 write 0x2921365 thru 0x29277b9 (0x6455 bytes) 2024-04-23T23:37:43.558 INFO:teuthology.orchestra.run.smithi077.stdout:767 clone 4 order 25 su 262144 sc 3 2024-04-23T23:37:43.579 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:43.592+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:43.586 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f /var/log/ceph/exp.3.c.5 2024-04-23T23:37:43.607 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:43.607 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:43.607 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:43.607 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:43.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:43.690 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:43.702+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:43.758 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:43.758 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:43.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:43.810 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:43.822+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:43.845 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone3 intact 2024-04-23T23:37:43.880 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1969 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20938752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6957339729999998, 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010883561, 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.881 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1969 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:43.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:37:43.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195332+0000", 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195335+0000", 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8990000000000001e-06 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195337+0000", 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3089999999999998e-06 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206119+0000", 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010781377 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206161+0000", 2024-04-23T23:37:43.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2574999999999998e-05 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206214+0000", 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3273999999999998e-05 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1983 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 16826368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.886 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.695722628, 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010990613999999999, 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1983 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2499999999999999e-07 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195343+0000", 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0750000000000001e-06 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195347+0000", 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2279999999999998e-06 2024-04-23T23:37:43.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195349+0000", 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3750000000000001e-06 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206239+0000", 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010889922 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206281+0000", 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2187000000000001e-05 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206333+0000", 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1601999999999998e-05 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.891 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1984 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17055744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6957127490000001, 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011105459999999999, 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1984 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.892 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.41e-07 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195353+0000", 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.540000000000001e-07 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195357+0000", 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5140000000000002e-06 2024-04-23T23:37:43.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195360+0000", 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.653e-06 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206356+0000", 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010995823 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206394+0000", 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7790000000000002e-05 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206458+0000", 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3485000000000006e-05 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1985 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17285120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6956988069999999, 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011236217999999999, 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.897 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1985 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:43.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195368+0000", 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7859999999999999e-06 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195374+0000", 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1820000000000003e-06 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195386+0000", 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1481000000000001e-05 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206487+0000", 2024-04-23T23:37:43.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011101428 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206547+0000", 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9449e-05 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206602+0000", 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5408999999999998e-05 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.901 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1986 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17514496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6956726849999999, 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011350281, 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.902 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1986 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:43.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195394+0000", 2024-04-23T23:37:43.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.759e-06 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195400+0000", 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9290000000000003e-06 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195404+0000", 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2899999999999996e-06 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206633+0000", 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011228804 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206692+0000", 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8556e-05 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206742+0000", 2024-04-23T23:37:43.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0581999999999998e-05 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1987 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17743872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6956548690000002, 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011463825, 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.907 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1987 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195412+0000", 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195418+0000", 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5979999999999996e-06 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195422+0000", 2024-04-23T23:37:43.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4290000000000003e-06 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206767+0000", 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011344745 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206817+0000", 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9740000000000001e-05 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206874+0000", 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7138000000000001e-05 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1988 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17973248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6956369909999998, 2024-04-23T23:37:43.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011660201, 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1988 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:43.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195430+0000", 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195436+0000", 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7350000000000001e-06 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195440+0000", 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3059999999999999e-06 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206908+0000", 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011467989 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206993+0000", 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4746999999999993e-05 2024-04-23T23:37:43.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207088+0000", 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5391999999999997e-05 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1989 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18202624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:43.917 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6956194880000002, 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011792265999999999, 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1989 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195446+0000", 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195447+0000", 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195453+0000", 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8830000000000003e-06 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195457+0000", 2024-04-23T23:37:43.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0860000000000004e-06 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207122+0000", 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011664737 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207177+0000", 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4632000000000001e-05 2024-04-23T23:37:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207238+0000", 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0859999999999997e-05 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6956003160000002, 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:37:43.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:37:43.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6955707809999998, 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.928 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:37:43.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.932 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6955510079999998, 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.933 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.937 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6955334620000002, 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.938 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:37:43.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.942 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.695515952, 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.943 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:37:43.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6954754140000001, 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:37:43.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:37:43.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.952 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.695461849, 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.953 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6954522509999999, 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:37:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.6954416889999999, 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.695432372, 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:37:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:37:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.695423184, 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:37:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.695408612, 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:37:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:37:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:37:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:43.983 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:43.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:37:43.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:43.986 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-04-23T23:37:43.986 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:43.996+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:44.086 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:44.098+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:44.143 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:44.143 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:44.143 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:44.144 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:44.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:44.158 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:44.159 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:44.177 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:44.177 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:44.186 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:44.198+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:44.195 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:44.195 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:44.212 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:44.212 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:44.230 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:44.231 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:44.231 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-04-23T23:37:44.245 INFO:teuthology.orchestra.run.smithi077.stdout:768 write 0x1adb467 thru 0x1add7d4 (0x236e bytes) 2024-04-23T23:37:44.248 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:44.248 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:44.282 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:44.282 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:44.282 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:44.283 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:44.287 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:44.299+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:44.289 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:37:44.289 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:37:44.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:44.388 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:44.400+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:44.441 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:44.441 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:44.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:44.492 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:44.504+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:44.590 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:44.602+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:44.594 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:44.594 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:44.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:44.691 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:44.703+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:44.706 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:44.706 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:44.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:44.793 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:44.805+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:44.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:37:44.861 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:44.862 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:44.871 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:44.914 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:44.926+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:44.978 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:44.978 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:44.986 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:45.028 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:45.039+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:45.096 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:45.108+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:45.128 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.128 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.137 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:45.197 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:45.209+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:45.240 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.240 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.249 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:45.298 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:45.310+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:45.353 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.353 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:45.399 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:45.411+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:45.465 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.465 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.474 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:45.500 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:45.512+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:45.575 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.575 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.584 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:45.601 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:45.613+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:45.686 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.686 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:45.738 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:45.750+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:45.797 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.797 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.803 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:45.815+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:45.805 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:45.826 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:37:45.904 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:45.916+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:45.948 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:45.949 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:45.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:46.005 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:46.016+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:46.062 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:46.062 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:46.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:46.113 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:46.125+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:46.172 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:46.173 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:46.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:46.207 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:46.220+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:46.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:37:46.326 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:46.326 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:46.327 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:46.339+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:46.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:46.415 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:46.415 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:46.416 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:46.427+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:46.433 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:46.433 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:46.450 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:46.450 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:46.470 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:46.470 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:46.484 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:46.484 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:46.484 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:46.484 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:46.486 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-04-23T23:37:46.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:46.505 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:46.505 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:46.522 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:46.523 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:46.523 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:46.535+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:46.527 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:37:46.527 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:37:46.608 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:46.608 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:46.608 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:46.608 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:46.608 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:46.610 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:46.622+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:46.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:46.711 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:46.723+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:46.761 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:46.761 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:46.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1969 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20938752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.577691164, 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010883561, 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1969 2024-04-23T23:37:46.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195331+0000", 2024-04-23T23:37:46.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195332+0000", 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195335+0000", 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8990000000000001e-06 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195337+0000", 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3089999999999998e-06 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206119+0000", 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010781377 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206161+0000", 2024-04-23T23:37:46.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2574999999999998e-05 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206214+0000", 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3273999999999998e-05 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1983 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 16826368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5776798190000001, 2024-04-23T23:37:46.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010990613999999999, 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1983 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195342+0000", 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2499999999999999e-07 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195343+0000", 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0750000000000001e-06 2024-04-23T23:37:46.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195347+0000", 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2279999999999998e-06 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195349+0000", 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3750000000000001e-06 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206239+0000", 2024-04-23T23:37:46.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010889922 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206281+0000", 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2187000000000001e-05 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206333+0000", 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1601999999999998e-05 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1984 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17055744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5776699399999998, 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011105459999999999, 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1984 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.771 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.41e-07 2024-04-23T23:37:46.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195353+0000", 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.540000000000001e-07 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195357+0000", 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5140000000000002e-06 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195360+0000", 2024-04-23T23:37:46.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.653e-06 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206356+0000", 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010995823 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206394+0000", 2024-04-23T23:37:46.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7790000000000002e-05 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206458+0000", 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3485000000000006e-05 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1985 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17285120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.577655998, 2024-04-23T23:37:46.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011236217999999999, 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1985 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195368+0000", 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7859999999999999e-06 2024-04-23T23:37:46.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195374+0000", 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1820000000000003e-06 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195386+0000", 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1481000000000001e-05 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206487+0000", 2024-04-23T23:37:46.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011101428 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206547+0000", 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9449e-05 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206602+0000", 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5408999999999998e-05 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1986 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17514496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5776298759999996, 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011350281, 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1986 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:37:46.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195394+0000", 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.759e-06 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195400+0000", 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9290000000000003e-06 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195404+0000", 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2899999999999996e-06 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206633+0000", 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011228804 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206692+0000", 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8556e-05 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206742+0000", 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0581999999999998e-05 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1987 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17743872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5776120599999999, 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011463825, 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1987 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195412+0000", 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195418+0000", 2024-04-23T23:37:46.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5979999999999996e-06 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195422+0000", 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4290000000000003e-06 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206767+0000", 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011344745 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206817+0000", 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9740000000000001e-05 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206874+0000", 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7138000000000001e-05 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1988 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17973248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5775941820000003, 2024-04-23T23:37:46.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011660201, 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1988 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195430+0000", 2024-04-23T23:37:46.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195436+0000", 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7350000000000001e-06 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195440+0000", 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3059999999999999e-06 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206908+0000", 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011467989 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206993+0000", 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4746999999999993e-05 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207088+0000", 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5391999999999997e-05 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1989 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18202624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5775766789999999, 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011792265999999999, 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1989 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195446+0000", 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:37:46.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195447+0000", 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195453+0000", 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8830000000000003e-06 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195457+0000", 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0860000000000004e-06 2024-04-23T23:37:46.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207122+0000", 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011664737 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207177+0000", 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4632000000000001e-05 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207238+0000", 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0859999999999997e-05 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.796 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5775575069999999, 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:37:46.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:37:46.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5775279720000004, 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:37:46.801 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:37:46.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5775081990000004, 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.806 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:46.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:37:46.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:37:46.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5774906529999999, 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:37:46.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:37:46.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5774731429999997, 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:37:46.814 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:37:46.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:37:46.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5774326050000003, 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:37:46.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5774190399999997, 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.823 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:37:46.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:37:46.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5774094420000004, 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.827 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.831 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5773988799999996, 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.835 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5773895629999997, 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:37:46.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:37:46.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:37:46.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5773803749999997, 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:37:46.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:37:46.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.5773658030000002, 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:37:46.844 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:46.848 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:46.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:46.850 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:46.862+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:46.951 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:46.963+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:46.954 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:46.954 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:46.954 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:46.954 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:46.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:47.051 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:47.063+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:47.106 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:47.106 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:47.106 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:47.106 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:47.106 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:47.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:47.153 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:47.165+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:47.253 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:47.266+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:47.259 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:47.259 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2770 3.0 e28/21 3:04638217:::rbd_data.1194137ed5d1.0000000000000103:head v 28'8, mlcod=28'6)", 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.9090964970000002, 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033753899999999998, 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361977+0000", 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.167e-06 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361992+0000", 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5685999999999999e-05 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362007+0000", 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4269e-05 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362015+0000", 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362070+0000", 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4750999999999998e-05 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362095+0000", 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4822999999999999e-05 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365317+0000", 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032223009999999999 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365351+0000", 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4029999999999998e-05 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2784 3.0 e28/21 3:05ebc6bc:::rbd_data.1194137ed5d1.000000000000005c:head v 28'9, mlcod=28'7)", 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:47.264 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.8869904499999999, 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031924290000000001, 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:47.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384083+0000", 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5510000000000001e-06 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384091+0000", 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.038e-06 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384108+0000", 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6833999999999998e-05 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384117+0000", 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.833e-06 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384190+0000", 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3208999999999997e-05 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384221+0000", 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1223000000000002e-05 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.387229+0000", 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003008176 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.387274+0000", 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4564999999999998e-05 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.268 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2807 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'5, mlcod=28'3)", 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.8795887679999996, 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044721090000000002, 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:47.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391484+0000", 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5199999999999996e-07 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391489+0000", 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391499+0000", 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9450000000000005e-06 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391505+0000", 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.331e-06 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391560+0000", 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5250000000000001e-05 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391579+0000", 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9049e-05 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395910+0000", 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043312419999999999 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395955+0000", 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4907000000000002e-05 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3490 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'9, mlcod=28'7)", 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.6017967029999998, 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0028448990000000001, 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.273 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669276+0000", 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6199999999999998e-07 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669282+0000", 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7690000000000002e-06 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669294+0000", 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1949e-05 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669300+0000", 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3060000000000003e-06 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669349+0000", 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9555000000000002e-05 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669367+0000", 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7965000000000002e-05 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.672090+0000", 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0027230829999999998 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.672120+0000", 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9709999999999998e-05 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3493 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'16, mlcod=28'13)", 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.6009748459999997, 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047633190000000002, 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670098+0000", 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670103+0000", 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:37:47.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670115+0000", 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.221e-05 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670126+0000", 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0216e-05 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670172+0000", 2024-04-23T23:37:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699000000000001e-05 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670190+0000", 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8074999999999999e-05 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674821+0000", 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046309300000000001 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674860+0000", 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9104999999999999e-05 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3496 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'11, mlcod=24'9)", 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.600584198, 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043762560000000002, 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.282 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:47.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3399999999999998e-07 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670495+0000", 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2349999999999996e-06 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670507+0000", 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2183e-05 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670515+0000", 2024-04-23T23:37:47.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0369999999999995e-06 2024-04-23T23:37:47.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670573+0000", 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8009e-05 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670594+0000", 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0545000000000001e-05 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674832+0000", 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004238192 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674864+0000", 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2320999999999998e-05 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:4024 3.4 e28/21 3:2546d4ff:::rbd_data.1194137ed5d1.0000000000000135:head v 28'16, mlcod=28'14)", 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.2627232770000001, 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042382929999999997, 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.288 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008350+0000", 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0720000000000001e-06 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008364+0000", 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4236000000000001e-05 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008381+0000", 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7070000000000001e-05 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008391+0000", 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7499999999999998e-06 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008452+0000", 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1057999999999997e-05 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008474+0000", 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2521999999999999e-05 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012559+0000", 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040842609999999996 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012587+0000", 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8323999999999999e-05 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5188 3.4 e28/21 3:21d47454:::rbd_data.1194137ed5d1.0000000000000058:head v 28'24, mlcod=28'22)", 2024-04-23T23:37:47.292 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.298579+0000", 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.9724926189999996, 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031562069999999998, 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298579+0000", 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298579+0000", 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298580+0000", 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8500000000000001e-07 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298586+0000", 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2330000000000003e-06 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298601+0000", 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4401e-05 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298608+0000", 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1779999999999997e-06 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298659+0000", 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0757999999999998e-05 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298682+0000", 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3521999999999999e-05 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.301705+0000", 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0030229329999999998 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.301736+0000", 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0497e-05 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5287 3.4 e28/21 3:200b80cf:::rbd_data.1194137ed5d1.0000000000000152:head v 28'26, mlcod=28'24)", 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.8685388119999997, 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042967179999999997, 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.297 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402546+0000", 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3029e-05 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402557+0000", 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0599e-05 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402575+0000", 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7765999999999999e-05 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402583+0000", 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.208e-06 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402989+0000", 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000405993 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.403011+0000", 2024-04-23T23:37:47.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2036e-05 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406781+0000", 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037698950000000001 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406830+0000", 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9191999999999999e-05 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5303 3.4 e28/21 3:21d47454:::rbd_data.1194137ed5d1.0000000000000058:head v 28'27, mlcod=28'25)", 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.8605153229999996, 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0034075889999999999, 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410558+0000", 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410567+0000", 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9089999999999995e-06 2024-04-23T23:37:47.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410584+0000", 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6458999999999999e-05 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410591+0000", 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0489999999999998e-06 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410648+0000", 2024-04-23T23:37:47.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6566e-05 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410667+0000", 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9718999999999999e-05 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.413927+0000", 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032602199999999999 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.413964+0000", 2024-04-23T23:37:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6767000000000002e-05 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5627 3.0 e28/21 3:05b00203:::rbd_data.1194137ed5d1.000000000000002b:head v 28'23, mlcod=28'21)", 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5514146579999997, 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065095700000000001, 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719658+0000", 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719664+0000", 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.998e-06 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719676+0000", 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1494999999999999e-05 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719683+0000", 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0049999999999998e-06 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719730+0000", 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7747999999999998e-05 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719750+0000", 2024-04-23T23:37:47.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9842000000000001e-05 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726120+0000", 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063699480000000003 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726167+0000", 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6802999999999999e-05 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:6080 3.4 e29/21 3:2709b39d:::rbd_data.1194ccf776f2.000000000000038b:head v 29'39, mlcod=29'37)", 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.123842+0000", 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1472303210000003, 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032416229999999999, 2024-04-23T23:37:47.311 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123842+0000", 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123842+0000", 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123843+0000", 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.235e-06 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123854+0000", 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1269e-05 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123873+0000", 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8902999999999998e-05 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123882+0000", 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3829999999999998e-06 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123966+0000", 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3149e-05 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123993+0000", 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6982e-05 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.127050+0000", 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0030569690000000001 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.127083+0000", 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3732999999999997e-05 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:6078 3.9 e29/21 3:90b40801:::rbd_data.1194ccf776f2.0000000000000389:head v 29'28, mlcod=28'26)", 2024-04-23T23:37:47.315 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.123875+0000", 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1471967379999999, 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0027811239999999998, 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123875+0000", 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123875+0000", 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123876+0000", 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6400000000000001e-07 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123884+0000", 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9039999999999992e-06 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123897+0000", 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2546e-05 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123904+0000", 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9709999999999998e-06 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123958+0000", 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4824999999999998e-05 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123986+0000", 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8051999999999998e-05 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.126613+0000", 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0026266079999999999 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.126656+0000", 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3353999999999999e-05 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:6150 3.0 e29/21 3:0303ef61:::rbd_data.1194ccf776f2.000000000000031b:head v 29'27, mlcod=28'25)", 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.170747+0000", 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1003253500000003, 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031032920000000001, 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170747+0000", 2024-04-23T23:37:47.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170747+0000", 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170748+0000", 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.054e-06 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170759+0000", 2024-04-23T23:37:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0978999999999999e-05 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170772+0000", 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3638999999999999e-05 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170780+0000", 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0700000000000007e-06 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170856+0000", 2024-04-23T23:37:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5415999999999998e-05 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170882+0000", 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6174999999999999e-05 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.173804+0000", 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0029216340000000002 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.173850+0000", 2024-04-23T23:37:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6325000000000001e-05 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7147 3.9 e29/21 3:94c47ac8:::rbd_data.1194ccf776f2.00000000000000d5:head v 29'31, mlcod=29'29)", 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.896181785, 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047294210000000001, 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374891+0000", 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.063e-06 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374901+0000", 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0112000000000001e-05 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374916+0000", 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4347e-05 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374925+0000", 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3079999999999997e-06 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374991+0000", 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6264000000000001e-05 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375012+0000", 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0356e-05 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379556+0000", 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045444079999999998 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379620+0000", 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3563000000000001e-05 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7149 3.0 e29/21 3:059b2f37:::rbd_data.1194ccf776f2.00000000000000d7:head v 29'34, mlcod=29'32)", 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.8953033640000001, 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003874508, 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375784+0000", 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4506e-05 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375794+0000", 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0261000000000001e-05 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375800+0000", 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4110000000000001e-06 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375863+0000", 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2825999999999998e-05 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375884+0000", 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1279000000000001e-05 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379601+0000", 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037165829999999999 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379643+0000", 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2033000000000002e-05 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7178 3.4 e29/21 3:21a3b24e:::rbd_data.1194ccf776f2.0000000000000129:head v 29'41, mlcod=29'39)", 2024-04-23T23:37:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.8621555729999999, 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0034548679999999998, 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:37:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408918+0000", 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.176e-06 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408928+0000", 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0844e-05 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408946+0000", 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7495000000000001e-05 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408956+0000", 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0577000000000001e-05 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409018+0000", 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1456000000000002e-05 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409038+0000", 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0268999999999999e-05 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.412323+0000", 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032843130000000001 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.412371+0000", 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8738e-05 2024-04-23T23:37:47.336 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7179 3.4 e29/21 3:266338eb:::rbd_data.1194ccf776f2.000000000000012a:head v 29'42, mlcod=29'39)", 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.8613605839999998, 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076296389999999997, 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.337 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409712+0000", 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6199999999999996e-07 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409718+0000", 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8089999999999998e-06 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409731+0000", 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3016e-05 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409739+0000", 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.503e-06 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409784+0000", 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5209e-05 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409806+0000", 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1820000000000001e-05 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417291+0000", 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074857949999999999 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417341+0000", 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9625e-05 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8092 3.9 e29/21 3:95ff2e9d:::rbd_data.1194ccf776f2.000000000000002c:head v 29'33, mlcod=29'31)", 2024-04-23T23:37:47.341 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.7755521010000002, 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0028729329999999998, 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495521+0000", 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0950000000000001e-06 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495746+0000", 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00022546099999999999 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495761+0000", 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4100999999999999e-05 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495768+0000", 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9480000000000008e-06 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495826+0000", 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7456e-05 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495850+0000", 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4096000000000001e-05 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.498357+0000", 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025072050000000002 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.498393+0000", 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5571000000000002e-05 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8160 3.4 e29/21 3:2138fb15:::rbd_data.1194ccf776f2.00000000000001f3:head v 29'44, mlcod=29'42)", 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.734127414, 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039317429999999997, 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536946+0000", 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.314e-06 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536958+0000", 2024-04-23T23:37:47.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1821000000000001e-05 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536984+0000", 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5986000000000002e-05 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536992+0000", 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6719999999999993e-06 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537058+0000", 2024-04-23T23:37:47.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5246000000000005e-05 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537083+0000", 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5282e-05 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540835+0000", 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037519129999999999 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540876+0000", 2024-04-23T23:37:47.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:37:47.350 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.350 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.350 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.350 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.350 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.350 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:47.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:47.395 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:47.407+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:47.455 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:47.455 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:47.455 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:47.455 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:47.455 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:47.467+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:47.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:47.556 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:47.569+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:47.607 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:47.607 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:47.607 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:47.607 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:47.608 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:47.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:47.657 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:47.670+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:47.758 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:47.770+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:47.761 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:47.762 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:47.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:47.762 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:47.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.762 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3238 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4161536~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.763 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:47.763 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3200851499999997, 2024-04-23T23:37:47.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029291145000000001, 2024-04-23T23:37:47.763 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.763 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.764 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.764 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3238 2024-04-23T23:37:47.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.765 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:47.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:47.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:37:47.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452574+0000", 2024-04-23T23:37:47.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:37:47.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452582+0000", 2024-04-23T23:37:47.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8930000000000005e-06 2024-04-23T23:37:47.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452587+0000", 2024-04-23T23:37:47.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3000000000000001e-06 2024-04-23T23:37:47.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481755+0000", 2024-04-23T23:37:47.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029167226000000001 2024-04-23T23:37:47.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481797+0000", 2024-04-23T23:37:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2651999999999998e-05 2024-04-23T23:37:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481863+0000", 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5685999999999994e-05 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3252 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 49152~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3200627709999999, 2024-04-23T23:37:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029578383999999999, 2024-04-23T23:37:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.774 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.774 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.775 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3252 2024-04-23T23:37:47.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.775 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:47.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:47.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452595+0000", 2024-04-23T23:37:47.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:37:47.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452597+0000", 2024-04-23T23:37:47.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:37:47.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452604+0000", 2024-04-23T23:37:47.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2660000000000004e-06 2024-04-23T23:37:47.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452610+0000", 2024-04-23T23:37:47.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8429999999999998e-06 2024-04-23T23:37:47.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481898+0000", 2024-04-23T23:37:47.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029288338000000001 2024-04-23T23:37:47.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482013+0000", 2024-04-23T23:37:47.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000114746 2024-04-23T23:37:47.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482172+0000", 2024-04-23T23:37:47.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015978300000000001 2024-04-23T23:37:47.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.783 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3253 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 278528~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3200410070000004, 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029686714999999999, 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3253 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452618+0000", 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1210000000000001e-06 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452627+0000", 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3489999999999992e-06 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452632+0000", 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1479999999999997e-06 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482187+0000", 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029555272 2024-04-23T23:37:47.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482230+0000", 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2750999999999998e-05 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482303+0000", 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2669000000000005e-05 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3254 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 507904~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.32001831, 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029953305999999999, 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.791 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3254 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452641+0000", 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1459999999999999e-06 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452647+0000", 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2620000000000004e-06 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452652+0000", 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482338+0000", 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029685554999999999 2024-04-23T23:37:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482432+0000", 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4643999999999997e-05 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482592+0000", 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015951100000000001 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3255 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 737280~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3199981999999997, 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030178470999999998, 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3255 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:47.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452661+0000", 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452667+0000", 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2639999999999997e-06 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452672+0000", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.848e-06 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482635+0000", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029962494999999999 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482709+0000", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4445999999999998e-05 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482837+0000", 2024-04-23T23:37:47.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012805100000000001 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3256 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 966656~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3199631409999997, 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030449868000000001, 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3256 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3900000000000004e-07 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452697+0000", 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452704+0000", 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.362e-06 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452710+0000", 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5609999999999998e-06 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482891+0000", 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030181050000000001 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482991+0000", 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9586000000000005e-05 2024-04-23T23:37:47.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483144+0000", 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015305000000000001 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3257 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1196032~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.319939679, 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030595397999999999, 2024-04-23T23:37:47.804 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3257 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452718+0000", 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452724+0000", 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452730+0000", 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5320000000000003e-06 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452738+0000", 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7579999999999992e-06 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483178+0000", 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030439931 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483232+0000", 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3695e-05 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483313+0000", 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0858000000000004e-05 2024-04-23T23:37:47.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3258 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1425408~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3199110620000001, 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030867680000000002, 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3258 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:47.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:47.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:37:47.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452748+0000", 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452765+0000", 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7003e-05 2024-04-23T23:37:47.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452771+0000", 2024-04-23T23:37:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:37:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483351+0000", 2024-04-23T23:37:47.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030579967999999999 2024-04-23T23:37:47.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483453+0000", 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010173100000000001 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483613+0000", 2024-04-23T23:37:47.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016066400000000001 2024-04-23T23:37:47.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.817 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.817 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3259 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1654784~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.818 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:47.818 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3198788029999999, 2024-04-23T23:37:47.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031145740000000002, 2024-04-23T23:37:47.818 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.818 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3259 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.819 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452779+0000", 2024-04-23T23:37:47.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:37:47.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452781+0000", 2024-04-23T23:37:47.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0360000000000001e-06 2024-04-23T23:37:47.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452787+0000", 2024-04-23T23:37:47.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2809999999999997e-06 2024-04-23T23:37:47.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452793+0000", 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0870000000000003e-06 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483651+0000", 2024-04-23T23:37:47.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030858239999999999 2024-04-23T23:37:47.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483759+0000", 2024-04-23T23:37:47.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107533 2024-04-23T23:37:47.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483924+0000", 2024-04-23T23:37:47.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016508199999999999 2024-04-23T23:37:47.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.827 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.827 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3260 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1884160~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.828 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:47.828 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3198556650000004, 2024-04-23T23:37:47.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031422796000000003, 2024-04-23T23:37:47.828 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.828 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.828 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.829 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3260 2024-04-23T23:37:47.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.829 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:47.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452802+0000", 2024-04-23T23:37:47.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.72e-07 2024-04-23T23:37:47.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452804+0000", 2024-04-23T23:37:47.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.979e-06 2024-04-23T23:37:47.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452811+0000", 2024-04-23T23:37:47.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0319999999999998e-06 2024-04-23T23:37:47.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452816+0000", 2024-04-23T23:37:47.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:37:47.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483962+0000", 2024-04-23T23:37:47.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031146258999999999 2024-04-23T23:37:47.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484069+0000", 2024-04-23T23:37:47.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106846 2024-04-23T23:37:47.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484224+0000", 2024-04-23T23:37:47.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015536799999999999 2024-04-23T23:37:47.837 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.837 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.837 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3261 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2113536~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3198355629999998, 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031579572, 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.838 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3261 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452822+0000", 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452824+0000", 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8419999999999999e-06 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452829+0000", 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7089999999999999e-06 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452835+0000", 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3120000000000001e-06 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484254+0000", 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031419152999999998 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484305+0000", 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1363000000000003e-05 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484401+0000", 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5784000000000003e-05 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.842 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3262 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2342912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3198161949999996, 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031829887000000001, 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3262 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452843+0000", 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452852+0000", 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5189999999999992e-06 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452857+0000", 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1259999999999997e-06 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484440+0000", 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031583133999999999 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484537+0000", 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7248000000000001e-05 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484671+0000", 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013340800000000001 2024-04-23T23:37:47.846 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3263 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2572288~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3197914419999996, 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032059593999999997, 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.847 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3263 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452866+0000", 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452868+0000", 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1560000000000002e-06 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452875+0000", 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5209999999999999e-06 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452879+0000", 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484704+0000", 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031825141000000001 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484797+0000", 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3107000000000002e-05 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484925+0000", 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000127711 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3264 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2801664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3197646179999998, 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032190086, 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.851 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3264 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452893+0000", 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452895+0000", 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.367e-06 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452902+0000", 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1919999999999999e-06 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452908+0000", 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.152e-06 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484951+0000", 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032043673000000002 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485011+0000", 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9840999999999998e-05 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485082+0000", 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1308000000000002e-05 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3265 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3031040~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.855 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3197425139999996, 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032433114999999998, 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3265 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452915+0000", 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9399999999999995e-07 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452917+0000", 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0650000000000001e-06 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452923+0000", 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5010000000000001e-06 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452928+0000", 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.746e-06 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485122+0000", 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032193745000000003 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485218+0000", 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6427000000000004e-05 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485347+0000", 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012913700000000001 2024-04-23T23:37:47.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3266 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3260416~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3197226979999996, 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032550864999999998, 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3266 2024-04-23T23:37:47.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452935+0000", 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:37:47.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452937+0000", 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452943+0000", 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0630000000000002e-06 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452947+0000", 2024-04-23T23:37:47.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7079999999999996e-06 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485376+0000", 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032428750999999999 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485423+0000", 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6597999999999997e-05 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485485+0000", 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2297000000000003e-05 2024-04-23T23:37:47.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3267 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3489792~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3197036940000002, 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032811840000000002, 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3267 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452954+0000", 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452955+0000", 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.877e-06 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452962+0000", 2024-04-23T23:37:47.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6760000000000001e-06 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452966+0000", 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3089999999999997e-06 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485525+0000", 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032558746 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485632+0000", 2024-04-23T23:37:47.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107179 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485765+0000", 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013261600000000001 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3268 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3719168~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3196796260000001, 2024-04-23T23:37:47.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032909676999999998, 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3268 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452978+0000", 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452980+0000", 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2290000000000002e-06 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452987+0000", 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5869999999999998e-06 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452992+0000", 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9949999999999996e-06 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485780+0000", 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032788386000000003 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485826+0000", 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5744000000000001e-05 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485887+0000", 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1254999999999995e-05 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3269 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3948544~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3196577850000004, 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033158813000000002, 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3269 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.873 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453000+0000", 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453007+0000", 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2320000000000004e-06 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453015+0000", 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453020+0000", 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485924+0000", 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032904299999999997 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486025+0000", 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101184 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486158+0000", 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000132521 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3270 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4177920~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.3196302080000004, 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033252354999999997, 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:47.877 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3270 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453029+0000", 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0430000000000002e-06 2024-04-23T23:37:47.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453036+0000", 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.545e-06 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453040+0000", 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6450000000000004e-06 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486175+0000", 2024-04-23T23:37:47.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033134469999999999 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486220+0000", 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000001e-05 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486279+0000", 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9021999999999998e-05 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:47.882 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:47.882 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:47.882 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:37:47.884 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:47.884 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:47.894+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:47.984 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:47.995+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:47.997 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:47.997 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:47.997 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:47.998 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:48.007 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:48.091 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:48.104+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:48.149 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:48.150 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:48.158 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:48.200 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:48.212+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:48.287 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:48.298+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:48.303 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:48.303 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8026 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461429+0000", 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8534006099999996, 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020354695999999999, 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.304 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8026 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461429+0000", 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461429+0000", 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461430+0000", 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.77e-07 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461431+0000", 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6700000000000001e-06 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461437+0000", 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8139999999999997e-06 2024-04-23T23:37:48.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461442+0000", 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481611+0000", 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020168875999999999 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481658+0000", 2024-04-23T23:37:48.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6486000000000002e-05 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481784+0000", 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000126458 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8027 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 468992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:48.308 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8533820910000003, 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020482334000000001, 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8027 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.41e-07 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461450+0000", 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.751e-06 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461455+0000", 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3009999999999997e-06 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461460+0000", 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9880000000000004e-06 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481817+0000", 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020356537000000001 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481863+0000", 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5799e-05 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481930+0000", 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7617e-05 2024-04-23T23:37:48.312 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8028 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 481280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461473+0000", 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8533567230000001, 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020641717, 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.313 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8028 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461473+0000", 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461473+0000", 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461474+0000", 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.08e-07 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461476+0000", 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.906e-06 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461491+0000", 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5693e-05 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.101e-06 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481957+0000", 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020460328 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482018+0000", 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1527999999999998e-05 2024-04-23T23:37:48.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482115+0000", 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6753e-05 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8029 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 493568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8533263629999999, 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020746667999999999, 2024-04-23T23:37:48.317 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8029 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461510+0000", 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999998e-06 2024-04-23T23:37:48.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461516+0000", 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0360000000000003e-06 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4469e-05 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482142+0000", 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020611055999999999 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482191+0000", 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9067999999999998e-05 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482250+0000", 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9567000000000001e-05 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8030 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 504832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8532894850000003, 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020899725000000001, 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8030 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.322 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:48.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461543+0000", 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1509999999999998e-06 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461554+0000", 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0421999999999999e-05 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461559+0000", 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1139999999999997e-06 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482272+0000", 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020713490000000001 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482328+0000", 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5730999999999999e-05 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482440+0000", 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112285 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8070 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 332800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8529796190000001, 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020265561000000001, 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.326 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8070 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:48.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461851+0000", 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461853+0000", 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2369999999999999e-06 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461859+0000", 2024-04-23T23:37:48.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2330000000000003e-06 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461864+0000", 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000004e-06 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481911+0000", 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020046443000000001 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481987+0000", 2024-04-23T23:37:48.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5870000000000004e-05 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482116+0000", 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000129216 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8071 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 345088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8529581769999997, 2024-04-23T23:37:48.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020492335, 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8071 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461874+0000", 2024-04-23T23:37:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461880+0000", 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6879999999999996e-06 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461885+0000", 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482156+0000", 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020271078000000001 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482250+0000", 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3821999999999997e-05 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482364+0000", 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011427800000000001 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8072 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 356352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462106+0000", 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8527238740000005, 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020503117000000001, 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8072 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.335 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462106+0000", 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462106+0000", 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462107+0000", 2024-04-23T23:37:48.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0800000000000003e-07 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462112+0000", 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.566e-06 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462121+0000", 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3850000000000008e-06 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462128+0000", 2024-04-23T23:37:48.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8600000000000004e-06 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482396+0000", 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020268327999999999 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482477+0000", 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0647000000000002e-05 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482609+0000", 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000132423 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8073 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 368640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8526900360000003, 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020640645999999999, 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8073 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:48.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462143+0000", 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462150+0000", 2024-04-23T23:37:48.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.725e-06 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462155+0000", 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5289999999999999e-06 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482648+0000", 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020492632 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482698+0000", 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0129000000000001e-05 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482781+0000", 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2730000000000002e-05 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8074 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 380928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462163+0000", 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8526669470000003, 2024-04-23T23:37:48.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020857049999999999, 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8074 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462163+0000", 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462163+0000", 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462164+0000", 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462166+0000", 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1519999999999999e-06 2024-04-23T23:37:48.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462172+0000", 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0100000000000001e-06 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462177+0000", 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9760000000000003e-06 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482818+0000", 2024-04-23T23:37:48.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020640815999999999 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482890+0000", 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2773000000000003e-05 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483020+0000", 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000129822 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8075 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 392192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8526470679999996, 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021029776999999999, 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8075 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:37:48.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462185+0000", 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8959999999999999e-06 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462191+0000", 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8880000000000002e-06 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462196+0000", 2024-04-23T23:37:48.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.322e-06 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483055+0000", 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020858752000000001 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483101+0000", 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6068e-05 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483213+0000", 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000111457 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8076 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 404480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462202+0000", 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8526276020000001, 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021253905, 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8076 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462202+0000", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462202+0000", 2024-04-23T23:37:48.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462203+0000", 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2300000000000002e-07 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462205+0000", 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.751e-06 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462210+0000", 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9320000000000001e-06 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462215+0000", 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.797e-06 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483249+0000", 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021033998000000002 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483327+0000", 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7702999999999998e-05 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483456+0000", 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012940099999999999 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8077 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 416768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.356 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8526093079999999, 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021481496999999999, 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8077 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:48.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462223+0000", 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462229+0000", 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5470000000000004e-06 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462233+0000", 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.464e-06 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483496+0000", 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021262976999999999 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483550+0000", 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3687000000000003e-05 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483702+0000", 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000152473 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8078 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 429056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462239+0000", 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.852590706, 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021693659000000001, 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.361 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8078 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462239+0000", 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462239+0000", 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462240+0000", 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462242+0000", 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462247+0000", 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999996e-06 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462250+0000", 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2459999999999999e-06 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483726+0000", 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021475675999999999 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483802+0000", 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6281999999999999e-05 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483933+0000", 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000131216 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8079 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 440320~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8525729020000004, 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021858498000000001, 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.365 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8079 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.22e-07 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462259+0000", 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4300000000000001e-06 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462263+0000", 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1629999999999998e-06 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462266+0000", 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3469999999999999e-06 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483972+0000", 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021706010000000001 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484027+0000", 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4799999999999997e-05 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484116+0000", 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8425999999999997e-05 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.369 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8080 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 452608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.85256037, 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022071971999999999, 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8080 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6899999999999998e-07 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462277+0000", 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462280+0000", 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3440000000000001e-06 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462283+0000", 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0680000000000001e-06 2024-04-23T23:37:48.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484137+0000", 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021854057 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484212+0000", 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5278000000000007e-05 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484342+0000", 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012923599999999999 2024-04-23T23:37:48.373 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8081 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 464896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462286+0000", 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8525436529999997, 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022272047, 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8081 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462286+0000", 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462286+0000", 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462287+0000", 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462288+0000", 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0699999999999999e-06 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462291+0000", 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9909999999999998e-06 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462293+0000", 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6230000000000001e-06 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484382+0000", 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022088785 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484473+0000", 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0708e-05 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484558+0000", 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5599000000000005e-05 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8082 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 477184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8525115039999998, 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022459004000000001, 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.378 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8082 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6399999999999998e-07 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462324+0000", 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.468e-06 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462330+0000", 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4330000000000003e-06 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462333+0000", 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7870000000000002e-06 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484591+0000", 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022258654999999999 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484669+0000", 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7718000000000004e-05 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484778+0000", 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010857900000000001 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8083 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 488448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462337+0000", 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8524930030000002, 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022660907000000001, 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8083 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462337+0000", 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462337+0000", 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462338+0000", 2024-04-23T23:37:48.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8500000000000002e-07 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462339+0000", 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.719e-06 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462345+0000", 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462349+0000", 2024-04-23T23:37:48.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5539999999999999e-06 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484808+0000", 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022458507999999999 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484872+0000", 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4559000000000003e-05 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484998+0000", 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012548099999999999 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8084 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 500736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.8524750619999999, 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022852787999999999, 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:48.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8084 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:48.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4700000000000002e-07 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462357+0000", 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.72e-06 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462363+0000", 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2310000000000001e-06 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462369+0000", 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4500000000000003e-06 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.485024+0000", 2024-04-23T23:37:48.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022654839 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.485100+0000", 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6051999999999996e-05 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.485208+0000", 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000108149 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:48.391 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:48.392 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:48.393 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:48.394 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:48.404+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:48.472 INFO:teuthology.orchestra.run.smithi077.stdout:769 read 0xa5b37b7 thru 0xa5b9e6c (0x66b6 bytes) 2024-04-23T23:37:48.472 INFO:teuthology.orchestra.run.smithi077.stdout:770 read 0x65e230c thru 0x65e4401 (0x20f6 bytes) 2024-04-23T23:37:48.472 INFO:teuthology.orchestra.run.smithi077.stdout:771 writesame 0x4c9fbfc thru 0x4cacf98 data_size 0x47(0xd39d bytes) 2024-04-23T23:37:48.494 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:48.506+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:48.516 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:48.516 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:48.516 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:48.516 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:48.528 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:48.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:37:48.594 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:48.605+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:48.650 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2024-04-23T23:37:48.650 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:37:48.650 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2024-04-23T23:37:48.650 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-23T23:37:48.650 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-23T23:37:48.651 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:48.651 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:48.653 INFO:tasks.ceph.osd.5:Started 2024-04-23T23:37:48.654 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:37:48.668 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:48.668 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:48.673 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:48.673 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:48.684 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:48.684 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:48.684 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:48.701 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:48.701 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:48.718 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:48.718 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:48.718 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-04-23T23:37:48.724 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:48.737+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:48.735 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:48.735 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:48.752 INFO:teuthology.orchestra.run.smithi170.stderr:no valid command found; 10 closest matches: 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:0 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:1 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:2 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:abort 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:assert 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:config diff 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:config diff get 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:config get 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:config help [] 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:config set ... 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi170.stderr:admin_socket: invalid command 2024-04-23T23:37:48.753 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:48.754 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:48.755 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:37:48.755 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2024-04-23T23:37:48.757 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:37:48.757 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:37:48.796 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:48.809+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:48.827 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:48.827 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:48.838 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:48.840 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:37:48.921 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:48.934+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:48.980 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:48.981 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:48.989 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:48.998 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:49.009+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:49.099 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:49.110+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:49.132 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.132 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.141 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:49.200 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:49.211+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:49.242 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.243 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.247 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:49.260+0000 7f59c9c1f640 -1 Falling back to public interface 2024-04-23T23:37:49.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:49.301 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:49.313+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:49.356 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.356 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:49.406 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:49.418+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:49.502 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:49.515+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:49.508 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.508 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:49.603 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:49.616+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:49.620 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.620 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:49.704 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:49.717+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:49.732 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.732 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:49.805 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:49.817+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:49.844 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.844 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:49.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:49.937 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:49.949+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:49.997 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:49.997 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:50.007 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:50.018+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:50.107 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:50.119+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:50.149 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:50.207 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:50.220+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:50.301 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:50.301 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.308 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:50.321+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:50.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:50.409 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:50.422+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:50.453 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:50.453 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:50.511 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:50.523+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:50.605 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:50.606 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.612 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:50.624+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:50.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:50.713 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:50.725+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:50.757 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:50.757 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:37:50.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:50.850 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:50.862+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:50.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:37:50.899 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:50.899 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:50.914 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:50.927+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:50.916 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:50.917 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:50.918 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:50.926 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:50.936 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:50.936 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:50.953 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:50.953 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:50.992 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:50.993 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-04-23T23:37:51.016 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:51.028+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:51.016 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:51.017 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:51.035 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:51.036 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:51.038 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:37:51.039 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:37:51.044 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:51.044 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:51.044 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:51.044 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:51.053 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:51.117 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:51.129+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:51.197 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:51.197 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:51.197 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:51.197 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:51.198 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:51.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:51.249 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:51.262+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8026 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 456704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461429+0000", 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8598340140000005, 2024-04-23T23:37:51.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020354695999999999, 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8026 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461429+0000", 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461429+0000", 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461430+0000", 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.77e-07 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461431+0000", 2024-04-23T23:37:51.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6700000000000001e-06 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461437+0000", 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8139999999999997e-06 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461442+0000", 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481611+0000", 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020168875999999999 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481658+0000", 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6486000000000002e-05 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481784+0000", 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000126458 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.314 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8027 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 468992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8598154950000003, 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020482334000000001, 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8027 2024-04-23T23:37:51.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461448+0000", 2024-04-23T23:37:51.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.41e-07 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461450+0000", 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.751e-06 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461455+0000", 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3009999999999997e-06 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461460+0000", 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9880000000000004e-06 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481817+0000", 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020356537000000001 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481863+0000", 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5799e-05 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481930+0000", 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7617e-05 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8028 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 481280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461473+0000", 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8597901270000001, 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020641717, 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.319 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8028 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461473+0000", 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461473+0000", 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461474+0000", 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.08e-07 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461476+0000", 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.906e-06 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461491+0000", 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5693e-05 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.101e-06 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481957+0000", 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020460328 2024-04-23T23:37:51.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482018+0000", 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1527999999999998e-05 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482115+0000", 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6753e-05 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8029 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 493568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8597597669999999, 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020746667999999999, 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8029 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.324 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461504+0000", 2024-04-23T23:37:51.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461510+0000", 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999998e-06 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461516+0000", 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0360000000000003e-06 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4469e-05 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482142+0000", 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020611055999999999 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482191+0000", 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9067999999999998e-05 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482250+0000", 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9567000000000001e-05 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8030 3.1c 3:3dad0c9e:::rbd_data.1194137ed5d1.0000000000000015:5 [read 504832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8597228890000004, 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020899725000000001, 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.328 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8030 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:51.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461543+0000", 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1509999999999998e-06 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461554+0000", 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0421999999999999e-05 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461559+0000", 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1139999999999997e-06 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482272+0000", 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020713490000000001 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482328+0000", 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5730999999999999e-05 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482440+0000", 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112285 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8070 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 332800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.332 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8594130230000001, 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020265561000000001, 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8070 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461851+0000", 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461853+0000", 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2369999999999999e-06 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461859+0000", 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2330000000000003e-06 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461864+0000", 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000004e-06 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481911+0000", 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020046443000000001 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.481987+0000", 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5870000000000004e-05 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482116+0000", 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000129216 2024-04-23T23:37:51.336 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8071 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 345088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8593915809999997, 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020492335, 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8071 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461872+0000", 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461874+0000", 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461880+0000", 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6879999999999996e-06 2024-04-23T23:37:51.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461885+0000", 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482156+0000", 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020271078000000001 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482250+0000", 2024-04-23T23:37:51.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3821999999999997e-05 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482364+0000", 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011427800000000001 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8072 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 356352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462106+0000", 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8591572779999996, 2024-04-23T23:37:51.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020503117000000001, 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8072 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462106+0000", 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462106+0000", 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462107+0000", 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0800000000000003e-07 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462112+0000", 2024-04-23T23:37:51.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.566e-06 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462121+0000", 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3850000000000008e-06 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462128+0000", 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8600000000000004e-06 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482396+0000", 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020268327999999999 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482477+0000", 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0647000000000002e-05 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482609+0000", 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000132423 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8073 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 368640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8591234400000003, 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020640645999999999, 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8073 2024-04-23T23:37:51.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462140+0000", 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462143+0000", 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462150+0000", 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.725e-06 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462155+0000", 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5289999999999999e-06 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482648+0000", 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020492632 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482698+0000", 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0129000000000001e-05 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482781+0000", 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2730000000000002e-05 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8074 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 380928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462163+0000", 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8591003510000004, 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020857049999999999, 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8074 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462163+0000", 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462163+0000", 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462164+0000", 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462166+0000", 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1519999999999999e-06 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462172+0000", 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0100000000000001e-06 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462177+0000", 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9760000000000003e-06 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482818+0000", 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020640815999999999 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.482890+0000", 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2773000000000003e-05 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483020+0000", 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000129822 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.354 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8075 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 392192~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8590804720000005, 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021029776999999999, 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8075 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462183+0000", 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462185+0000", 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8959999999999999e-06 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462191+0000", 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8880000000000002e-06 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462196+0000", 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.322e-06 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483055+0000", 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020858752000000001 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483101+0000", 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6068e-05 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483213+0000", 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000111457 2024-04-23T23:37:51.358 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8076 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 404480~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462202+0000", 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8590610060000001, 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021253905, 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8076 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462202+0000", 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462202+0000", 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462203+0000", 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2300000000000002e-07 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462205+0000", 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.751e-06 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462210+0000", 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9320000000000001e-06 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462215+0000", 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.797e-06 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483249+0000", 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021033998000000002 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483327+0000", 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7702999999999998e-05 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483456+0000", 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012940099999999999 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8077 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 416768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8590427119999999, 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021481496999999999, 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.363 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8077 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462221+0000", 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462223+0000", 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462229+0000", 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5470000000000004e-06 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462233+0000", 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.464e-06 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483496+0000", 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021262976999999999 2024-04-23T23:37:51.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483550+0000", 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3687000000000003e-05 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483702+0000", 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000152473 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8078 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 429056~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462239+0000", 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.85902411, 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021693659000000001, 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8078 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462239+0000", 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462239+0000", 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462240+0000", 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:37:51.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462242+0000", 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462247+0000", 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999996e-06 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462250+0000", 2024-04-23T23:37:51.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2459999999999999e-06 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483726+0000", 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021475675999999999 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483802+0000", 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6281999999999999e-05 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483933+0000", 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000131216 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8079 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 440320~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8590063060000004, 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021858498000000001, 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8079 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462257+0000", 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.22e-07 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462259+0000", 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4300000000000001e-06 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462263+0000", 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1629999999999998e-06 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462266+0000", 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3469999999999999e-06 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.483972+0000", 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021706010000000001 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484027+0000", 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4799999999999997e-05 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484116+0000", 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8425999999999997e-05 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.376 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8080 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 452608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.858993774, 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022071971999999999, 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8080 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462270+0000", 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6899999999999998e-07 2024-04-23T23:37:51.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462277+0000", 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462280+0000", 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3440000000000001e-06 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462283+0000", 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0680000000000001e-06 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484137+0000", 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021854057 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484212+0000", 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5278000000000007e-05 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484342+0000", 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012923599999999999 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8081 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 464896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462286+0000", 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8589770569999997, 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022272047, 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.381 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8081 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462286+0000", 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462286+0000", 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462287+0000", 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462288+0000", 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0699999999999999e-06 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462291+0000", 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9909999999999998e-06 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462293+0000", 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6230000000000001e-06 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484382+0000", 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022088785 2024-04-23T23:37:51.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484473+0000", 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0708e-05 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484558+0000", 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5599000000000005e-05 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8082 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 477184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8589449079999998, 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022459004000000001, 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8082 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462319+0000", 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6399999999999998e-07 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462324+0000", 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.468e-06 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462330+0000", 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4330000000000003e-06 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462333+0000", 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7870000000000002e-06 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484591+0000", 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022258654999999999 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484669+0000", 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7718000000000004e-05 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484778+0000", 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010857900000000001 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8083 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 488448~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462337+0000", 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8589264070000002, 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022660907000000001, 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.390 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8083 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462337+0000", 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462337+0000", 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462338+0000", 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8500000000000002e-07 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462339+0000", 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.719e-06 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462345+0000", 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462349+0000", 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5539999999999999e-06 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484808+0000", 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022458507999999999 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484872+0000", 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4559000000000003e-05 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.484998+0000", 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012548099999999999 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8084 3.1d 3:b9027eba:::rbd_data.1194137ed5d1.0000000000000018:5 [read 500736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:51.394 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.8589084659999999, 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022852787999999999, 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8084 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462355+0000", 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4700000000000002e-07 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462357+0000", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.72e-06 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462363+0000", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2310000000000001e-06 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462369+0000", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4500000000000003e-06 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.485024+0000", 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022654839 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.485100+0000", 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6051999999999996e-05 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.485208+0000", 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000108149 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.399 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.399 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.399 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.399 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:51.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:51.401 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:51.412+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:51.501 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:51.513+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:51.543 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:51.543 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:51.543 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:51.543 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:51.551 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:51.602 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:51.615+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:51.656 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:51.657 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:51.665 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:51.703 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:51.715+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:51.804 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:51.817+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:51.809 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:51.809 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:51.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11437 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 517120~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.497866+0000", 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3230372290000001, 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024847178000000001, 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11437 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497866+0000", 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497866+0000", 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497867+0000", 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497868+0000", 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.739e-06 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497876+0000", 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6070000000000002e-06 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497881+0000", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7960000000000003e-06 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522551+0000", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024670128 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522617+0000", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5611999999999995e-05 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522714+0000", 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6898000000000006e-05 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11450 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 458752~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.497887+0000", 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3230164950000001, 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025025329999999998, 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.814 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11450 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497887+0000", 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497887+0000", 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497888+0000", 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497889+0000", 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.939e-06 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497899+0000", 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7350000000000008e-06 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497904+0000", 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7350000000000004e-06 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522740+0000", 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024835893000000001 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522814+0000", 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3767e-05 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522912+0000", 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8826999999999994e-05 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11451 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 470016~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.497910+0000", 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3229935579999998, 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025199788000000001, 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.818 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11451 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497910+0000", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497910+0000", 2024-04-23T23:37:51.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497910+0000", 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5199999999999998e-07 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497918+0000", 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7940000000000003e-06 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497926+0000", 2024-04-23T23:37:51.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9519999999999994e-06 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497931+0000", 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9269999999999996e-06 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.522942+0000", 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025011327 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523011+0000", 2024-04-23T23:37:51.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8244000000000006e-05 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523110+0000", 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9191999999999995e-05 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11455 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 518144~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.497938+0000", 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3229658679999998, 2024-04-23T23:37:51.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025372095000000001, 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11455 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497938+0000", 2024-04-23T23:37:51.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497938+0000", 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497938+0000", 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5900000000000003e-07 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497940+0000", 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6619999999999999e-06 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497946+0000", 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9279999999999998e-06 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497951+0000", 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8810000000000004e-06 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523138+0000", 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025187958 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523215+0000", 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6062999999999993e-05 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523310+0000", 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5243999999999998e-05 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.826 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11467 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 459776~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.497960+0000", 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3229432700000001, 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025551592000000001, 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11467 2024-04-23T23:37:51.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497960+0000", 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497960+0000", 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497961+0000", 2024-04-23T23:37:51.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497968+0000", 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.973e-06 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497975+0000", 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.939e-06 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497980+0000", 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9370000000000003e-06 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523340+0000", 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025360780999999999 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523415+0000", 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4308999999999996e-05 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523512+0000", 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7233999999999998e-05 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11468 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 471040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.497986+0000", 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.322917533, 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025719041000000002, 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11468 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497986+0000", 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497986+0000", 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497986+0000", 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497989+0000", 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1090000000000001e-06 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.497995+0000", 2024-04-23T23:37:51.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5019999999999998e-06 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.498000+0000", 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8910000000000003e-06 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523541+0000", 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025540976 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523609+0000", 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7742000000000003e-05 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523705+0000", 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6409999999999993e-05 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11472 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 519168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499253+0000", 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3216509099999998, 2024-04-23T23:37:51.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024844883000000002, 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11472 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499253+0000", 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499253+0000", 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499253+0000", 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499255+0000", 2024-04-23T23:37:51.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.238e-06 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499261+0000", 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1129999999999997e-06 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499274+0000", 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2880999999999999e-05 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.523929+0000", 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024654401999999999 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524001+0000", 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2188999999999996e-05 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524098+0000", 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6607999999999994e-05 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.839 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11485 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 460800~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499282+0000", 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3216216960000002, 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025009844999999999, 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.840 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11485 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499282+0000", 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499282+0000", 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499282+0000", 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499284+0000", 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1100000000000001e-06 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499290+0000", 2024-04-23T23:37:51.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8200000000000002e-06 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499302+0000", 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1537e-05 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524125+0000", 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024823482000000001 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524195+0000", 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9871999999999998e-05 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524292+0000", 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6588000000000004e-05 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11486 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 472064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499309+0000", 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321594487, 2024-04-23T23:37:51.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025183791000000001, 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11486 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499309+0000", 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499309+0000", 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499310+0000", 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.39e-07 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499312+0000", 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1100000000000001e-06 2024-04-23T23:37:51.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499318+0000", 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499322+0000", 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7650000000000001e-06 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524325+0000", 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025002217 2024-04-23T23:37:51.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524392+0000", 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7150000000000006e-05 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524493+0000", 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010115000000000001 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11489 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 508928~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499331+0000", 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3215721829999998, 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025355272000000002, 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11489 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499331+0000", 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499331+0000", 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499332+0000", 2024-04-23T23:37:51.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499334+0000", 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9759999999999998e-06 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499339+0000", 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3990000000000003e-06 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499343+0000", 2024-04-23T23:37:51.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0749999999999999e-06 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524522+0000", 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025178663 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524594+0000", 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2142000000000001e-05 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524687+0000", 2024-04-23T23:37:51.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2571999999999994e-05 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11490 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 520192~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499374+0000", 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321529145, 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025516601999999999, 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.853 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11490 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499374+0000", 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499374+0000", 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499375+0000", 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4600000000000005e-07 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499378+0000", 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2059999999999999e-06 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499384+0000", 2024-04-23T23:37:51.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2829999999999998e-06 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499390+0000", 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4559999999999999e-06 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524717+0000", 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.02532705 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524787+0000", 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0520999999999998e-05 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524891+0000", 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010354 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11503 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 461824~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499400+0000", 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321503399, 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025687555000000001, 2024-04-23T23:37:51.857 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11503 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499400+0000", 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499400+0000", 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499401+0000", 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3799999999999998e-07 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499403+0000", 2024-04-23T23:37:51.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.092e-06 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499408+0000", 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5790000000000003e-06 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499413+0000", 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.707e-06 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524923+0000", 2024-04-23T23:37:51.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025510218000000001 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.524995+0000", 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1604000000000001e-05 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525088+0000", 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2917000000000005e-05 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11504 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 473088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499419+0000", 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321484452, 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025870814999999998, 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11504 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.862 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499419+0000", 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499419+0000", 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499420+0000", 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:37:51.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499421+0000", 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.689e-06 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499427+0000", 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6840000000000001e-06 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499431+0000", 2024-04-23T23:37:51.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6160000000000004e-06 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525118+0000", 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025686666 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525194+0000", 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5545999999999998e-05 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525290+0000", 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6217000000000004e-05 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11507 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 509952~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499437+0000", 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321466306, 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026049046999999999, 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.866 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11507 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499437+0000", 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499437+0000", 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499438+0000", 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499440+0000", 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.801e-06 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499445+0000", 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5389999999999998e-06 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499450+0000", 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5249999999999999e-06 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525317+0000", 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.02586776 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525385+0000", 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7836999999999994e-05 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525486+0000", 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010111 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.870 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11508 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 521216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499455+0000", 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321448384, 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026227901000000001, 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11508 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499455+0000", 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499455+0000", 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499456+0000", 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499473+0000", 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7047000000000001e-05 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499480+0000", 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9879999999999998e-06 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499485+0000", 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0139999999999998e-06 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525514+0000", 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026029162000000002 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525584+0000", 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0302000000000006e-05 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525683+0000", 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9005999999999994e-05 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.874 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11521 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 462848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499492+0000", 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321411452, 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026388211000000002, 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11521 2024-04-23T23:37:51.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499492+0000", 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499492+0000", 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499493+0000", 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499495+0000", 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3089999999999998e-06 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499501+0000", 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499505+0000", 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3939999999999998e-06 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525715+0000", 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026209771999999999 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525784+0000", 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9418000000000005e-05 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525880+0000", 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6087000000000003e-05 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11522 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 474112~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499511+0000", 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3213923780000001, 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026562128000000001, 2024-04-23T23:37:51.879 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11522 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499511+0000", 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499511+0000", 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499512+0000", 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499518+0000", 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2670000000000003e-06 2024-04-23T23:37:51.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499524+0000", 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499534+0000", 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0550000000000001e-05 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525907+0000", 2024-04-23T23:37:51.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026373190000000001 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.525978+0000", 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0413999999999994e-05 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526073+0000", 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5492e-05 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11525 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 510976~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499542+0000", 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3213620530000001, 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026727594, 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11525 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499542+0000", 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499542+0000", 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499542+0000", 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499544+0000", 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0540000000000002e-06 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499550+0000", 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2890000000000003e-06 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499555+0000", 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6770000000000003e-06 2024-04-23T23:37:51.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526102+0000", 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026547444999999999 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526177+0000", 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4975000000000006e-05 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526269+0000", 2024-04-23T23:37:51.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1759e-05 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11526 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 522240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499562+0000", 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.321341436, 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026902365000000001, 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11526 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499562+0000", 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499562+0000", 2024-04-23T23:37:51.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499563+0000", 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499564+0000", 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7850000000000001e-06 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499570+0000", 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9170000000000003e-06 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499575+0000", 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3619999999999999e-06 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526299+0000", 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026724639000000001 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526371+0000", 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1919e-05 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526464+0000", 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3356000000000005e-05 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:11571 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 359424~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:51.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:48.499580+0000", 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.3213236660000001, 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027139307000000001, 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 11571 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499580+0000", 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499580+0000", 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499580+0000", 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499582+0000", 2024-04-23T23:37:51.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.685e-06 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499587+0000", 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4670000000000003e-06 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.499592+0000", 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3919999999999996e-06 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:51.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526515+0000", 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026923252000000002 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526606+0000", 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0569000000000006e-05 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:48.526719+0000", 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113546 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:51.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:51.897 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:51.898 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:37:51.899 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:51.940 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:51.952+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:52.005 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:52.017+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:52.048 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:52.048 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:52.049 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:52.049 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:52.057 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:52.107 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:52.119+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:52.158 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:52.159 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:52.159 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:52.159 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:52.159 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:52.167 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:52.211 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:52.224+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:52.272 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.555232316000001, 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:52.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:37:52.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:37:52.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:37:52.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.278 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:7994 3.13 3:cbf42c78:::rbd_data.1194137ed5d1.0000000000000013:5 [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8220021549999998, 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034041705999999998, 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 7994 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461189+0000", 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5600000000000002e-07 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461190+0000", 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461193+0000", 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0860000000000002e-06 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461195+0000", 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3800000000000001e-06 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495064+0000", 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033868478 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495146+0000", 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1927000000000004e-05 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495230+0000", 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4598999999999994e-05 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8049 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 302080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8216949109999998, 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024337000000002, 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8049 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2200000000000004e-07 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461500+0000", 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6739999999999999e-06 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461508+0000", 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6650000000000003e-06 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461513+0000", 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5740000000000003e-06 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495262+0000", 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033749023000000003 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495369+0000", 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010689200000000001 2024-04-23T23:37:52.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000150987 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8050 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 314368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8216596710000008, 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034238880999999999, 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.287 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8050 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461534+0000", 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3929999999999998e-06 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9460000000000001e-06 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461548+0000", 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9229999999999996e-06 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495572+0000", 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024167000000001 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495663+0000", 2024-04-23T23:37:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1079e-05 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495770+0000", 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010681800000000001 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8051 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 325632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:37:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8216152870000002, 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034417270999999999, 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8051 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:37:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461576+0000", 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461578+0000", 2024-04-23T23:37:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.407e-06 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461586+0000", 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0010000000000001e-06 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461592+0000", 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495803+0000", 2024-04-23T23:37:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034211245000000001 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495880+0000", 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7002999999999994e-05 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495993+0000", 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112111 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8052 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 337920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8215907680000001, 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034632123000000001, 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8052 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461602+0000", 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461608+0000", 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2269999999999998e-06 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461629+0000", 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0832999999999999e-05 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496041+0000", 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034411774999999999 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496129+0000", 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8263999999999994e-05 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496232+0000", 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102701 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8053 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 350208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8215501889999999, 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034759724999999998, 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8053 2024-04-23T23:37:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461641+0000", 2024-04-23T23:37:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461643+0000", 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5119999999999998e-06 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461663+0000", 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9483999999999998e-05 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461675+0000", 2024-04-23T23:37:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1989e-05 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496280+0000", 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034604677 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496329+0000", 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9072e-05 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496400+0000", 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1486e-05 2024-04-23T23:37:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8054 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 362496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8215062169999996, 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034935358, 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8054 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461685+0000", 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461706+0000", 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1420000000000002e-05 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461717+0000", 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0563e-05 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461723+0000", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9050000000000002e-06 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496438+0000", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034714753000000001 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496521+0000", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.365e-05 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496620+0000", 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8559000000000003e-05 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8055 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 373760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8214471410000002, 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035088333999999999, 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8055 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461744+0000", 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461747+0000", 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5000000000000002e-06 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461771+0000", 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4871999999999998e-05 2024-04-23T23:37:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461783+0000", 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1762e-05 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496665+0000", 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034881844000000002 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496749+0000", 2024-04-23T23:37:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4398000000000001e-05 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496832+0000", 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2367999999999995e-05 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213999180000009, 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:37:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:37:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213871279999996, 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:37:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:37:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213769759999998, 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:37:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:37:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:37:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213612189999999, 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:37:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:37:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:37:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213426229999996, 2024-04-23T23:37:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213228909999994, 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8213029590000005, 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:37:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:37:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8212710320000003, 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:37:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.821242732, 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:37:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8212167010000009, 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:37:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8211960640000004, 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:37:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:37:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:52.357 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:52.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:52.359 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:52.370+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:52.460 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:52.472+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:52.462 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:52.462 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:52.462 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:52.462 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:52.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:52.560 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:52.572+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:52.613 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:52.613 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:52.613 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:52.613 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:52.614 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:52.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:52.663 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:52.675+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:52.699 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:52.711+0000 7f59c9c1f640 -1 osd.5 24 log_to_monitors true 2024-04-23T23:37:52.763 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:52.775+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:52.770 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672712509, 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:52.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:37:52.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672698864000001, 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:37:52.775 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.779 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672685813999999, 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:37:52.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.783 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672674795000001, 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.784 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672665719999999, 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.788 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:37:52.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672653776000001, 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.672644665, 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.670999292999999, 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:37:52.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.670987044, 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:37:52.804 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:52.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:37:52.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:37:52.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4540 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666818562, 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053214760999999999, 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.808 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4540 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115187+0000", 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2599999999999998e-07 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115188+0000", 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.085e-06 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115191+0000", 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.033e-06 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115194+0000", 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.909e-06 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168391+0000", 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053197041 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168402+0000", 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0366999999999999e-05 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666808451, 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666796669, 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.816 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.6667866, 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.820 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:52.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666774941, 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.824 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:37:52.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:37:52.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666765621, 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:37:52.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:37:52.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666755109, 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.835 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666745669000001, 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:37:52.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:52.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666550576000001, 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.840 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:37:52.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:37:52.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666529542999999, 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:52.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:52.847 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.666515652999999, 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:52.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:52.851 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:52.852 INFO:teuthology.orchestra.run.smithi077.stdout:772 read 0x6d05faf thru 0x6d1073c (0xa78e bytes) 2024-04-23T23:37:52.852 INFO:teuthology.orchestra.run.smithi077.stdout:773 write 0x999eb17 thru 0x99aacd7 (0xc1c1 bytes) 2024-04-23T23:37:52.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:52.854 INFO:teuthology.orchestra.run.smithi077.stdout:774 write 0x1b24b25 thru 0x1b2f7f5 (0xacd1 bytes) 2024-04-23T23:37:52.854 INFO:teuthology.orchestra.run.smithi077.stdout:775 write 0x21509f thru 0x221d9d (0xccff bytes) 2024-04-23T23:37:52.854 INFO:teuthology.orchestra.run.smithi077.stdout:776 trunc from 0xb2ea4ba to 0xc644a8a 2024-04-23T23:37:52.854 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:52.854 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:52.854 INFO:teuthology.orchestra.run.smithi077.stdout:781 write 0x96747ca thru 0x9681889 (0xd0c0 bytes) 2024-04-23T23:37:52.870 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:52.883+0000 7f59bd421640 -1 osd.5 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:37:52.879 INFO:teuthology.orchestra.run.smithi077.stdout:782 writesame 0xadd1c73 thru 0xadd2fd9 data_size 0x1(0x1367 bytes) 2024-04-23T23:37:52.880 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:52.892+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:52.883 INFO:teuthology.orchestra.run.smithi077.stdout:783 writesame 0x1330b9 thru 0x1424ca data_size 0x7(0xf412 bytes) 2024-04-23T23:37:52.965 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:52.978+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:52.996 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:52.996 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:52.996 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:53.005 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:53.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:37:53.089 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:53.101+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:53.150 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:53.152 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:53.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:53.167 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:53.167 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:53.167 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:53.179+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:53.185 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:53.186 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:53.204 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:53.204 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:53.221 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:53.221 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:53.239 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:53.239 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.5 2024-04-23T23:37:53.257 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:53.258 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:53.268 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:53.280+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:53.271 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:53.272 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:53.275 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:53.275 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:53.278 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:37:53.278 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:37:53.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:53.369 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:53.381+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:53.424 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:53.424 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:53.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:53.476 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:53.488+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:53.534 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:53.534 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:53.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:53.584 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:53.596+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:53.671 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:53.684+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:53.684 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:53.684 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:53.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:53.756 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:37:53.772 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:53.784+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:53.796 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:53.796 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:53.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:53.877 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:53.877 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:53.877 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:53.877 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:53.890 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:53.902+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:53.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:37:53.954 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:53.954 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:53.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:54.007 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:54.019+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:54.068 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.069 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.074 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:54.086+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:54.077 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:54.174 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:54.187+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:54.181 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.182 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.190 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:54.275 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:54.287+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:37:54.332 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.332 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:54.375 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:54.387+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:54.476 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:54.489+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:37:54.485 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.485 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.494 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:54.578 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:54.591+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:54.640 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.640 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.649 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:54.678 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:54.690+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:54.779 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:54.791+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:54.790 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.790 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.799 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:54.858 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:37:54.880 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:54.892+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:54.917 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:54.917 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:54.929 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:54.980 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:54.992+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:55.076 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:55.077 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:55.081 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:55.093+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:55.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:55.182 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:55.194+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:55.187 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:55.188 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:55.196 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:55.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:37:55.282 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:55.295+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:55.299 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:55.299 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:55.308 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:37:55.383 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:55.395+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:55.397 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:55.398 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:55.415 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:55.415 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:55.433 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:55.433 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:55.450 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:55.450 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:55.450 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:37:55.451 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:55.459 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:37:55.466 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:55.467 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:55.484 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:37:55.484 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-04-23T23:37:55.501 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:55.501 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:55.503 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:55.516+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:55.519 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:55.563 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:55.564 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:37:55.564 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:37:55.564 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:37:55.564 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:55.573 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:37:55.584 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:55.596+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:55.685 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:55.697+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:55.717 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.16 36/35 [PushOp(3:69f73515:::rbd_data.1194ccf776f2.0000000000000034:head, version: 29'171, data_included: [1024~9216,22528~8192,43008~9216,63488~9216,84992~8192,105472~9216,125952~9216,147456~8192,167936~9216,188416~9216,209920~2048,248832~1024], data_size: 92160, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:69f73515:::rbd_data.1194ccf776f2.0000000000000034:head@29'171, size: 249856, copy_subset: [(0, 249856)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 249856, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(first, data_recovered_to: 0, data_complete: false, omap_recovered_to: , omap_complete: false, error: false))])", 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.917729+0000", 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.81098384000000001, 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0021690479999999998, 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.718 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917729+0000", 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917729+0000", 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917730+0000", 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917793+0000", 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3572999999999996e-05 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917813+0000", 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9655000000000001e-05 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917840+0000", 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7355000000000002e-05 2024-04-23T23:37:55.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917907+0000", 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7012000000000001e-05 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.917915+0000", 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.919898+0000", 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00198335 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.721 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [4194304~655238,4849664~3072,4860928~3072,4872192~3072,4883456~3072,4894720~3072,4905984~3072,4917248~3072,4928512~3072,4939776~3072,4951040~3072,4962304~3072,4973568~3072,4980736~356474], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 5337210, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 4194304, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.972903+0000", 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.75580975399999994, 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0027677890000000001, 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.972903+0000", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.972903+0000", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.972904+0000", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.973970+0000", 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010662239999999999 2024-04-23T23:37:55.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.973986+0000", 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5874000000000001e-05 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.973998+0000", 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1817000000000001e-05 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.974094+0000", 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6118000000000004e-05 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.974102+0000", 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5709999999999998e-06 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.975671+0000", 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0015686809999999999 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [5337210~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 6385786, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 5337210, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.977864+0000", 2024-04-23T23:37:55.725 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.75084937399999996, 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001839299, 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.977864+0000", 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.977864+0000", 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.977864+0000", 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999995e-07 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.978742+0000", 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00087795699999999996 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.978758+0000", 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5528000000000001e-05 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.978768+0000", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0054999999999999e-05 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.978847+0000", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8677000000000006e-05 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.978854+0000", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4669999999999998e-06 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.979703+0000", 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00084887999999999999 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [7434362~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 8482938, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 7434362, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.985921+0000", 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.74279152400000004, 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019422230000000001, 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.985921+0000", 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.985921+0000", 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.985922+0000", 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5499999999999998e-07 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.986877+0000", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095487999999999996 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.986894+0000", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6670000000000001e-05 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.986921+0000", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7407e-05 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.986985+0000", 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3497000000000005e-05 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.986992+0000", 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8220000000000007e-06 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.987864+0000", 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00087129199999999996 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [8482938~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 9531514, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 8482938, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.990058+0000", 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.73865467200000001, 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.002262858, 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.990058+0000", 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.990058+0000", 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.990059+0000", 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8100000000000002e-07 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.991072+0000", 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010125869999999999 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.991096+0000", 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3881000000000001e-05 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.991116+0000", 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0475999999999998e-05 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.991204+0000", 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8289999999999997e-05 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.991217+0000", 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2836999999999999e-05 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.992321+0000", 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001104006 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [9531514~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 10580090, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 9531514, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.994685+0000", 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.734027969, 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0020544489999999999, 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.994685+0000", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.994685+0000", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.994686+0000", 2024-04-23T23:37:55.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5000000000000002e-07 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.995677+0000", 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00099116400000000011 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.995701+0000", 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4304999999999999e-05 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.995719+0000", 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7921e-05 2024-04-23T23:37:55.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.995792+0000", 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3311000000000003e-05 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.995801+0000", 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8689999999999993e-06 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.996739+0000", 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000938129 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.739 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [10580090~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 11628666, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 10580090, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:54.999638+0000", 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.72907480800000002, 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0020895779999999999, 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.999638+0000", 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.999638+0000", 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:54.999639+0000", 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5000000000000002e-07 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.000603+0000", 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096422800000000003 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.000621+0000", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8071e-05 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.000641+0000", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9755e-05 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.000708+0000", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6715000000000001e-05 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.000717+0000", 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3700000000000001e-06 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.001728+0000", 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010106889999999999 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [11628666~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 12677242, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 11628666, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.004150+0000", 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.72456258500000004, 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0021617030000000001, 2024-04-23T23:37:55.743 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.004150+0000", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.004150+0000", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.004151+0000", 2024-04-23T23:37:55.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6000000000000003e-07 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.005192+0000", 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001041251 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.005213+0000", 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1036e-05 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.005232+0000", 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8797999999999999e-05 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.005307+0000", 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5122000000000003e-05 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.005316+0000", 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9679999999999995e-06 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.006312+0000", 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00099576799999999996 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [12677242~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 13725818, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 12677242, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.008720+0000", 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.719992992, 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0020865129999999999, 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.008720+0000", 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.008720+0000", 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.008721+0000", 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9899999999999999e-07 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.009684+0000", 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096367299999999996 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.009703+0000", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.859e-05 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.009716+0000", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2714999999999999e-05 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.009789+0000", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3478000000000004e-05 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.009799+0000", 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3540000000000006e-06 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.010806+0000", 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001007904 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [13725818~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 14774394, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 13725818, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.013078+0000", 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.71563523299999998, 2024-04-23T23:37:55.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00199109, 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.013078+0000", 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.013078+0000", 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.013078+0000", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.54e-07 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.014025+0000", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00094686599999999998 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.014042+0000", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7102e-05 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.014055+0000", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2308e-05 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.014120+0000", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4801000000000005e-05 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.014129+0000", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1889999999999996e-06 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.015069+0000", 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00094006999999999999 2024-04-23T23:37:55.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [14774394~954246,16515072~94330], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 16609402, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 14774394, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.017249+0000", 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.71146401400000003, 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.002084561, 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.017249+0000", 2024-04-23T23:37:55.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.017249+0000", 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.017249+0000", 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4200000000000001e-07 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.018231+0000", 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098202599999999999 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.018246+0000", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4527e-05 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.018258+0000", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1574e-05 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.018321+0000", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3676999999999994e-05 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.018331+0000", 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3219999999999999e-06 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.019334+0000", 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001002993 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [16609402~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 17657978, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 16609402, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.021400+0000", 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.70731269600000002, 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0020344809999999999, 2024-04-23T23:37:55.757 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.021400+0000", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.021400+0000", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.021401+0000", 2024-04-23T23:37:55.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8100000000000002e-07 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.022350+0000", 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00094907699999999999 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.022368+0000", 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7787000000000001e-05 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.022380+0000", 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2629000000000001e-05 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.022447+0000", 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6129000000000003e-05 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.022456+0000", 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5719999999999992e-06 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.023435+0000", 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00097860599999999992 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [17657978~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 18706554, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 17657978, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.025714+0000", 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.702998915, 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0020599360000000001, 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.025714+0000", 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.025714+0000", 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.025715+0000", 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.026679+0000", 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096394700000000005 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.026696+0000", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7068999999999999e-05 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.026708+0000", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1936999999999999e-05 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.026770+0000", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2521999999999995e-05 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.026779+0000", 2024-04-23T23:37:55.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1039999999999996e-06 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.027774+0000", 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00099484300000000003 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [18706554~429958,19399680~10240,19410944~10240,19422208~10240,19433472~10240,19444736~10240,19456000~10240,19467264~10240,19478528~10240,19489792~10240,19501056~10240,19512320~10240,19523584~10240,19534848~10240,19546112~10240,19557376~10240,19568640~10240,19579904~10240,19591168~10240,19602432~10240,19613696~10240,19624960~10240,19636224~10240,19647488~10240,19658752~4096,19663872~10240,19675136~10240,19686400~10240,19697664~10240,19708928~10240,19720192~10240,19731456~10240,19742720~10240,19753984~10240,19765248~10240,19776512~10240,19787776~10240,19799040~10240,19810304~10240,19821568~10240,19832832~10240,19844096~10240,19855360~10240,19866624~10240,19877888~10240,19889152~10240,19900416~10240,19911680~10240,19922944~4096,19928064~10240,19939328~10240,19950592~10240,19961856~10240,19973120~10240,19984384~10240,19995648~10240,20006912~10240,20018176~10240,20029440~10240,20040704~10240,20051968~10240,20063232~10240,20074496~6266], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 20080762, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 18706554, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.69719727099999995, 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0085980770000000008, 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.764 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032508+0000", 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0009915010000000001 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032531+0000", 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2903000000000001e-05 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032555+0000", 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4304999999999999e-05 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032668+0000", 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113476 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032684+0000", 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5481e-05 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.040114+0000", 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0074298810000000002 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [20080762~3974,20085760~10240,20097024~10240,20108288~10240,20119552~10240,20130816~10240,20142080~10240,20153344~10240,20164608~10240,20175872~962682], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 21138554, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 20080762, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.042640+0000", 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.68607269900000001, 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.003075211, 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.042640+0000", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.042640+0000", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.042641+0000", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1429999999999999e-06 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.043595+0000", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095317700000000004 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.043616+0000", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1747999999999999e-05 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.043631+0000", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.472e-05 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.043708+0000", 2024-04-23T23:37:55.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7412999999999999e-05 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.043719+0000", 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0669999999999999e-05 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.045715+0000", 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019963400000000001 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [21138554~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 22187130, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 21138554, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.048006+0000", 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.68070651699999996, 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0023023509999999998, 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.048006+0000", 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.048006+0000", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.048007+0000", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4099999999999997e-07 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.049142+0000", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001135023 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.049162+0000", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9528999999999999e-05 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.049174+0000", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2405000000000001e-05 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.049244+0000", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9225000000000002e-05 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.049253+0000", 2024-04-23T23:37:55.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1079999999999999e-06 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.050309+0000", 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00105612 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [22187130~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 23235706, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 22187130, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.052620+0000", 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.67609302500000001, 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.002228299, 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.775 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.052620+0000", 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.052620+0000", 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.052621+0000", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6500000000000008e-07 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.053620+0000", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00099890799999999996 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.053635+0000", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5339999999999999e-05 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.053647+0000", 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1732e-05 2024-04-23T23:37:55.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.053712+0000", 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5497e-05 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.053721+0000", 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0669999999999998e-06 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.054848+0000", 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011267899999999999 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.778 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [23235706~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 24284282, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 23235706, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.057062+0000", 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.67165105899999999, 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0021882830000000001, 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.057062+0000", 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.057062+0000", 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.057063+0000", 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.058030+0000", 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096688799999999995 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.058047+0000", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7388999999999999e-05 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.058058+0000", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1134999999999999e-05 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.058125+0000", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999999e-05 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.058134+0000", 2024-04-23T23:37:55.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0129999999999999e-06 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.059250+0000", 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001116337 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [24284282~1048576], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 25332858, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 24284282, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.061450+0000", 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.66726291199999999, 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0021378650000000001, 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.782 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.061450+0000", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.061450+0000", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.061451+0000", 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999995e-07 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.062388+0000", 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00093675900000000001 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.062405+0000", 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7702000000000001e-05 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.062418+0000", 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2744e-05 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.062489+0000", 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0926999999999994e-05 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.062498+0000", 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.02e-06 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.063588+0000", 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010899779999999999 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [25332858~881542,26868732~54173], data_size: 935715, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 26922905, data_complete: true, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 25332858, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.065844+0000", 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.66286931100000002, 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.002260738, 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.065844+0000", 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.065844+0000", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.065844+0000", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8199999999999999e-07 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.066695+0000", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00085069300000000002 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.066711+0000", 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5685999999999999e-05 2024-04-23T23:37:55.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.066722+0000", 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1503e-05 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.066785+0000", 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2976000000000001e-05 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.066795+0000", 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4080000000000004e-06 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:37:55.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.068104+0000", 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0013097899999999999 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:37:55.789 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:37:55.790 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:55.802+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:55.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:55.892 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:55.904+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:55.894 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:55.894 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:55.894 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:55.894 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:55.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:55.992 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:56.004+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:56.046 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:56.046 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:56.046 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:56.046 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:56.046 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:56.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:56.093 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:56.106+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:37:56.195 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:56.207+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:56.198 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100824518, 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:37:56.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:37:56.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:37:56.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.202 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100810873, 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.203 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.206 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100797823000001, 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.207 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:37:56.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:37:56.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100786804, 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:37:56.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100777729000001, 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:37:56.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100765785, 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:37:56.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:37:56.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:37:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.100756673999999, 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.223 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:37:56.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.099111302000001, 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.227 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:37:56.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:37:56.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.099099053, 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.231 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:37:56.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094920460000001, 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094908677999999, 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:37:56.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094898608999999, 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.242 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094886949999999, 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:37:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094877629999999, 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:37:56.249 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:56.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:37:56.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094867118, 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.253 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:37:56.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094857678, 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:37:56.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094662585, 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:37:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:56.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:37:56.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.263 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094641552000001, 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.094627662000001, 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:37:56.267 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:37:56.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.4914711569999999, 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:37:56.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:37:56.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:37:56.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.275 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:56.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:56.296 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:56.308+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:56.396 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:56.408+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:56.420 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:56.420 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:56.420 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:56.429 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:37:56.513 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:56.525+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:56.571 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:56.571 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:56.571 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:56.571 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:56.571 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:56.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:37:56.621 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:56.633+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:56.699 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:56.711+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1984 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17055744~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539889882000001, 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011105459999999999, 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1984 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195352+0000", 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.41e-07 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195353+0000", 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.540000000000001e-07 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195357+0000", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5140000000000002e-06 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195360+0000", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.653e-06 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206356+0000", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010995823 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206394+0000", 2024-04-23T23:37:56.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7790000000000002e-05 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206458+0000", 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3485000000000006e-05 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1985 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17285120~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539875940000002, 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011236217999999999, 2024-04-23T23:37:56.728 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1985 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:56.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195366+0000", 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195368+0000", 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7859999999999999e-06 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195374+0000", 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1820000000000003e-06 2024-04-23T23:37:56.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195386+0000", 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1481000000000001e-05 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206487+0000", 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011101428 2024-04-23T23:37:56.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206547+0000", 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9449e-05 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206602+0000", 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5408999999999998e-05 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1986 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17514496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.732 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539849818, 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011350281, 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1986 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195392+0000", 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:37:56.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195394+0000", 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.759e-06 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195400+0000", 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9290000000000003e-06 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195404+0000", 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2899999999999996e-06 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206633+0000", 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011228804 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206692+0000", 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8556e-05 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206742+0000", 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0581999999999998e-05 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1987 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17743872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539832002000001, 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011463825, 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1987 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.737 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195412+0000", 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195418+0000", 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5979999999999996e-06 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195422+0000", 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4290000000000003e-06 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206767+0000", 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011344745 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206817+0000", 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9740000000000001e-05 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206874+0000", 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7138000000000001e-05 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1988 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17973248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539814123999999, 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011660201, 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1988 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:37:56.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195430+0000", 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195436+0000", 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7350000000000001e-06 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195440+0000", 2024-04-23T23:37:56.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3059999999999999e-06 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206908+0000", 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011467989 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206993+0000", 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4746999999999993e-05 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207088+0000", 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5391999999999997e-05 2024-04-23T23:37:56.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1989 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18202624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539796621000001, 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011792265999999999, 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1989 2024-04-23T23:37:56.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195446+0000", 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195447+0000", 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195453+0000", 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8830000000000003e-06 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195457+0000", 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0860000000000004e-06 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207122+0000", 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011664737 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207177+0000", 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4632000000000001e-05 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207238+0000", 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0859999999999997e-05 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539777448999999, 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539747913999999, 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:37:56.753 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:37:56.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539728141000001, 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:37:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:56.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539710594999999, 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:37:56.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:37:56.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:37:56.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539693085, 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:37:56.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:37:56.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539652546999999, 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:37:56.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539638982, 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:37:56.774 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:56.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539629384000001, 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:37:56.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539618822000001, 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:56.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:37:56.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539609505000001, 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.786 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539600317000001, 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.790 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.539585745, 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:56.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:56.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:37:56.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.3413986569999992, 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:56.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12738 3.19 3:981e3435:::rbd_data.11943f90bac1.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 20048663~49601] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:37:56.803 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.920424331, 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014968690999999999, 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12738 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814819+0000", 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5719999999999999e-06 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815601+0000", 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00078195599999999999 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815617+0000", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6178e-05 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815627+0000", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6220000000000004e-06 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815716+0000", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9190999999999994e-05 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:56.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815816+0000", 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010035999999999999 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 3", 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.816033+0000", 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000216329 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.827645+0000", 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011612618999999999 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:37:56.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829716+0000", 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020706159999999999 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829753+0000", 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6786000000000003e-05 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829786+0000", 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3461999999999999e-05 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:56.809 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:56.809 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:56.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:37:56.810 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:56.822+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:56.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:37:56.911 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:56.923+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:56.957 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:56.957 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:56.957 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:56.957 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:56.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:37:57.011 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:57.023+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:57.076 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:57.076 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:57.076 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:57.076 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:57.076 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:57.085 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:37:57.113 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:57.125+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:57.214 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:37:57.227+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:37:57.230 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2770 3.0 e28/21 3:04638217:::rbd_data.1194137ed5d1.0000000000000103:head v 28'8, mlcod=28'6)", 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.88020964, 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033753899999999998, 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361977+0000", 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.167e-06 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361992+0000", 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5685999999999999e-05 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362007+0000", 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4269e-05 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362015+0000", 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:37:57.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362070+0000", 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4750999999999998e-05 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362095+0000", 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4822999999999999e-05 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365317+0000", 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032223009999999999 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365351+0000", 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4029999999999998e-05 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2784 3.0 e28/21 3:05ebc6bc:::rbd_data.1194137ed5d1.000000000000005c:head v 28'9, mlcod=28'7)", 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.858103592999999, 2024-04-23T23:37:57.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031924290000000001, 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384082+0000", 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384083+0000", 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5510000000000001e-06 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384091+0000", 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.038e-06 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384108+0000", 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6833999999999998e-05 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384117+0000", 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.833e-06 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384190+0000", 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3208999999999997e-05 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.384221+0000", 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1223000000000002e-05 2024-04-23T23:37:57.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.387229+0000", 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003008176 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.387274+0000", 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4564999999999998e-05 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.239 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2807 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'5, mlcod=28'3)", 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.850701911000002, 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044721090000000002, 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391484+0000", 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5199999999999996e-07 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391489+0000", 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391499+0000", 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9450000000000005e-06 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391505+0000", 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.331e-06 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391560+0000", 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5250000000000001e-05 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391579+0000", 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9049e-05 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395910+0000", 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043312419999999999 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395955+0000", 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4907000000000002e-05 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.243 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3490 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'9, mlcod=28'7)", 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.572909846000002, 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0028448990000000001, 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669275+0000", 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669276+0000", 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6199999999999998e-07 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669282+0000", 2024-04-23T23:37:57.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7690000000000002e-06 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669294+0000", 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1949e-05 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669300+0000", 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3060000000000003e-06 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669349+0000", 2024-04-23T23:37:57.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9555000000000002e-05 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.669367+0000", 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7965000000000002e-05 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.672090+0000", 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0027230829999999998 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.672120+0000", 2024-04-23T23:37:57.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9709999999999998e-05 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3493 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'16, mlcod=28'13)", 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.572087989, 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047633190000000002, 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670098+0000", 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:37:57.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670103+0000", 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670115+0000", 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.221e-05 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670126+0000", 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0216e-05 2024-04-23T23:37:57.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670172+0000", 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699000000000001e-05 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670190+0000", 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8074999999999999e-05 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674821+0000", 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046309300000000001 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674860+0000", 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9104999999999999e-05 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3496 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'11, mlcod=24'9)", 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:57.252 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.571697341, 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043762560000000002, 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3399999999999998e-07 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670495+0000", 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2349999999999996e-06 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670507+0000", 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2183e-05 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670515+0000", 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0369999999999995e-06 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670573+0000", 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8009e-05 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670594+0000", 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0545000000000001e-05 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674832+0000", 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004238192 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674864+0000", 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2320999999999998e-05 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:4024 3.4 e28/21 3:2546d4ff:::rbd_data.1194137ed5d1.0000000000000135:head v 28'16, mlcod=28'14)", 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.233836419999999, 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042382929999999997, 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008350+0000", 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0720000000000001e-06 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008364+0000", 2024-04-23T23:37:57.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4236000000000001e-05 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008381+0000", 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7070000000000001e-05 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008391+0000", 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7499999999999998e-06 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008452+0000", 2024-04-23T23:37:57.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1057999999999997e-05 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008474+0000", 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2521999999999999e-05 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012559+0000", 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040842609999999996 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012587+0000", 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8323999999999999e-05 2024-04-23T23:37:57.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5188 3.4 e28/21 3:21d47454:::rbd_data.1194137ed5d1.0000000000000058:head v 28'24, mlcod=28'22)", 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.298579+0000", 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.943605762000001, 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031562069999999998, 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298579+0000", 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298579+0000", 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298580+0000", 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8500000000000001e-07 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298586+0000", 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2330000000000003e-06 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298601+0000", 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4401e-05 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298608+0000", 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1779999999999997e-06 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298659+0000", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0757999999999998e-05 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.298682+0000", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3521999999999999e-05 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.301705+0000", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0030229329999999998 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.301736+0000", 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0497e-05 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5287 3.4 e28/21 3:200b80cf:::rbd_data.1194137ed5d1.0000000000000152:head v 28'26, mlcod=28'24)", 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.839651955000001, 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042967179999999997, 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402546+0000", 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3029e-05 2024-04-23T23:37:57.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402557+0000", 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0599e-05 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402575+0000", 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7765999999999999e-05 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402583+0000", 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.208e-06 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402989+0000", 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000405993 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.403011+0000", 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2036e-05 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406781+0000", 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037698950000000001 2024-04-23T23:37:57.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406830+0000", 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9191999999999999e-05 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5303 3.4 e28/21 3:21d47454:::rbd_data.1194137ed5d1.0000000000000058:head v 28'27, mlcod=28'25)", 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.831628466, 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0034075889999999999, 2024-04-23T23:37:57.269 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410558+0000", 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410567+0000", 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9089999999999995e-06 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410584+0000", 2024-04-23T23:37:57.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6458999999999999e-05 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410591+0000", 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0489999999999998e-06 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410648+0000", 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6566e-05 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410667+0000", 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9718999999999999e-05 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.413927+0000", 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032602199999999999 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.413964+0000", 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6767000000000002e-05 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5627 3.0 e28/21 3:05b00203:::rbd_data.1194137ed5d1.000000000000002b:head v 28'23, mlcod=28'21)", 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.522527801000001, 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065095700000000001, 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:37:57.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719658+0000", 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719664+0000", 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.998e-06 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719676+0000", 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1494999999999999e-05 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719683+0000", 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0049999999999998e-06 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719730+0000", 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7747999999999998e-05 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719750+0000", 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9842000000000001e-05 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726120+0000", 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063699480000000003 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726167+0000", 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6802999999999999e-05 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:6080 3.4 e29/21 3:2709b39d:::rbd_data.1194ccf776f2.000000000000038b:head v 29'39, mlcod=29'37)", 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.123842+0000", 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.118343464000001, 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032416229999999999, 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.278 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123842+0000", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123842+0000", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123843+0000", 2024-04-23T23:37:57.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.235e-06 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123854+0000", 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1269e-05 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123873+0000", 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8902999999999998e-05 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123882+0000", 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3829999999999998e-06 2024-04-23T23:37:57.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123966+0000", 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3149e-05 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.123993+0000", 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6982e-05 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.127050+0000", 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0030569690000000001 2024-04-23T23:37:57.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.127083+0000", 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3732999999999997e-05 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:6150 3.0 e29/21 3:0303ef61:::rbd_data.1194ccf776f2.000000000000031b:head v 29'27, mlcod=28'25)", 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.170747+0000", 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.071438493, 2024-04-23T23:37:57.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0031032920000000001, 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170747+0000", 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170747+0000", 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170748+0000", 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.054e-06 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170759+0000", 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0978999999999999e-05 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170772+0000", 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3638999999999999e-05 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170780+0000", 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0700000000000007e-06 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170856+0000", 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5415999999999998e-05 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.170882+0000", 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6174999999999999e-05 2024-04-23T23:37:57.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.173804+0000", 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0029216340000000002 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.173850+0000", 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6325000000000001e-05 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7147 3.9 e29/21 3:94c47ac8:::rbd_data.1194ccf776f2.00000000000000d5:head v 29'31, mlcod=29'29)", 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.867294928, 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047294210000000001, 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374891+0000", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.063e-06 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374901+0000", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0112000000000001e-05 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374916+0000", 2024-04-23T23:37:57.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4347e-05 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374925+0000", 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3079999999999997e-06 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374991+0000", 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6264000000000001e-05 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375012+0000", 2024-04-23T23:37:57.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0356e-05 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379556+0000", 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045444079999999998 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379620+0000", 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3563000000000001e-05 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7149 3.0 e29/21 3:059b2f37:::rbd_data.1194ccf776f2.00000000000000d7:head v 29'34, mlcod=29'32)", 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.866416507, 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003874508, 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375784+0000", 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4506e-05 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375794+0000", 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0261000000000001e-05 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375800+0000", 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4110000000000001e-06 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375863+0000", 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2825999999999998e-05 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375884+0000", 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1279000000000001e-05 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379601+0000", 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037165829999999999 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379643+0000", 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2033000000000002e-05 2024-04-23T23:37:57.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7178 3.4 e29/21 3:21a3b24e:::rbd_data.1194ccf776f2.0000000000000129:head v 29'41, mlcod=29'39)", 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.833268715999999, 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0034548679999999998, 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:37:57.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408918+0000", 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.176e-06 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408928+0000", 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0844e-05 2024-04-23T23:37:57.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408946+0000", 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7495000000000001e-05 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408956+0000", 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0577000000000001e-05 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409018+0000", 2024-04-23T23:37:57.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1456000000000002e-05 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409038+0000", 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0268999999999999e-05 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.412323+0000", 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032843130000000001 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.412371+0000", 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8738e-05 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7179 3.4 e29/21 3:266338eb:::rbd_data.1194ccf776f2.000000000000012a:head v 29'42, mlcod=29'39)", 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.832473727, 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076296389999999997, 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409712+0000", 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6199999999999996e-07 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409718+0000", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8089999999999998e-06 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409731+0000", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3016e-05 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409739+0000", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.503e-06 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409784+0000", 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5209e-05 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409806+0000", 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1820000000000001e-05 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417291+0000", 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074857949999999999 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417341+0000", 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9625e-05 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8092 3.9 e29/21 3:95ff2e9d:::rbd_data.1194ccf776f2.000000000000002c:head v 29'33, mlcod=29'31)", 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.746665244000001, 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0028729329999999998, 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.303 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495521+0000", 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0950000000000001e-06 2024-04-23T23:37:57.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495746+0000", 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00022546099999999999 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495761+0000", 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4100999999999999e-05 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495768+0000", 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9480000000000008e-06 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495826+0000", 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7456e-05 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.495850+0000", 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4096000000000001e-05 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.498357+0000", 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025072050000000002 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.498393+0000", 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5571000000000002e-05 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8160 3.4 e29/21 3:2138fb15:::rbd_data.1194ccf776f2.00000000000001f3:head v 29'44, mlcod=29'42)", 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.705240557, 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039317429999999997, 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536946+0000", 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.314e-06 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536958+0000", 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1821000000000001e-05 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536984+0000", 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5986000000000002e-05 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536992+0000", 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6719999999999993e-06 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537058+0000", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5246000000000005e-05 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537083+0000", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5282e-05 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540835+0000", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037519129999999999 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540876+0000", 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.8331495410000009, 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.315 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:57.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:37:57.317 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:57.329+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:57.417 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:57.430+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:57.441 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:57.441 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:57.441 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:57.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:37:57.486 INFO:teuthology.orchestra.run.smithi077.stdout:784 write 0xc63bfc4 thru 0xc63f02a (0x3067 bytes) 2024-04-23T23:37:57.491 INFO:teuthology.orchestra.run.smithi077.stdout:785 write 0x4d139ad thru 0x4d17873 (0x3ec7 bytes) 2024-04-23T23:37:57.496 INFO:teuthology.orchestra.run.smithi077.stdout:786 read 0x5462da2 thru 0x546ae22 (0x8081 bytes) 2024-04-23T23:37:57.496 INFO:teuthology.orchestra.run.smithi077.stdout:789 read 0x460401d thru 0x46074e5 (0x34c9 bytes) 2024-04-23T23:37:57.496 INFO:teuthology.orchestra.run.smithi077.stdout:790 writesame 0x229679b thru 0x229f5a2 data_size 0x78(0x8e08 bytes) 2024-04-23T23:37:57.499 INFO:teuthology.orchestra.run.smithi077.stdout:791 read 0x85f3514 thru 0x85ffa92 (0xc57f bytes) 2024-04-23T23:37:57.499 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.499 INFO:teuthology.orchestra.run.smithi077.stdout:794 read 0x6d61066 thru 0x6d6a88c (0x9827 bytes) 2024-04-23T23:37:57.500 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.500 INFO:teuthology.orchestra.run.smithi077.stdout:797 write 0x6b97ae4 thru 0x6b9adba (0x32d7 bytes) 2024-04-23T23:37:57.501 INFO:teuthology.orchestra.run.smithi077.stdout:800 write 0x362fadd thru 0x3635200 (0x5724 bytes) 2024-04-23T23:37:57.503 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.503 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.503 INFO:teuthology.orchestra.run.smithi077.stdout:803 read 0x3eec081 thru 0x3ef2470 (0x63f0 bytes) 2024-04-23T23:37:57.503 INFO:teuthology.orchestra.run.smithi077.stdout:805 read 0xb16e416 thru 0xb17e192 (0xfd7d bytes) 2024-04-23T23:37:57.516 INFO:teuthology.orchestra.run.smithi077.stdout:807 trunc from 0xc644a8a to 0x1b301d7 2024-04-23T23:37:57.518 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:57.530+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:57.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:37:57.552 INFO:teuthology.orchestra.run.smithi077.stdout:808 write 0x40526ed thru 0x4061de4 (0xf6f8 bytes) 2024-04-23T23:37:57.561 INFO:teuthology.orchestra.run.smithi077.stdout:809 write 0x4cf2afa thru 0x4cf8d2c (0x6233 bytes) 2024-04-23T23:37:57.563 INFO:teuthology.orchestra.run.smithi077.stdout:812 punch from 0x4ce7a40 to 0x4ceaa62, (0x3022 bytes) 2024-04-23T23:37:57.563 INFO:teuthology.orchestra.run.smithi077.stdout:813 read 0x82d2c8 thru 0x838c1c (0xb955 bytes) 2024-04-23T23:37:57.563 INFO:teuthology.orchestra.run.smithi077.stdout:814 punch from 0x38801d6 to 0x3883526, (0x3350 bytes) 2024-04-23T23:37:57.570 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:57.570 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:57.570 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:37:57.570 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:37:57.570 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:57.573 INFO:teuthology.orchestra.run.smithi077.stdout:815 write 0x7e672dc thru 0x7e76aa9 (0xf7ce bytes) 2024-04-23T23:37:57.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:37:57.589 INFO:teuthology.orchestra.run.smithi077.stdout:816 write 0xde9208e thru 0xde97161 (0x50d4 bytes) 2024-04-23T23:37:57.593 INFO:teuthology.orchestra.run.smithi077.stdout:817 writesame 0xc82a59a thru 0xc837c4b data_size 0x1(0xd6b2 bytes) 2024-04-23T23:37:57.618 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:57.630+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:57.620 INFO:teuthology.orchestra.run.smithi077.stdout:818 punch from 0x479a3e9 to 0x479c85f, (0x2476 bytes) 2024-04-23T23:37:57.620 INFO:teuthology.orchestra.run.smithi077.stdout:821 read 0x705fa83 thru 0x706dcbb (0xe239 bytes) 2024-04-23T23:37:57.620 INFO:teuthology.orchestra.run.smithi077.stdout:823 writesame 0x62f44af thru 0x63017f3 data_size 0x5(0xd345 bytes) 2024-04-23T23:37:57.626 INFO:teuthology.orchestra.run.smithi077.stdout:824 read 0xb431b2c thru 0xb43ab34 (0x9009 bytes) 2024-04-23T23:37:57.632 INFO:teuthology.orchestra.run.smithi077.stdout:826 trunc from 0xde97162 to 0xa134eb1 2024-04-23T23:37:57.643 INFO:teuthology.orchestra.run.smithi077.stdout:827 write 0x647f59a thru 0x6481182 (0x1be9 bytes) 2024-04-23T23:37:57.645 INFO:teuthology.orchestra.run.smithi077.stdout:828 write 0x8dabca4 thru 0x8dafe97 (0x41f4 bytes) 2024-04-23T23:37:57.647 INFO:teuthology.orchestra.run.smithi077.stdout:829 write 0x7ae1c28 thru 0x7aede99 (0xc272 bytes) 2024-04-23T23:37:57.649 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.649 INFO:teuthology.orchestra.run.smithi077.stdout:831 writesame 0x8791f4d thru 0x879e996 data_size 0x36(0xca4a bytes) 2024-04-23T23:37:57.655 INFO:teuthology.orchestra.run.smithi077.stdout:832 trunc from 0xa134eb1 to 0xc6bf9ab 2024-04-23T23:37:57.661 INFO:teuthology.orchestra.run.smithi077.stdout:834 punch from 0xaad2de7 to 0xaae13b9, (0xe5d2 bytes) 2024-04-23T23:37:57.661 INFO:teuthology.orchestra.run.smithi077.stdout:836 punch from 0x835b5ad to 0x8366ae6, (0xb539 bytes) 2024-04-23T23:37:57.661 INFO:teuthology.orchestra.run.smithi077.stdout:837 punch from 0x89dcde5 to 0x89de176, (0x1391 bytes) 2024-04-23T23:37:57.661 INFO:teuthology.orchestra.run.smithi077.stdout:838 write 0xbccf976 thru 0xbcd754d (0x7bd8 bytes) 2024-04-23T23:37:57.662 INFO:teuthology.orchestra.run.smithi077.stdout:839 write 0x9fa823a thru 0x9fb5516 (0xd2dd bytes) 2024-04-23T23:37:57.665 INFO:teuthology.orchestra.run.smithi077.stdout:843 write 0x7ba9abf thru 0x7bb363c (0x9b7e bytes) 2024-04-23T23:37:57.665 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:57.666 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:57.667 INFO:teuthology.orchestra.run.smithi077.stdout:844 punch from 0x20df40c to 0x20ecaf1, (0xd6e5 bytes) 2024-04-23T23:37:57.667 INFO:teuthology.orchestra.run.smithi077.stdout:845 write 0xc18b06c thru 0xc19395b (0x88f0 bytes) 2024-04-23T23:37:57.674 INFO:teuthology.orchestra.run.smithi077.stdout:846 trunc from 0xc6bf9ab to 0xdec59cf 2024-04-23T23:37:57.680 INFO:teuthology.orchestra.run.smithi077.stdout:847 write 0xbc8460 thru 0xbd784e (0xf3ef bytes) 2024-04-23T23:37:57.682 INFO:teuthology.orchestra.run.smithi077.stdout:848 write 0x257ab06 thru 0x2580cd9 (0x61d4 bytes) 2024-04-23T23:37:57.684 INFO:teuthology.orchestra.run.smithi077.stdout:851 read 0x2a6fc66 thru 0x2a7dcc1 (0xe05c bytes) 2024-04-23T23:37:57.685 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:57.685 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:57.686 INFO:teuthology.orchestra.run.smithi077.stdout:853 punch from 0x45d2461 to 0x45e1344, (0xeee3 bytes) 2024-04-23T23:37:57.686 INFO:teuthology.orchestra.run.smithi077.stdout:854 writesame 0x998d3f7 thru 0x9998c9b data_size 0x1(0xb8a5 bytes) 2024-04-23T23:37:57.703 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:37:57.703 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:37:57.708 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.708 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.708 INFO:teuthology.orchestra.run.smithi077.stdout:857 read 0xb05a9 thru 0xb43e4 (0x3e3c bytes) 2024-04-23T23:37:57.709 INFO:teuthology.orchestra.run.smithi077.stdout:859 writesame 0x685b30f thru 0x68657dd data_size 0x1(0xa4cf bytes) 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3238 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4161536~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.270061281, 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029291145000000001, 2024-04-23T23:37:57.712 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3238 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452574+0000", 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452582+0000", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8930000000000005e-06 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452587+0000", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3000000000000001e-06 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481755+0000", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029167226000000001 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481797+0000", 2024-04-23T23:37:57.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2651999999999998e-05 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481863+0000", 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5685999999999994e-05 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3252 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 49152~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.270038902, 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029578383999999999, 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.716 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3252 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:37:57.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452595+0000", 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452597+0000", 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452604+0000", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2660000000000004e-06 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452610+0000", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8429999999999998e-06 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481898+0000", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029288338000000001 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482013+0000", 2024-04-23T23:37:57.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000114746 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482172+0000", 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015978300000000001 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3253 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 278528~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.270017138, 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029686714999999999, 2024-04-23T23:37:57.720 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3253 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452618+0000", 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1210000000000001e-06 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452627+0000", 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3489999999999992e-06 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452632+0000", 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1479999999999997e-06 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482187+0000", 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029555272 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482230+0000", 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2750999999999998e-05 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482303+0000", 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2669000000000005e-05 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.724 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3254 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 507904~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269994441000001, 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029953305999999999, 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3254 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452641+0000", 2024-04-23T23:37:57.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1459999999999999e-06 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452647+0000", 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2620000000000004e-06 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452652+0000", 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482338+0000", 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029685554999999999 2024-04-23T23:37:57.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482432+0000", 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4643999999999997e-05 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482592+0000", 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015951100000000001 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3255 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 737280~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.728 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269974331, 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030178470999999998, 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3255 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:57.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452661+0000", 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452667+0000", 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2639999999999997e-06 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452672+0000", 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.848e-06 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482635+0000", 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029962494999999999 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482709+0000", 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4445999999999998e-05 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482837+0000", 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012805100000000001 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3256 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 966656~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269939271999998, 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030449868000000001, 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3256 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3900000000000004e-07 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452697+0000", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452704+0000", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.362e-06 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452710+0000", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5609999999999998e-06 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482891+0000", 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030181050000000001 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482991+0000", 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9586000000000005e-05 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483144+0000", 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015305000000000001 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3257 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1196032~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269915810000001, 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030595397999999999, 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3257 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452718+0000", 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452724+0000", 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452730+0000", 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5320000000000003e-06 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452738+0000", 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7579999999999992e-06 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483178+0000", 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030439931 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483232+0000", 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3695e-05 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483313+0000", 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0858000000000004e-05 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3258 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1425408~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269887192999999, 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030867680000000002, 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3258 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452748+0000", 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452765+0000", 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7003e-05 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452771+0000", 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483351+0000", 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030579967999999999 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483453+0000", 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010173100000000001 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483613+0000", 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016066400000000001 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.744 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3259 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1654784~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269854934000001, 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031145740000000002, 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3259 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.745 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452779+0000", 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452781+0000", 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0360000000000001e-06 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452787+0000", 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2809999999999997e-06 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452793+0000", 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0870000000000003e-06 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483651+0000", 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030858239999999999 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483759+0000", 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107533 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483924+0000", 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016508199999999999 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.748 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3260 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1884160~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269831795999998, 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031422796000000003, 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3260 2024-04-23T23:37:57.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452802+0000", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.72e-07 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452804+0000", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.979e-06 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452811+0000", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0319999999999998e-06 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452816+0000", 2024-04-23T23:37:57.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483962+0000", 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031146258999999999 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484069+0000", 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106846 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484224+0000", 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015536799999999999 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.752 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3261 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2113536~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269811694000001, 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031579572, 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3261 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.753 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452822+0000", 2024-04-23T23:37:57.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452824+0000", 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8419999999999999e-06 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452829+0000", 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7089999999999999e-06 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452835+0000", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3120000000000001e-06 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484254+0000", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031419152999999998 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484305+0000", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1363000000000003e-05 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484401+0000", 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5784000000000003e-05 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3262 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2342912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269792326000001, 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031829887000000001, 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.757 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3262 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:57.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452843+0000", 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452852+0000", 2024-04-23T23:37:57.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5189999999999992e-06 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452857+0000", 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1259999999999997e-06 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484440+0000", 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031583133999999999 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484537+0000", 2024-04-23T23:37:57.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7248000000000001e-05 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484671+0000", 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013340800000000001 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3263 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2572288~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269767572999999, 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032059593999999997, 2024-04-23T23:37:57.761 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3263 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452866+0000", 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452868+0000", 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1560000000000002e-06 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452875+0000", 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5209999999999999e-06 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452879+0000", 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484704+0000", 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031825141000000001 2024-04-23T23:37:57.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484797+0000", 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3107000000000002e-05 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484925+0000", 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000127711 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3264 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2801664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269740749, 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032190086, 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3264 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452893+0000", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452895+0000", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.367e-06 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452902+0000", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1919999999999999e-06 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452908+0000", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.152e-06 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484951+0000", 2024-04-23T23:37:57.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032043673000000002 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485011+0000", 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9840999999999998e-05 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485082+0000", 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1308000000000002e-05 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.769 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3265 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3031040~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269718645000001, 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032433114999999998, 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3265 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452915+0000", 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9399999999999995e-07 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452917+0000", 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0650000000000001e-06 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452923+0000", 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5010000000000001e-06 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452928+0000", 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.746e-06 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485122+0000", 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032193745000000003 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485218+0000", 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6427000000000004e-05 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485347+0000", 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012913700000000001 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.773 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3266 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3260416~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269698828999999, 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032550864999999998, 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3266 2024-04-23T23:37:57.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452935+0000", 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452937+0000", 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452943+0000", 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0630000000000002e-06 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452947+0000", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7079999999999996e-06 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485376+0000", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032428750999999999 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485423+0000", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6597999999999997e-05 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485485+0000", 2024-04-23T23:37:57.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2297000000000003e-05 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3267 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3489792~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269679825000001, 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032811840000000002, 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3267 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452954+0000", 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452955+0000", 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.877e-06 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452962+0000", 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6760000000000001e-06 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452966+0000", 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3089999999999997e-06 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485525+0000", 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032558746 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485632+0000", 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107179 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485765+0000", 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013261600000000001 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3268 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3719168~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269655756999999, 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032909676999999998, 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3268 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452978+0000", 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452980+0000", 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2290000000000002e-06 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452987+0000", 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5869999999999998e-06 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452992+0000", 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9949999999999996e-06 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485780+0000", 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032788386000000003 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485826+0000", 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5744000000000001e-05 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485887+0000", 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1254999999999995e-05 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.786 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3269 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3948544~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269633916, 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033158813000000002, 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3269 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453000+0000", 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:37:57.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453007+0000", 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2320000000000004e-06 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453015+0000", 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453020+0000", 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485924+0000", 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032904299999999997 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486025+0000", 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101184 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486158+0000", 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000132521 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3270 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4177920~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.269606338999999, 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033252354999999997, 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:37:57.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3270 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:37:57.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453029+0000", 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0430000000000002e-06 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453036+0000", 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.545e-06 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453040+0000", 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6450000000000004e-06 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486175+0000", 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033134469999999999 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486220+0000", 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000001e-05 2024-04-23T23:37:57.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486279+0000", 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9021999999999998e-05 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:37:57.795 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:57.797 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:37:57.797 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:37:57.797 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:37:57.798 INFO:teuthology.orchestra.run.smithi077.stdout:861 read 0x17710e thru 0x181d00 (0xabf3 bytes) 2024-04-23T23:37:57.798 INFO:teuthology.orchestra.run.smithi077.stdout:862 writesame 0xa7be4d7 thru 0xa7cd26b data_size 0x1(0xed95 bytes) 2024-04-23T23:37:57.798 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:37:57.798 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:37:57.799 INFO:teuthology.orchestra.run.smithi077.stdout:863 punch from 0x3122d76 to 0x312d2a7, (0xa531 bytes) 2024-04-23T23:37:57.799 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:37:57.799 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:37:57.800 INFO:teuthology.orchestra.run.smithi077.stdout:864 trunc from 0xdec59cf to 0x59a54fd 2024-04-23T23:37:57.800 INFO:teuthology.orchestra.run.smithi077.stdout:865 read 0x3f583a thru 0x3fb1a0 (0x5967 bytes) 2024-04-23T23:37:57.800 INFO:teuthology.orchestra.run.smithi077.stdout:869 read 0x9979bc thru 0x99e1f9 (0x683e bytes) 2024-04-23T23:37:57.800 INFO:teuthology.orchestra.run.smithi077.stdout:870 read 0x2ea217 thru 0x2edb96 (0x3980 bytes) 2024-04-23T23:37:57.800 INFO:teuthology.orchestra.run.smithi077.stdout:871 trunc from 0x59a54fd to 0x333a781 2024-04-23T23:37:57.800 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:37:57.801 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:37:57.801 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.801 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.801 INFO:teuthology.orchestra.run.smithi077.stdout:877 writesame 0x1bc92ed thru 0x1bd71e9 data_size 0x31(0xdefd bytes) 2024-04-23T23:37:57.802 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:57.809+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:57.805 INFO:teuthology.orchestra.run.smithi077.stdout:878 trunc from 0x333a781 to 0x99d5790 2024-04-23T23:37:57.808 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:37:57.808 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:37:57.817 INFO:teuthology.orchestra.run.smithi077.stdout:880 writesame 0xa13608c thru 0xa136558 data_size 0x1(0x4cd bytes) 2024-04-23T23:37:57.817 INFO:teuthology.orchestra.run.smithi077.stdout:881 punch from 0x1e3756 to 0x1e3c10, (0x4ba bytes) 2024-04-23T23:37:57.817 INFO:teuthology.orchestra.run.smithi077.stdout:882 read 0x98df675 thru 0x98ee89d (0xf229 bytes) 2024-04-23T23:37:57.817 INFO:teuthology.orchestra.run.smithi077.stdout:884 writesame 0x7aef92b thru 0x7af0ce6 data_size 0x6(0x13bc bytes) 2024-04-23T23:37:57.820 INFO:teuthology.orchestra.run.smithi077.stdout:885 read 0x99bacc thru 0x9a5af9 (0xa02e bytes) 2024-04-23T23:37:57.820 INFO:teuthology.orchestra.run.smithi077.stdout:889 read 0x9d61b40 thru 0x9d638f2 (0x1db3 bytes) 2024-04-23T23:37:57.820 INFO:teuthology.orchestra.run.smithi077.stdout:890 write 0x941e7f1 thru 0x941f916 (0x1126 bytes) 2024-04-23T23:37:57.823 INFO:teuthology.orchestra.run.smithi077.stdout:891 read 0x109d9a3 thru 0x10aa750 (0xcdae bytes) 2024-04-23T23:37:57.824 INFO:teuthology.orchestra.run.smithi077.stdout:892 write 0x6b5ddff thru 0x6b6a49c (0xc69e bytes) 2024-04-23T23:37:57.827 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.827 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.827 INFO:teuthology.orchestra.run.smithi077.stdout:895 read 0x69ee28a thru 0x69fadfd (0xcb74 bytes) 2024-04-23T23:37:57.835 INFO:teuthology.orchestra.run.smithi077.stdout:898 write 0xbe4eaf9 thru 0xbe58fa7 (0xa4af bytes) 2024-04-23T23:37:57.836 INFO:teuthology.orchestra.run.smithi077.stdout:900 read 0x3de89bb thru 0x3df059e (0x7be4 bytes) 2024-04-23T23:37:57.836 INFO:teuthology.orchestra.run.smithi077.stdout:901 writesame 0xb00be77 thru 0xb013bdf data_size 0x1(0x7d69 bytes) 2024-04-23T23:37:57.851 INFO:teuthology.orchestra.run.smithi077.stdout:903 read 0x623262d thru 0x623fae4 (0xd4b8 bytes) 2024-04-23T23:37:57.857 INFO:teuthology.orchestra.run.smithi077.stdout:906 write 0xc144d2c thru 0xc14c52f (0x7804 bytes) 2024-04-23T23:37:57.860 INFO:teuthology.orchestra.run.smithi077.stdout:909 write 0x77ab0a6 thru 0x77ac93a (0x1895 bytes) 2024-04-23T23:37:57.861 INFO:teuthology.orchestra.run.smithi077.stdout:910 read 0x67b3e84 thru 0x67c13b5 (0xd532 bytes) 2024-04-23T23:37:57.862 INFO:teuthology.orchestra.run.smithi077.stdout:911 writesame 0x1729e24 thru 0x1735dcd data_size 0x1(0xbfaa bytes) 2024-04-23T23:37:57.873 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:37:57.889 INFO:teuthology.orchestra.run.smithi077.stdout:912 punch from 0x82edea6 to 0x82f10c4, (0x321e bytes) 2024-04-23T23:37:57.899 INFO:teuthology.orchestra.run.smithi077.stdout:914 writesame 0xc6782a2 thru 0xc67b003 data_size 0x25(0x2d62 bytes) 2024-04-23T23:37:57.899 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:57.911+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:57.908 INFO:teuthology.orchestra.run.smithi077.stdout:917 write 0xee22beb thru 0xee2b644 (0x8a5a bytes) 2024-04-23T23:37:57.911 INFO:teuthology.orchestra.run.smithi077.stdout:918 read 0x5ef8437 thru 0x5f00510 (0x80da bytes) 2024-04-23T23:37:57.911 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:57.911 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:57.919 INFO:teuthology.orchestra.run.smithi077.stdout:919 trunc from 0xee2b645 to 0x8da7084 2024-04-23T23:37:57.920 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:37:57.931 INFO:teuthology.orchestra.run.smithi077.stdout:920 read 0x81f5226 thru 0x81f9f2b (0x4d06 bytes) 2024-04-23T23:37:57.938 INFO:teuthology.orchestra.run.smithi077.stdout:921 trunc from 0x8da7084 to 0x3b645f5 2024-04-23T23:37:57.949 INFO:teuthology.orchestra.run.smithi077.stdout:922 read 0x2b782f0 thru 0x2b85e5c (0xdb6d bytes) 2024-04-23T23:37:57.951 INFO:teuthology.orchestra.run.smithi077.stdout:923 trunc from 0x3b645f5 to 0x2a77396 2024-04-23T23:37:57.958 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:57.966 INFO:teuthology.orchestra.run.smithi077.stdout:925 write 0x480c083 thru 0x4816ee6 (0xae64 bytes) 2024-04-23T23:37:57.980 INFO:teuthology.orchestra.run.smithi077.stdout:926 write 0x99b9ce3 thru 0x99bf83f (0x5b5d bytes) 2024-04-23T23:37:57.990 INFO:teuthology.orchestra.run.smithi077.stdout:927 trunc from 0x99bf840 to 0x3b32587 2024-04-23T23:37:57.997 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:58.010+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:58.016 INFO:teuthology.orchestra.run.smithi077.stdout:928 writesame 0xb1c5463 thru 0xb1c880b data_size 0x1(0x33a9 bytes) 2024-04-23T23:37:58.016 INFO:teuthology.orchestra.run.smithi077.stdout:929 read 0x388f028 thru 0x389835d (0x9336 bytes) 2024-04-23T23:37:58.024 INFO:teuthology.orchestra.run.smithi077.stdout:930 trunc from 0xb1c880c to 0x48d6689 2024-04-23T23:37:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.029 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.034 INFO:teuthology.orchestra.run.smithi077.stdout:931 read 0x216c665 thru 0x2172ec6 (0x6862 bytes) 2024-04-23T23:37:58.039 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:37:58.039 INFO:teuthology.orchestra.run.smithi077.stdout:932 trunc from 0x48d6689 to 0x8ae2f8c 2024-04-23T23:37:58.045 INFO:teuthology.orchestra.run.smithi077.stdout:933 read 0x7404fce thru 0x741487d (0xf8b0 bytes) 2024-04-23T23:37:58.050 INFO:teuthology.orchestra.run.smithi077.stdout:934 writesame 0x925355a thru 0x9255880 data_size 0x1(0x2327 bytes) 2024-04-23T23:37:58.050 INFO:teuthology.orchestra.run.smithi077.stdout:936 read 0x665ab67 thru 0x665d2fa (0x2794 bytes) 2024-04-23T23:37:58.051 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.056 INFO:teuthology.orchestra.run.smithi077.stdout:939 trunc from 0x9255881 to 0xe59bf82 2024-04-23T23:37:58.061 INFO:teuthology.orchestra.run.smithi077.stdout:941 read 0xc538631 thru 0xc53ff18 (0x78e8 bytes) 2024-04-23T23:37:58.062 INFO:teuthology.orchestra.run.smithi077.stdout:942 write 0x545eea9 thru 0x5460575 (0x16cd bytes) 2024-04-23T23:37:58.067 INFO:teuthology.orchestra.run.smithi077.stdout:943 trunc from 0xe59bf82 to 0xad84f93 2024-04-23T23:37:58.073 INFO:teuthology.orchestra.run.smithi077.stdout:944 punch from 0x88d81dc to 0x88ddfb6, (0x5dda bytes) 2024-04-23T23:37:58.073 INFO:teuthology.orchestra.run.smithi077.stdout:946 write 0x8c7d7d0 thru 0x8c8b149 (0xd97a bytes) 2024-04-23T23:37:58.077 INFO:teuthology.orchestra.run.smithi077.stdout:947 read 0x74345e8 thru 0x74395df (0x4ff8 bytes) 2024-04-23T23:37:58.077 INFO:teuthology.orchestra.run.smithi077.stdout:949 read 0x38844e3 thru 0x38879b7 (0x34d5 bytes) 2024-04-23T23:37:58.077 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.077 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.077 INFO:teuthology.orchestra.run.smithi077.stdout:952 writesame 0x7f87662 thru 0x7f8c29b data_size 0xb(0x4c3a bytes) 2024-04-23T23:37:58.079 INFO:teuthology.orchestra.run.smithi077.stdout:953 punch from 0x2ec7da7 to 0x2ed121c, (0x9475 bytes) 2024-04-23T23:37:58.079 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.079 INFO:teuthology.orchestra.run.smithi077.stdout:956 read 0x1d03356 thru 0x1d0702f (0x3cda bytes) 2024-04-23T23:37:58.084 INFO:teuthology.orchestra.run.smithi077.stdout:958 writesame 0xb025533 thru 0xb02efe5 data_size 0x2b(0x9ab3 bytes) 2024-04-23T23:37:58.094 INFO:teuthology.orchestra.run.smithi077.stdout:959 write 0xe36ec26 thru 0xe371a2d (0x2e08 bytes) 2024-04-23T23:37:58.097 INFO:teuthology.orchestra.run.smithi077.stdout:960 write 0xd16a9d3 thru 0xd177065 (0xc693 bytes) 2024-04-23T23:37:58.099 INFO:teuthology.orchestra.run.smithi077.stdout:961 read 0xa0a3cce thru 0xa0aa681 (0x69b4 bytes) 2024-04-23T23:37:58.099 INFO:teuthology.orchestra.run.smithi077.stdout:962 punch from 0x1921d9f to 0x19279ca, (0x5c2b bytes) 2024-04-23T23:37:58.099 INFO:teuthology.orchestra.run.smithi077.stdout:964 punch from 0x438f019 to 0x439cdb7, (0xdd9e bytes) 2024-04-23T23:37:58.099 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.099 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:58.111+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:58.108 INFO:teuthology.orchestra.run.smithi077.stdout:966 trunc from 0xe371a2e to 0x5983864 2024-04-23T23:37:58.133 INFO:teuthology.orchestra.run.smithi077.stdout:967 write 0xc1a7b1a thru 0xc1a8280 (0x767 bytes) 2024-04-23T23:37:58.142 INFO:teuthology.orchestra.run.smithi077.stdout:968 write 0xc8ed5bd thru 0xc8f2cb5 (0x56f9 bytes) 2024-04-23T23:37:58.145 INFO:teuthology.orchestra.run.smithi077.stdout:969 punch from 0x425da96 to 0x426a9be, (0xcf28 bytes) 2024-04-23T23:37:58.145 INFO:teuthology.orchestra.run.smithi077.stdout:970 read 0x49fc489 thru 0x49fe797 (0x230f bytes) 2024-04-23T23:37:58.145 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.152 INFO:teuthology.orchestra.run.smithi077.stdout:972 writesame 0xe048869 thru 0xe055c39 data_size 0x2d(0xd3d1 bytes) 2024-04-23T23:37:58.153 INFO:teuthology.orchestra.run.smithi077.stdout:973 read 0x308ee43 thru 0x309912b (0xa2e9 bytes) 2024-04-23T23:37:58.154 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.154 INFO:teuthology.orchestra.run.smithi077.stdout:976 read 0xbad181c thru 0xbadec15 (0xd3fa bytes) 2024-04-23T23:37:58.154 INFO:teuthology.orchestra.run.smithi077.stdout:978 read 0x67ef99 thru 0x683d67 (0x4dcf bytes) 2024-04-23T23:37:58.154 INFO:teuthology.orchestra.run.smithi077.stdout:979 read 0x11cf03d thru 0x11d4d1f (0x5ce3 bytes) 2024-04-23T23:37:58.155 INFO:teuthology.orchestra.run.smithi077.stdout:981 writesame 0x3825251 thru 0x3831c94 data_size 0x1e(0xca44 bytes) 2024-04-23T23:37:58.157 INFO:teuthology.orchestra.run.smithi077.stdout:983 flatten 2024-04-23T23:37:58.168 INFO:teuthology.orchestra.run.smithi077.stdout:984 trunc from 0xe055c3a to 0xa4e4530 2024-04-23T23:37:58.177 INFO:teuthology.orchestra.run.smithi077.stdout:985 write 0x68201e5 thru 0x6828723 (0x853f bytes) 2024-04-23T23:37:58.180 INFO:teuthology.orchestra.run.smithi077.stdout:986 read 0x9623d4a thru 0x962cf38 (0x91ef bytes) 2024-04-23T23:37:58.187 INFO:teuthology.orchestra.run.smithi077.stdout:987 trunc from 0xa4e4530 to 0x4f60df8 2024-04-23T23:37:58.187 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.188 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.197 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:37:58.198 INFO:teuthology.orchestra.run.smithi077.stdout:988 read 0x494f2c3 thru 0x495ceeb (0xdc29 bytes) 2024-04-23T23:37:58.199 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:58.211+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:58.202 INFO:teuthology.orchestra.run.smithi077.stdout:989 trunc from 0x4f60df8 to 0x7a4271e 2024-04-23T23:37:58.207 INFO:teuthology.orchestra.run.smithi077.stdout:991 write 0x31bbbc0 thru 0x31c53db (0x981c bytes) 2024-04-23T23:37:58.211 INFO:teuthology.orchestra.run.smithi077.stdout:993 read 0x5ab11c7 thru 0x5aba562 (0x939c bytes) 2024-04-23T23:37:58.212 INFO:teuthology.orchestra.run.smithi077.stdout:994 writesame 0x38983d1 thru 0x38a4fb8 data_size 0x3(0xcbe8 bytes) 2024-04-23T23:37:58.228 INFO:teuthology.orchestra.run.smithi077.stdout:998 write 0x8b792dd thru 0x8b7a0d5 (0xdf9 bytes) 2024-04-23T23:37:58.230 INFO:teuthology.orchestra.run.smithi077.stdout:999 punch from 0x6560e7e to 0x6563dd8, (0x2f5a bytes) 2024-04-23T23:37:58.236 INFO:teuthology.orchestra.run.smithi077.stdout:1001 writesame 0x8f2913a thru 0x8f33b97 data_size 0x9(0xaa5e bytes) 2024-04-23T23:37:58.239 INFO:teuthology.orchestra.run.smithi077.stdout:1002 trunc from 0x8f33b98 to 0xa943f1a 2024-04-23T23:37:58.247 INFO:teuthology.orchestra.run.smithi077.stdout:1004 punch from 0xa8e008e to 0xa8eae27, (0xad99 bytes) 2024-04-23T23:37:58.247 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.250 INFO:teuthology.orchestra.run.smithi077.stdout:1010 trunc from 0xa943f1a to 0xcb01690 2024-04-23T23:37:58.255 INFO:teuthology.orchestra.run.smithi077.stdout:1012 write 0x4fda511 thru 0x4fdf312 (0x4e02 bytes) 2024-04-23T23:37:58.260 INFO:teuthology.orchestra.run.smithi077.stdout:1015 punch from 0xbce30c7 to 0xbce9b4a, (0x6a83 bytes) 2024-04-23T23:37:58.260 INFO:teuthology.orchestra.run.smithi077.stdout:1016 read 0x5bbe04c thru 0x5bc7fd0 (0x9f85 bytes) 2024-04-23T23:37:58.263 INFO:teuthology.orchestra.run.smithi077.stdout:1017 trunc from 0xcb01690 to 0xa552e30 2024-04-23T23:37:58.269 INFO:teuthology.orchestra.run.smithi077.stdout:1018 writesame 0x6670055 thru 0x667d281 data_size 0x55(0xd22d bytes) 2024-04-23T23:37:58.274 INFO:teuthology.orchestra.run.smithi077.stdout:1019 writesame 0x901b21b thru 0x901ff75 data_size 0x45(0x4d5b bytes) 2024-04-23T23:37:58.277 INFO:teuthology.orchestra.run.smithi077.stdout:1021 read 0x183f66f thru 0x1845445 (0x5dd7 bytes) 2024-04-23T23:37:58.278 INFO:teuthology.orchestra.run.smithi077.stdout:1022 read 0x24c380f thru 0x24d04b0 (0xcca2 bytes) 2024-04-23T23:37:58.278 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.278 INFO:teuthology.orchestra.run.smithi077.stdout:1024 read 0x4a8dff8 thru 0x4a91577 (0x3580 bytes) 2024-04-23T23:37:58.288 INFO:teuthology.orchestra.run.smithi077.stdout:1025 write 0xe984eb3 thru 0xe98f23f (0xa38d bytes) 2024-04-23T23:37:58.292 INFO:teuthology.orchestra.run.smithi077.stdout:1026 writesame 0x8a2c957 thru 0x8a3b145 data_size 0x5f(0xe7ef bytes) 2024-04-23T23:37:58.293 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.294 INFO:teuthology.orchestra.run.smithi077.stdout:1028 punch from 0xb331ab0 to 0xb336d18, (0x5268 bytes) 2024-04-23T23:37:58.294 INFO:teuthology.orchestra.run.smithi077.stdout:1029 read 0x8b719c0 thru 0x8b7f057 (0xd698 bytes) 2024-04-23T23:37:58.294 INFO:teuthology.orchestra.run.smithi077.stdout:1030 writesame 0x42f3c23 thru 0x42f9ac4 data_size 0x1(0x5ea2 bytes) 2024-04-23T23:37:58.300 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:58.313+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.307 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.316 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:37:58.322 INFO:teuthology.orchestra.run.smithi077.stdout:1032 trunc from 0xe98f240 to 0xc714bd 2024-04-23T23:37:58.337 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.337 INFO:teuthology.orchestra.run.smithi077.stdout:1035 punch from 0xe8e8 to 0x1cb71, (0xe289 bytes) 2024-04-23T23:37:58.337 INFO:teuthology.orchestra.run.smithi077.stdout:1036 read 0xa04c35 thru 0xa09dfc (0x51c8 bytes) 2024-04-23T23:37:58.353 INFO:teuthology.orchestra.run.smithi077.stdout:1037 write 0xaa14559 thru 0xaa2090c (0xc3b4 bytes) 2024-04-23T23:37:58.356 INFO:teuthology.orchestra.run.smithi077.stdout:1038 read 0xa17420c thru 0xa17a693 (0x6488 bytes) 2024-04-23T23:37:58.357 INFO:teuthology.orchestra.run.smithi077.stdout:1039 read 0x3144b53 thru 0x3151d0b (0xd1b9 bytes) 2024-04-23T23:37:58.357 INFO:teuthology.orchestra.run.smithi077.stdout:1040 punch from 0x26a7d4e to 0x26ab076, (0x3328 bytes) 2024-04-23T23:37:58.357 INFO:teuthology.orchestra.run.smithi077.stdout:1041 read 0x9a9c61d thru 0x9aa5aef (0x94d3 bytes) 2024-04-23T23:37:58.357 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.365 INFO:teuthology.orchestra.run.smithi077.stdout:1046 write 0xd921f17 thru 0xd92a9c9 (0x8ab3 bytes) 2024-04-23T23:37:58.368 INFO:teuthology.orchestra.run.smithi077.stdout:1047 write 0x3d5395d thru 0x3d62039 (0xe6dd bytes) 2024-04-23T23:37:58.370 INFO:teuthology.orchestra.run.smithi077.stdout:1050 read 0x2b483a2 thru 0x2b53f27 (0xbb86 bytes) 2024-04-23T23:37:58.370 INFO:teuthology.orchestra.run.smithi077.stdout:1051 read 0x21f6c33 thru 0x21fa870 (0x3c3e bytes) 2024-04-23T23:37:58.371 INFO:teuthology.orchestra.run.smithi077.stdout:1052 trunc from 0xd92a9ca to 0xd8a77c2 2024-04-23T23:37:58.377 INFO:teuthology.orchestra.run.smithi077.stdout:1053 punch from 0x4801da2 to 0x480d8cd, (0xbb2b bytes) 2024-04-23T23:37:58.377 INFO:teuthology.orchestra.run.smithi077.stdout:1056 write 0x3034e57 thru 0x303a2b3 (0x545d bytes) 2024-04-23T23:37:58.384 INFO:teuthology.orchestra.run.smithi077.stdout:1057 writesame 0xde93542 thru 0xde9fa8d data_size 0x5c(0xc54c bytes) 2024-04-23T23:37:58.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:58.384 INFO:teuthology.orchestra.run.smithi077.stdout:1061 writesame 0x422064 thru 0x424176 data_size 0x1(0x2113 bytes) 2024-04-23T23:37:58.389 INFO:teuthology.orchestra.run.smithi077.stdout:1062 clone 5 order 21 su 262144 sc 15 2024-04-23T23:37:58.401 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:58.413+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:58.459 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.459 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.468 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:37:58.509 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:58.522+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:58.602 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:58.615+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:58.610 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.610 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.619 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:37:58.703 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:58.715+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:58.762 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.762 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.770 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:37:58.804 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:37:58.816+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:37:58.871 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.871 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.879 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:37:58.888 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:37:58.888 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:37:58.888 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-23T23:37:58.888 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-23T23:37:58.888 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-23T23:37:58.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-23T23:37:58.932 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:58.944+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:58.986 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:58.986 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:58.994 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:37:58.998 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:58.999 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-23T23:37:58.999 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:59.006 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:59.018+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:59.092 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-04-23T23:37:59.100 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:59.100 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:59.107 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:37:59.119+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:37:59.109 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:37:59.208 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:37:59.220+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:37:59.266 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:59.266 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:59.280 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:37:59.321 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:59.334+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:59.409 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:59.422+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:59.430 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:59.430 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:59.438 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:37:59.510 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:59.523+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:59.582 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:59.582 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:59.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:37:59.635 INFO:teuthology.orchestra.run.smithi077.stdout:1063 read 0x191683c thru 0x191c8d6 (0x609b bytes) 2024-04-23T23:37:59.635 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:37:59.647+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:37:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:1066 read 0xa3a9753 thru 0xa3af74a (0x5ff8 bytes) 2024-04-23T23:37:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:1067 read 0x15495be thru 0x154e4ce (0x4f11 bytes) 2024-04-23T23:37:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:1069 read 0x279d2e6 thru 0x27ab07f (0xdd9a bytes) 2024-04-23T23:37:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:1070 trunc from 0xde9fa8e to 0x5969e76 2024-04-23T23:37:59.662 INFO:teuthology.orchestra.run.smithi077.stdout:1071 punch from 0x2e5c8d9 to 0x2e66a06, (0xa12d bytes) 2024-04-23T23:37:59.671 INFO:teuthology.orchestra.run.smithi077.stdout:1072 trunc from 0x5969e76 to 0xd1e7785 2024-04-23T23:37:59.676 INFO:teuthology.orchestra.run.smithi077.stdout:1073 writesame 0xba93800 thru 0xba94e90 data_size 0x1(0x1691 bytes) 2024-04-23T23:37:59.680 INFO:teuthology.orchestra.run.smithi077.stdout:1074 write 0x324cc70 thru 0x324e3d4 (0x1765 bytes) 2024-04-23T23:37:59.698 INFO:teuthology.orchestra.run.smithi077.stdout:1075 trunc from 0xd1e7785 to 0x2002def 2024-04-23T23:37:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:59.712 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:37:59.725+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:37:59.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:37:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:1077 read 0xbce893 thru 0xbd4b11 (0x627f bytes) 2024-04-23T23:37:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:1079 punch from 0x792e18 to 0x79406e, (0x1256 bytes) 2024-04-23T23:37:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:1080 read 0xd0e268 thru 0xd1ad1e (0xcab7 bytes) 2024-04-23T23:37:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:1081 read 0x53bfd9 thru 0x549bc9 (0xdbf1 bytes) 2024-04-23T23:37:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:1082 read 0xf94ea9 thru 0xf9a628 (0x5780 bytes) 2024-04-23T23:37:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:1086 punch from 0x4ab89f to 0x4ac702, (0xe63 bytes) 2024-04-23T23:37:59.740 INFO:teuthology.orchestra.run.smithi077.stdout:1088 writesame 0xcba7922 thru 0xcba93a6 data_size 0x1f(0x1a85 bytes) 2024-04-23T23:37:59.740 INFO:teuthology.orchestra.run.smithi077.stdout:1089 read 0xa780e86 thru 0xa78c3d2 (0xb54d bytes) 2024-04-23T23:37:59.740 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.740 INFO:teuthology.orchestra.run.smithi077.stdout:1091 read 0x1e4d0b1 thru 0x1e5b73e (0xe68e bytes) 2024-04-23T23:37:59.740 INFO:teuthology.orchestra.run.smithi077.stdout:1092 punch from 0x6ee3a11 to 0x6eebebd, (0x84ac bytes) 2024-04-23T23:37:59.740 INFO:teuthology.orchestra.run.smithi077.stdout:1094 punch from 0xa046ea5 to 0xa052eb8, (0xc013 bytes) 2024-04-23T23:37:59.741 INFO:teuthology.orchestra.run.smithi077.stdout:1095 write 0x816665f thru 0x816c192 (0x5b34 bytes) 2024-04-23T23:37:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:1096 punch from 0x671d8a9 to 0x672b7e7, (0xdf3e bytes) 2024-04-23T23:37:59.750 INFO:teuthology.orchestra.run.smithi077.stdout:1097 trunc from 0xcba93a7 to 0x7062bcf 2024-04-23T23:37:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:1098 writesame 0xcd1cb8f thru 0xcd2157f data_size 0x1(0x49f1 bytes) 2024-04-23T23:37:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:1099 write 0xad9f2f2 thru 0xada5138 (0x5e47 bytes) 2024-04-23T23:37:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:1100 trunc from 0xcd21580 to 0x2d29846 2024-04-23T23:37:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:1101 trunc from 0x2d29846 to 0xc16edb 2024-04-23T23:37:59.813 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:37:59.826+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:37:59.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:37:59.850 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:37:59.850 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:37:59.855 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.855 INFO:teuthology.orchestra.run.smithi077.stdout:1104 read 0x8e6240 thru 0x8f4a90 (0xe851 bytes) 2024-04-23T23:37:59.855 INFO:teuthology.orchestra.run.smithi077.stdout:1106 read 0x99326e thru 0x99dce6 (0xaa79 bytes) 2024-04-23T23:37:59.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:37:59.868 INFO:teuthology.orchestra.run.smithi077.stdout:1107 writesame 0x5bf58ce thru 0x5bfe9b0 data_size 0x1(0x90e3 bytes) 2024-04-23T23:37:59.874 INFO:teuthology.orchestra.run.smithi077.stdout:1108 writesame 0x6650ce3 thru 0x665d4bd data_size 0x1(0xc7db bytes) 2024-04-23T23:37:59.874 INFO:teuthology.orchestra.run.smithi077.stdout:1109 writesame 0x1326639 thru 0x132675e data_size 0x3(0x126 bytes) 2024-04-23T23:37:59.882 INFO:teuthology.orchestra.run.smithi077.stdout:1110 write 0x8fc1a42 thru 0x8fcc586 (0xab45 bytes) 2024-04-23T23:37:59.886 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.886 INFO:teuthology.orchestra.run.smithi077.stdout:1112 punch from 0x58d3143 to 0x58e282c, (0xf6e9 bytes) 2024-04-23T23:37:59.886 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:37:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:1116 writesame 0xb5cd8ee thru 0xb5dcb2a data_size 0x7(0xf23d bytes) 2024-04-23T23:37:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:1117 writesame 0xa8193e4 thru 0xa82552d data_size 0x9(0xc14a bytes) 2024-04-23T23:37:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:1120 writesame 0x63ceb07 thru 0x63d9e9f data_size 0x1(0xb399 bytes) 2024-04-23T23:37:59.914 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:37:59.926+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:37:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:1122 writesame 0x6282db0 thru 0x6286dc7 data_size 0x1c(0x4018 bytes) 2024-04-23T23:37:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:1123 read 0xfca4a2 thru 0xfd58d7 (0xb436 bytes) 2024-04-23T23:37:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:1125 trunc from 0xb5dcb2b to 0x39e5910 2024-04-23T23:37:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:1126 write 0x29430f2 thru 0x294c902 (0x9811 bytes) 2024-04-23T23:37:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:1127 punch from 0x35fd5fa to 0x360afe5, (0xd9eb bytes) 2024-04-23T23:37:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:1128 punch from 0x24d69ce to 0x24e4e67, (0xe499 bytes) 2024-04-23T23:37:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:1130 read 0x2314eb9 thru 0x2319dbc (0x4f04 bytes) 2024-04-23T23:37:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:1131 punch from 0x1309297 to 0x130d035, (0x3d9e bytes) 2024-04-23T23:37:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:1132 writesame 0x67b86e1 thru 0x67c4d70 data_size 0x30(0xc690 bytes) 2024-04-23T23:37:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:1133 read 0x437590f thru 0x437a673 (0x4d65 bytes) 2024-04-23T23:37:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:37:59.957 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:37:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:1135 trunc from 0x67c4d71 to 0x22cf49 2024-04-23T23:37:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:37:59.978 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:37:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:1137 punch from 0x13d232 to 0x149072, (0xbe40 bytes) 2024-04-23T23:37:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:1138 write 0x7ceb01 thru 0x7d5f55 (0x7455 bytes) 2024-04-23T23:37:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:37:59.992 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:37:59.992 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:37:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:37:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:37:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:1141 trunc from 0x7d5f56 to 0x2437b02 2024-04-23T23:38:00.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:1142 trunc from 0x2437b02 to 0x91b3013 2024-04-23T23:38:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:00.012 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:1143 read 0x6066312 thru 0x606dbb7 (0x78a6 bytes) 2024-04-23T23:38:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:1145 writesame 0x4a05cb1 thru 0x4a0c8cf data_size 0x1(0x6c1f bytes) 2024-04-23T23:38:00.015 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:00.028+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:00.037 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:00.037 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:1146 trunc from 0x91b3013 to 0x1c565f 2024-04-23T23:38:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:00.057 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:1148 write 0x47dcfb thru 0x47f5b2 (0x18b8 bytes) 2024-04-23T23:38:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:00.075 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:1149 write 0x5a16f23 thru 0x5a17c84 (0xd62 bytes) 2024-04-23T23:38:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:1151 write 0x63163f7 thru 0x6317dfc (0x1a06 bytes) 2024-04-23T23:38:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:1152 punch from 0x566bec1 to 0x567bba6, (0xfce5 bytes) 2024-04-23T23:38:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:1154 read 0x5a5689 thru 0x5b2e91 (0xd809 bytes) 2024-04-23T23:38:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:1156 read 0x204d696 thru 0x20585c3 (0xaf2e bytes) 2024-04-23T23:38:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:00.093 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:1157 write 0xb0cb4d1 thru 0xb0d2dd4 (0x7904 bytes) 2024-04-23T23:38:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:1158 read 0x68f9560 thru 0x68fff64 (0x6a05 bytes) 2024-04-23T23:38:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:1159 read 0x4b6d482 thru 0x4b6f555 (0x20d4 bytes) 2024-04-23T23:38:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:1160 trunc from 0xb0d2dd5 to 0x6042906 2024-04-23T23:38:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:00.116 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:00.129+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:1161 write 0x55b92ad thru 0x55bec18 (0x596c bytes) 2024-04-23T23:38:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:1162 read 0x5493a0f thru 0x54a21f6 (0xe7e8 bytes) 2024-04-23T23:38:00.129 INFO:teuthology.orchestra.run.smithi077.stdout:1164 trunc from 0x6042906 to 0xc96a891 2024-04-23T23:38:00.134 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.135 INFO:teuthology.orchestra.run.smithi077.stdout:1167 read 0x6d772 thru 0x7b9e3 (0xe272 bytes) 2024-04-23T23:38:00.135 INFO:teuthology.orchestra.run.smithi077.stdout:1168 read 0x627c1e0 thru 0x6283c06 (0x7a27 bytes) 2024-04-23T23:38:00.140 INFO:teuthology.orchestra.run.smithi077.stdout:1169 trunc from 0xc96a891 to 0x8fa8ad2 2024-04-23T23:38:00.141 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:00.141 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:00.141 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:00.141 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:00.141 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:00.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:00.154 INFO:teuthology.orchestra.run.smithi077.stdout:1170 write 0xcc00409 thru 0xcc0486e (0x4466 bytes) 2024-04-23T23:38:00.157 INFO:teuthology.orchestra.run.smithi077.stdout:1172 read 0xabe1a80 thru 0xabef6fb (0xdc7c bytes) 2024-04-23T23:38:00.157 INFO:teuthology.orchestra.run.smithi077.stdout:1173 write 0xc4c28e5 thru 0xc4c30dc (0x7f8 bytes) 2024-04-23T23:38:00.160 INFO:teuthology.orchestra.run.smithi077.stdout:1175 write 0x3a1ed27 thru 0x3a281a4 (0x947e bytes) 2024-04-23T23:38:00.163 INFO:teuthology.orchestra.run.smithi077.stdout:1176 write 0x9d1fb4c thru 0x9d2faa4 (0xff59 bytes) 2024-04-23T23:38:00.166 INFO:teuthology.orchestra.run.smithi077.stdout:1177 writesame 0xc742bfc thru 0xc742dc3 data_size 0x4(0x1c8 bytes) 2024-04-23T23:38:00.169 INFO:teuthology.orchestra.run.smithi077.stdout:1179 writesame 0xb49bac5 thru 0xb49e196 data_size 0x1(0x26d2 bytes) 2024-04-23T23:38:00.181 INFO:teuthology.orchestra.run.smithi077.stdout:1180 write 0xeaebd55 thru 0xeaf290d (0x6bb9 bytes) 2024-04-23T23:38:00.184 INFO:teuthology.orchestra.run.smithi077.stdout:1182 read 0x6fa99a0 thru 0x6fb00a1 (0x6702 bytes) 2024-04-23T23:38:00.184 INFO:teuthology.orchestra.run.smithi077.stdout:1183 write 0x191e2c9 thru 0x192c821 (0xe559 bytes) 2024-04-23T23:38:00.187 INFO:teuthology.orchestra.run.smithi077.stdout:1187 read 0x131f40a thru 0x1329f69 (0xab60 bytes) 2024-04-23T23:38:00.188 INFO:teuthology.orchestra.run.smithi077.stdout:1188 read 0xef55a1 thru 0xef6d72 (0x17d2 bytes) 2024-04-23T23:38:00.188 INFO:teuthology.orchestra.run.smithi077.stdout:1189 read 0x71fa8bd thru 0x7201d15 (0x7459 bytes) 2024-04-23T23:38:00.188 INFO:teuthology.orchestra.run.smithi077.stdout:1191 write 0x21ad90c thru 0x21b2c66 (0x535b bytes) 2024-04-23T23:38:00.191 INFO:teuthology.orchestra.run.smithi077.stdout:1192 write 0xc7013e3 thru 0xc7099b5 (0x85d3 bytes) 2024-04-23T23:38:00.200 INFO:teuthology.orchestra.run.smithi077.stdout:1193 trunc from 0xeaf290e to 0x8e556bc 2024-04-23T23:38:00.210 INFO:teuthology.orchestra.run.smithi077.stdout:1194 write 0x818f2cd thru 0x81950ae (0x5de2 bytes) 2024-04-23T23:38:00.214 INFO:teuthology.orchestra.run.smithi077.stdout:1197 read 0x581ecc7 thru 0x5827291 (0x85cb bytes) 2024-04-23T23:38:00.214 INFO:teuthology.orchestra.run.smithi077.stdout:1198 read 0x54c8f08 thru 0x54d8707 (0xf800 bytes) 2024-04-23T23:38:00.217 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:00.230+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:1200 writesame 0xbb9fc45 thru 0xbba914f data_size 0xd(0x950b bytes) 2024-04-23T23:38:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:1202 punch from 0x4b531eb to 0x4b5db6b, (0xa980 bytes) 2024-04-23T23:38:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:1203 punch from 0xbea50f to 0xbf02bd, (0x5dae bytes) 2024-04-23T23:38:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:1204 read 0x355e5b6 thru 0x3566bc9 (0x8614 bytes) 2024-04-23T23:38:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:1205 read 0xa355b00 thru 0xa361621 (0xbb22 bytes) 2024-04-23T23:38:00.223 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.224 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.234 INFO:teuthology.orchestra.run.smithi077.stdout:1209 trunc from 0xbba9150 to 0x3adcf7b 2024-04-23T23:38:00.244 INFO:teuthology.orchestra.run.smithi077.stdout:1210 read 0x2b71426 thru 0x2b727d9 (0x13b4 bytes) 2024-04-23T23:38:00.244 INFO:teuthology.orchestra.run.smithi077.stdout:1211 writesame 0x1ce0817 thru 0x1ce6615 data_size 0xd(0x5dff bytes) 2024-04-23T23:38:00.246 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.248 INFO:teuthology.orchestra.run.smithi077.stdout:1213 trunc from 0x3adcf7b to 0x52d2147 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1987 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17743872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:38:00.268 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083969646, 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011463825, 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1987 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195410+0000", 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195412+0000", 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195418+0000", 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5979999999999996e-06 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195422+0000", 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4290000000000003e-06 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206767+0000", 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011344745 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206817+0000", 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9740000000000001e-05 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206874+0000", 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7138000000000001e-05 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.272 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1988 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 17973248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083951767999999, 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011660201, 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1988 2024-04-23T23:38:00.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195428+0000", 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195430+0000", 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195436+0000", 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7350000000000001e-06 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195440+0000", 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3059999999999999e-06 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206908+0000", 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011467989 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.206993+0000", 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4746999999999993e-05 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207088+0000", 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5391999999999997e-05 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1989 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18202624~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083934265, 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011792265999999999, 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1989 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195445+0000", 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195446+0000", 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195447+0000", 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195453+0000", 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8830000000000003e-06 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195457+0000", 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0860000000000004e-06 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207122+0000", 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011664737 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207177+0000", 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4632000000000001e-05 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207238+0000", 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0859999999999997e-05 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083915093000002, 2024-04-23T23:38:00.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:00.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.285 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083885557999999, 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.286 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083865785, 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:38:00.290 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.294 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083848239000002, 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:38:00.298 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083830728999999, 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.299 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:38:00.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083790190999999, 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.303 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.307 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083776625999999, 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:38:00.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:38:00.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083767028, 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.312 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:38:00.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:38:00.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083756466000001, 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:38:00.316 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:38:00.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:38:00.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083747149000001, 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083737961000001, 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:38:00.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:00.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:38:00.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.083723388999999, 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.329 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:00.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:38:00.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 11.885536301, 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.333 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:00.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:00.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.338 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12738 3.19 3:981e3435:::rbd_data.11943f90bac1.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 20048663~49601] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.4645619749999996, 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014968690999999999, 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12738 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.339 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814819+0000", 2024-04-23T23:38:00.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5719999999999999e-06 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815601+0000", 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00078195599999999999 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815617+0000", 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6178e-05 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815627+0000", 2024-04-23T23:38:00.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6220000000000004e-06 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815716+0000", 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9190999999999994e-05 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815816+0000", 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010035999999999999 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:00.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.816033+0000", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000216329 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.827645+0000", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011612618999999999 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829716+0000", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020706159999999999 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829753+0000", 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6786000000000003e-05 2024-04-23T23:38:00.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829786+0000", 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3461999999999999e-05 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.8868856730000001, 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.344 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:00.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:00.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14891 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.7422978649999998, 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014134285999999999, 2024-04-23T23:38:00.349 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14891 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537083+0000", 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.17e-06 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537087+0000", 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3660000000000002e-06 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537099+0000", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1412e-05 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537104+0000", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537155+0000", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0970999999999997e-05 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537209+0000", 2024-04-23T23:38:00.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3625999999999998e-05 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537282+0000", 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3201000000000006e-05 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551035+0000", 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013752861 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551108+0000", 2024-04-23T23:38:00.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2977000000000003e-05 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551165+0000", 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7639000000000002e-05 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551216+0000", 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0634999999999999e-05 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14892 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 2.742246272, 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014338742999999999, 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14892 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537134+0000", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537137+0000", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2160000000000002e-06 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537144+0000", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.951e-06 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537149+0000", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1830000000000002e-06 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543614+0000", 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0064648400000000003 2024-04-23T23:38:00.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543717+0000", 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010273200000000001 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543873+0000", 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000155883 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551092+0000", 2024-04-23T23:38:00.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072189960000000001 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551384+0000", 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00029250700000000001 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551432+0000", 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8287e-05 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551472+0000", 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9613999999999997e-05 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.360 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:00.361 INFO:teuthology.orchestra.run.smithi077.stdout:1216 writesame 0xcf66496 thru 0xcf6d696 data_size 0xd(0x7201 bytes) 2024-04-23T23:38:00.361 INFO:teuthology.orchestra.run.smithi077.stdout:1218 read 0xe39236 thru 0xe3c1e4 (0x2faf bytes) 2024-04-23T23:38:00.361 INFO:teuthology.orchestra.run.smithi077.stdout:1219 writesame 0x3b6a23b thru 0x3b7530f data_size 0x7(0xb0d5 bytes) 2024-04-23T23:38:00.361 INFO:teuthology.orchestra.run.smithi077.stdout:1220 write 0x4fa67e thru 0x4ff18d (0x4b10 bytes) 2024-04-23T23:38:00.362 INFO:teuthology.orchestra.run.smithi077.stdout:1221 punch from 0x1ca90f9 to 0x1cb6995, (0xd89c bytes) 2024-04-23T23:38:00.362 INFO:teuthology.orchestra.run.smithi077.stdout:1222 writesame 0xc9e2761 thru 0xc9ee83a data_size 0x5(0xc0da bytes) 2024-04-23T23:38:00.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:1223 trunc from 0xcf6d697 to 0xa99602f 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:1224 write 0xd57e276 thru 0xd583b5a (0x58e5 bytes) 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:1226 read 0x52d9d8d thru 0x52da379 (0x5ed bytes) 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:1227 trunc from 0xd583b5b to 0xbb4717e 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:1229 writesame 0xf4089c thru 0xf4f268 data_size 0x47(0xe9cd bytes) 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.364 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.365 INFO:teuthology.orchestra.run.smithi077.stdout:1233 write 0x8cd12d8 thru 0x8cd7324 (0x604d bytes) 2024-04-23T23:38:00.365 INFO:teuthology.orchestra.run.smithi077.stdout:1235 read 0x3bdabce thru 0x3bddaf0 (0x2f23 bytes) 2024-04-23T23:38:00.365 INFO:teuthology.orchestra.run.smithi077.stdout:1237 trunc from 0xbb4717e to 0x1b286f6 2024-04-23T23:38:00.365 INFO:teuthology.orchestra.run.smithi077.stdout:1238 read 0x88ab5e thru 0x8916d8 (0x6b7b bytes) 2024-04-23T23:38:00.365 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:00.374+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:00.373 INFO:teuthology.orchestra.run.smithi077.stdout:1241 write 0xd3019a9 thru 0xd3075eb (0x5c43 bytes) 2024-04-23T23:38:00.376 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.376 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.376 INFO:teuthology.orchestra.run.smithi077.stdout:1245 write 0x4f8678a thru 0x4f92799 (0xc010 bytes) 2024-04-23T23:38:00.379 INFO:teuthology.orchestra.run.smithi077.stdout:1246 write 0x68892a3 thru 0x688b839 (0x2597 bytes) 2024-04-23T23:38:00.381 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.382 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.382 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.382 INFO:teuthology.orchestra.run.smithi077.stdout:1254 read 0xad30e1b thru 0xad4080c (0xf9f2 bytes) 2024-04-23T23:38:00.382 INFO:teuthology.orchestra.run.smithi077.stdout:1255 trunc from 0xd3075ec to 0xd8c3481 2024-04-23T23:38:00.386 INFO:teuthology.orchestra.run.smithi077.stdout:1256 write 0xea7d29 thru 0xeb4a07 (0xccdf bytes) 2024-04-23T23:38:00.389 INFO:teuthology.orchestra.run.smithi077.stdout:1257 write 0x60f18d8 thru 0x60ff02e (0xd757 bytes) 2024-04-23T23:38:00.392 INFO:teuthology.orchestra.run.smithi077.stdout:1258 write 0xaea87bc thru 0xaeb6876 (0xe0bb bytes) 2024-04-23T23:38:00.395 INFO:teuthology.orchestra.run.smithi077.stdout:1259 write 0xb283bc6 thru 0xb2923c7 (0xe802 bytes) 2024-04-23T23:38:00.406 INFO:teuthology.orchestra.run.smithi077.stdout:1261 trunc from 0xd8c3481 to 0x7108687 2024-04-23T23:38:00.415 INFO:teuthology.orchestra.run.smithi077.stdout:1262 write 0x2a0c8aa thru 0x2a0efa0 (0x26f7 bytes) 2024-04-23T23:38:00.418 INFO:teuthology.orchestra.run.smithi077.stdout:1265 read 0x12a4fc thru 0x134ff2 (0xaaf7 bytes) 2024-04-23T23:38:00.421 INFO:teuthology.orchestra.run.smithi077.stdout:1266 trunc from 0x7108687 to 0x5507d27 2024-04-23T23:38:00.431 INFO:teuthology.orchestra.run.smithi077.stdout:1267 read 0x2c44293 thru 0x2c47c5a (0x39c8 bytes) 2024-04-23T23:38:00.431 INFO:teuthology.orchestra.run.smithi077.stdout:1268 read 0xa2054f thru 0xa2d3d8 (0xce8a bytes) 2024-04-23T23:38:00.431 INFO:teuthology.orchestra.run.smithi077.stdout:1270 write 0x4700dbc thru 0x470f031 (0xe276 bytes) 2024-04-23T23:38:00.438 INFO:teuthology.orchestra.run.smithi077.stdout:1271 trunc from 0x5507d27 to 0x810eacc 2024-04-23T23:38:00.443 INFO:teuthology.orchestra.run.smithi077.stdout:1272 writesame 0x5055393 thru 0x50575d5 data_size 0x7(0x2243 bytes) 2024-04-23T23:38:00.446 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.446 INFO:teuthology.orchestra.run.smithi077.stdout:1275 read 0x20541d0 thru 0x205f4f8 (0xb329 bytes) 2024-04-23T23:38:00.446 INFO:teuthology.orchestra.run.smithi077.stdout:1276 read 0x426090a thru 0x426120e (0x905 bytes) 2024-04-23T23:38:00.454 INFO:teuthology.orchestra.run.smithi077.stdout:1278 write 0xa96a5a1 thru 0xa972996 (0x83f6 bytes) 2024-04-23T23:38:00.457 INFO:teuthology.orchestra.run.smithi077.stdout:1279 write 0x25c9682 thru 0x25cdce7 (0x4666 bytes) 2024-04-23T23:38:00.459 INFO:teuthology.orchestra.run.smithi077.stdout:1281 write 0xbc1c98 thru 0xbc7c15 (0x5f7e bytes) 2024-04-23T23:38:00.462 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:00.474+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:00.469 INFO:teuthology.orchestra.run.smithi077.stdout:1282 write 0xd4988d0 thru 0xd4a7dcf (0xf500 bytes) 2024-04-23T23:38:00.472 INFO:teuthology.orchestra.run.smithi077.stdout:1285 punch from 0x9ba0eb to 0x9bd8f2, (0x3807 bytes) 2024-04-23T23:38:00.472 INFO:teuthology.orchestra.run.smithi077.stdout:1286 writesame 0x1496afb thru 0x149f50a data_size 0x5e(0x8a10 bytes) 2024-04-23T23:38:00.473 INFO:teuthology.orchestra.run.smithi077.stdout:1287 punch from 0xbf2e7c2 to 0xbf36f50, (0x878e bytes) 2024-04-23T23:38:00.474 INFO:teuthology.orchestra.run.smithi077.stdout:1289 writesame 0xfc2f2e thru 0xfd26c6 data_size 0x7(0xf799 bytes) 2024-04-23T23:38:00.479 INFO:teuthology.orchestra.run.smithi077.stdout:1290 trunc from 0xd4a7dd0 to 0xc8b98c1 2024-04-23T23:38:00.485 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:00.485 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:00.486 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:00.486 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:00.488 INFO:teuthology.orchestra.run.smithi077.stdout:1291 write 0x6e9479 thru 0x6f49fd (0xb585 bytes) 2024-04-23T23:38:00.491 INFO:teuthology.orchestra.run.smithi077.stdout:1292 read 0x6ae8236 thru 0x6af713b (0xef06 bytes) 2024-04-23T23:38:00.491 INFO:teuthology.orchestra.run.smithi077.stdout:1293 writesame 0x17f0a36 thru 0x180043d data_size 0xa8(0xfa08 bytes) 2024-04-23T23:38:00.492 INFO:teuthology.orchestra.run.smithi077.stdout:1294 write 0xb19ebb2 thru 0xb1a8bd7 (0xa026 bytes) 2024-04-23T23:38:00.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:00.495 INFO:teuthology.orchestra.run.smithi077.stdout:1295 write 0x9b3b785 thru 0x9b44ce8 (0x9564 bytes) 2024-04-23T23:38:00.498 INFO:teuthology.orchestra.run.smithi077.stdout:1296 read 0x12e27a9 thru 0x12ef488 (0xcce0 bytes) 2024-04-23T23:38:00.499 INFO:teuthology.orchestra.run.smithi077.stdout:1297 read 0x8e11a06 thru 0x8e20e55 (0xf450 bytes) 2024-04-23T23:38:00.499 INFO:teuthology.orchestra.run.smithi077.stdout:1298 write 0xb39c61f thru 0xb3a64f2 (0x9ed4 bytes) 2024-04-23T23:38:00.502 INFO:teuthology.orchestra.run.smithi077.stdout:1299 read 0x13b092c thru 0x13b335d (0x2a32 bytes) 2024-04-23T23:38:00.512 INFO:teuthology.orchestra.run.smithi077.stdout:1300 trunc from 0xc8b98c1 to 0x45afae6 2024-04-23T23:38:00.523 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.523 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.523 INFO:teuthology.orchestra.run.smithi077.stdout:1305 writesame 0x4157590 thru 0x4164d6e data_size 0x6d(0xd7df bytes) 2024-04-23T23:38:00.539 INFO:teuthology.orchestra.run.smithi077.stdout:1306 writesame 0x891386f thru 0x89207c4 data_size 0x1(0xcf56 bytes) 2024-04-23T23:38:00.539 INFO:teuthology.orchestra.run.smithi077.stdout:1308 write 0x61a2c0 thru 0x622981 (0x86c2 bytes) 2024-04-23T23:38:00.542 INFO:teuthology.orchestra.run.smithi077.stdout:1309 write 0x13f6d02 thru 0x13fbcd2 (0x4fd1 bytes) 2024-04-23T23:38:00.543 INFO:teuthology.orchestra.run.smithi077.stdout:1310 writesame 0x34376a5 thru 0x3443e27 data_size 0x4b(0xc783 bytes) 2024-04-23T23:38:00.548 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.548 INFO:teuthology.orchestra.run.smithi077.stdout:1312 punch from 0x4923fa0 to 0x492d199, (0x91f9 bytes) 2024-04-23T23:38:00.548 INFO:teuthology.orchestra.run.smithi077.stdout:1313 punch from 0x338ba7b to 0x3396594, (0xab19 bytes) 2024-04-23T23:38:00.557 INFO:teuthology.orchestra.run.smithi077.stdout:1314 trunc from 0x89207c5 to 0x15f3498 2024-04-23T23:38:00.564 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:00.576+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:00.572 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.572 INFO:teuthology.orchestra.run.smithi077.stdout:1316 read 0x38a9c5 thru 0x39a975 (0xffb1 bytes) 2024-04-23T23:38:00.572 INFO:teuthology.orchestra.run.smithi077.stdout:1318 read 0x12f43e4 thru 0x1301751 (0xd36e bytes) 2024-04-23T23:38:00.582 INFO:teuthology.orchestra.run.smithi077.stdout:1319 trunc from 0x15f3498 to 0x8c197df 2024-04-23T23:38:00.587 INFO:teuthology.orchestra.run.smithi077.stdout:1320 read 0x2fd1387 thru 0x2fdf4cf (0xe149 bytes) 2024-04-23T23:38:00.587 INFO:teuthology.orchestra.run.smithi077.stdout:1321 write 0x59004f2 thru 0x5900aa3 (0x5b2 bytes) 2024-04-23T23:38:00.594 INFO:teuthology.orchestra.run.smithi077.stdout:1322 trunc from 0x8c197df to 0xc9d4edd 2024-04-23T23:38:00.599 INFO:teuthology.orchestra.run.smithi077.stdout:1323 write 0xc149a98 thru 0xc14f0d5 (0x563e bytes) 2024-04-23T23:38:00.602 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:00.602 INFO:teuthology.orchestra.run.smithi077.stdout:1325 writesame 0x346b16a thru 0x3474cbb data_size 0x5e(0x9b52 bytes) 2024-04-23T23:38:00.617 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:00.618 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:00.618 INFO:teuthology.orchestra.run.smithi077.stdout:1326 trunc from 0xc9d4edd to 0x165ee8b 2024-04-23T23:38:00.628 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:00.633 INFO:teuthology.orchestra.run.smithi077.stdout:1327 clone 6 order 20 su 8192 sc 6 2024-04-23T23:38:00.663 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:00.676+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2770 3.0 e28/21 3:04638217:::rbd_data.1194137ed5d1.0000000000000103:head v 28'8, mlcod=28'6)", 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.385285103000001, 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033753899999999998, 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.736 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361975+0000", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361977+0000", 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.167e-06 2024-04-23T23:38:00.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.361992+0000", 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5685999999999999e-05 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362007+0000", 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4269e-05 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362015+0000", 2024-04-23T23:38:00.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362070+0000", 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4750999999999998e-05 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.362095+0000", 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4822999999999999e-05 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365317+0000", 2024-04-23T23:38:00.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032223009999999999 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.365351+0000", 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4029999999999998e-05 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2807 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'5, mlcod=28'3)", 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.355777373999999, 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044721090000000002, 2024-04-23T23:38:00.740 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391484+0000", 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5199999999999996e-07 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391489+0000", 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391499+0000", 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9450000000000005e-06 2024-04-23T23:38:00.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391505+0000", 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.331e-06 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391560+0000", 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5250000000000001e-05 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391579+0000", 2024-04-23T23:38:00.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9049e-05 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395910+0000", 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043312419999999999 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395955+0000", 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4907000000000002e-05 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3493 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'16, mlcod=28'13)", 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.077163452000001, 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047633190000000002, 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670098+0000", 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670103+0000", 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:38:00.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670115+0000", 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.221e-05 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670126+0000", 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0216e-05 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670172+0000", 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699000000000001e-05 2024-04-23T23:38:00.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670190+0000", 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8074999999999999e-05 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674821+0000", 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046309300000000001 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674860+0000", 2024-04-23T23:38:00.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9104999999999999e-05 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3496 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'11, mlcod=24'9)", 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.076772804000001, 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043762560000000002, 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3399999999999998e-07 2024-04-23T23:38:00.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670495+0000", 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2349999999999996e-06 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670507+0000", 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2183e-05 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670515+0000", 2024-04-23T23:38:00.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0369999999999995e-06 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670573+0000", 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8009e-05 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670594+0000", 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0545000000000001e-05 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674832+0000", 2024-04-23T23:38:00.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004238192 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674864+0000", 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2320999999999998e-05 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:4024 3.4 e28/21 3:2546d4ff:::rbd_data.1194137ed5d1.0000000000000135:head v 28'16, mlcod=28'14)", 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.738911883, 2024-04-23T23:38:00.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042382929999999997, 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008350+0000", 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0720000000000001e-06 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008364+0000", 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4236000000000001e-05 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008381+0000", 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7070000000000001e-05 2024-04-23T23:38:00.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008391+0000", 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7499999999999998e-06 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008452+0000", 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1057999999999997e-05 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008474+0000", 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2521999999999999e-05 2024-04-23T23:38:00.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012559+0000", 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040842609999999996 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012587+0000", 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8323999999999999e-05 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.757 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5287 3.4 e28/21 3:200b80cf:::rbd_data.1194137ed5d1.0000000000000152:head v 28'26, mlcod=28'24)", 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.344727418000002, 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042967179999999997, 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402546+0000", 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3029e-05 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402557+0000", 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0599e-05 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402575+0000", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7765999999999999e-05 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402583+0000", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.208e-06 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402989+0000", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000405993 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.403011+0000", 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2036e-05 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406781+0000", 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037698950000000001 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406830+0000", 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9191999999999999e-05 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5303 3.4 e28/21 3:21d47454:::rbd_data.1194137ed5d1.0000000000000058:head v 28'27, mlcod=28'25)", 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.336703928999999, 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0034075889999999999, 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410557+0000", 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410558+0000", 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410567+0000", 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9089999999999995e-06 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410584+0000", 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6458999999999999e-05 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410591+0000", 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0489999999999998e-06 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410648+0000", 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6566e-05 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.410667+0000", 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9718999999999999e-05 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.413927+0000", 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032602199999999999 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.413964+0000", 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6767000000000002e-05 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.765 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5627 3.0 e28/21 3:05b00203:::rbd_data.1194137ed5d1.000000000000002b:head v 28'23, mlcod=28'21)", 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.027603264, 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065095700000000001, 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:00.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719658+0000", 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719664+0000", 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.998e-06 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719676+0000", 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1494999999999999e-05 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719683+0000", 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0049999999999998e-06 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719730+0000", 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7747999999999998e-05 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719750+0000", 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9842000000000001e-05 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726120+0000", 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063699480000000003 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726167+0000", 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6802999999999999e-05 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7147 3.9 e29/21 3:94c47ac8:::rbd_data.1194ccf776f2.00000000000000d5:head v 29'31, mlcod=29'29)", 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.372370391, 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047294210000000001, 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.770 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374891+0000", 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.063e-06 2024-04-23T23:38:00.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374901+0000", 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0112000000000001e-05 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374916+0000", 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4347e-05 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374925+0000", 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3079999999999997e-06 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374991+0000", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6264000000000001e-05 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375012+0000", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0356e-05 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379556+0000", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045444079999999998 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379620+0000", 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3563000000000001e-05 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7149 3.0 e29/21 3:059b2f37:::rbd_data.1194ccf776f2.00000000000000d7:head v 29'34, mlcod=29'32)", 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.371491970000001, 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003874508, 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375769+0000", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375784+0000", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4506e-05 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375794+0000", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0261000000000001e-05 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375800+0000", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4110000000000001e-06 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375863+0000", 2024-04-23T23:38:00.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2825999999999998e-05 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375884+0000", 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1279000000000001e-05 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379601+0000", 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037165829999999999 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379643+0000", 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2033000000000002e-05 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.777 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7178 3.4 e29/21 3:21a3b24e:::rbd_data.1194ccf776f2.0000000000000129:head v 29'41, mlcod=29'39)", 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.338344179, 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0034548679999999998, 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:38:00.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408916+0000", 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408918+0000", 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.176e-06 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408928+0000", 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0844e-05 2024-04-23T23:38:00.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408946+0000", 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7495000000000001e-05 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.408956+0000", 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0577000000000001e-05 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409018+0000", 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1456000000000002e-05 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409038+0000", 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0268999999999999e-05 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.412323+0000", 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032843130000000001 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.412371+0000", 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8738e-05 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7179 3.4 e29/21 3:266338eb:::rbd_data.1194ccf776f2.000000000000012a:head v 29'42, mlcod=29'39)", 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.337549190000001, 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076296389999999997, 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409712+0000", 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6199999999999996e-07 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409718+0000", 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8089999999999998e-06 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409731+0000", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3016e-05 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409739+0000", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.503e-06 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409784+0000", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5209e-05 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409806+0000", 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1820000000000001e-05 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417291+0000", 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074857949999999999 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417341+0000", 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9625e-05 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8160 3.4 e29/21 3:2138fb15:::rbd_data.1194ccf776f2.00000000000001f3:head v 29'44, mlcod=29'42)", 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.21031602, 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039317429999999997, 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536946+0000", 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.314e-06 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536958+0000", 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1821000000000001e-05 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536984+0000", 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5986000000000002e-05 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536992+0000", 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6719999999999993e-06 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537058+0000", 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5246000000000005e-05 2024-04-23T23:38:00.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537083+0000", 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5282e-05 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540835+0000", 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037519129999999999 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540876+0000", 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:38:00.789 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 12.338225004, 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.3385291499999998, 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14875 3.0 e36/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 36'40, mlcod=34'38)", 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.505475+0000", 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.2417855389999999, 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033382669999999998, 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.798 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505475+0000", 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505475+0000", 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505476+0000", 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4700000000000001e-07 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505493+0000", 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6922000000000002e-05 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505503+0000", 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0609e-05 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505509+0000", 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3539999999999999e-06 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505553+0000", 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4289000000000002e-05 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.505567+0000", 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3798000000000001e-05 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.508772+0000", 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032054620000000001 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.508813+0000", 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1186000000000002e-05 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14891 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'41, mlcod=36'39)", 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.2099079760000002, 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011022845, 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.802 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:00.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537361+0000", 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8099999999999998e-06 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537375+0000", 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3451e-05 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537383+0000", 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9920000000000007e-06 2024-04-23T23:38:00.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537452+0000", 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9506999999999997e-05 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537473+0000", 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1178e-05 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548321+0000", 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010847203 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548375+0000", 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4880000000000003e-05 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14892 3.0 e36/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 36'42, mlcod=36'39)", 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.2032962270000001, 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0048549480000000004, 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.806 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543966+0000", 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2139999999999999e-06 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543981+0000", 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5197e-05 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543994+0000", 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.279e-05 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544000+0000", 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7530000000000004e-06 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544055+0000", 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4564000000000001e-05 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544078+0000", 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3016000000000001e-05 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548773+0000", 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046950689999999996 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548819+0000", 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6344999999999998e-05 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.810 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14984 3.9 e36/21 3:97f65ac9:::rbd_data.11943f90bac1.0000000000000006:head v 36'42, mlcod=36'40)", 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.682104+0000", 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.0651561479999998, 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035861769999999999, 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682104+0000", 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682104+0000", 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682106+0000", 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1659999999999999e-06 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682155+0000", 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9286000000000002e-05 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682171+0000", 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6158e-05 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682178+0000", 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2899999999999997e-06 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682233+0000", 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4701999999999999e-05 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.682255+0000", 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2402e-05 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.685633+0000", 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0033779529999999999 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.685691+0000", 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7219999999999998e-05 2024-04-23T23:38:00.814 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:22078 3.9 e38/21 3:95d2d0ee:::rbd_data.11942420a0c9.0000000000000007:head v 38'77, mlcod=38'75)", 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:00.576398+0000", 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.17086280000000001, 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037514829999999999, 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576398+0000", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576398+0000", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576399+0000", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:00.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576404+0000", 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7219999999999996e-06 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576416+0000", 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1751e-05 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576423+0000", 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6059999999999999e-06 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576477+0000", 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4364000000000003e-05 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.576497+0000", 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9887000000000001e-05 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.580122+0000", 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036250430000000001 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:00.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:00.580149+0000", 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7379e-05 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:00.819 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:00.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:00.821 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:00.833+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:00.890 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:38:00.921 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:00.933+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:00.931 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:00.931 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:00.932 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:00.932 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:00.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:00.949 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone5 2024-04-23T23:38:00.994 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-04-23T23:38:01.022 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:01.034+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:01.064 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:01.064 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:01.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:01.161 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:01.173+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:01.223 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:01.235+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3238 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4161536~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784715403, 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029291145000000001, 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.226 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3238 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452574+0000", 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452582+0000", 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8930000000000005e-06 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452587+0000", 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3000000000000001e-06 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481755+0000", 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029167226000000001 2024-04-23T23:38:01.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481797+0000", 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2651999999999998e-05 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481863+0000", 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5685999999999994e-05 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3252 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 49152~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784693023999999, 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029578383999999999, 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3252 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452595+0000", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452597+0000", 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452604+0000", 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2660000000000004e-06 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452610+0000", 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8429999999999998e-06 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481898+0000", 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029288338000000001 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482013+0000", 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000114746 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482172+0000", 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015978300000000001 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.234 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3253 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 278528~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.78467126, 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029686714999999999, 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3253 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.235 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452618+0000", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1210000000000001e-06 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452627+0000", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3489999999999992e-06 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452632+0000", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1479999999999997e-06 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482187+0000", 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029555272 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482230+0000", 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2750999999999998e-05 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482303+0000", 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2669000000000005e-05 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3254 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 507904~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784648563000001, 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029953305999999999, 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3254 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.239 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452641+0000", 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1459999999999999e-06 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452647+0000", 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2620000000000004e-06 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452652+0000", 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482338+0000", 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029685554999999999 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482432+0000", 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4643999999999997e-05 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482592+0000", 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015951100000000001 2024-04-23T23:38:01.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3255 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 737280~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784628453, 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030178470999999998, 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.243 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3255 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:01.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452661+0000", 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452667+0000", 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2639999999999997e-06 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452672+0000", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.848e-06 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482635+0000", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029962494999999999 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482709+0000", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4445999999999998e-05 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482837+0000", 2024-04-23T23:38:01.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012805100000000001 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3256 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 966656~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784593394000002, 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030449868000000001, 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.247 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3256 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3900000000000004e-07 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452697+0000", 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452704+0000", 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.362e-06 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452710+0000", 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5609999999999998e-06 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482891+0000", 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030181050000000001 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482991+0000", 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9586000000000005e-05 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483144+0000", 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015305000000000001 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3257 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1196032~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784569932, 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030595397999999999, 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.251 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3257 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452718+0000", 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452724+0000", 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452730+0000", 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5320000000000003e-06 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452738+0000", 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7579999999999992e-06 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483178+0000", 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030439931 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483232+0000", 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3695e-05 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483313+0000", 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0858000000000004e-05 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3258 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1425408~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784541314999998, 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030867680000000002, 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3258 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452748+0000", 2024-04-23T23:38:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452765+0000", 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7003e-05 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452771+0000", 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483351+0000", 2024-04-23T23:38:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030579967999999999 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483453+0000", 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010173100000000001 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483613+0000", 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016066400000000001 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3259 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1654784~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784509056000001, 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031145740000000002, 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3259 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452779+0000", 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:38:01.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452781+0000", 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0360000000000001e-06 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452787+0000", 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2809999999999997e-06 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452793+0000", 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0870000000000003e-06 2024-04-23T23:38:01.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483651+0000", 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030858239999999999 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483759+0000", 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107533 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483924+0000", 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016508199999999999 2024-04-23T23:38:01.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3260 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1884160~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784485918000001, 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031422796000000003, 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.264 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3260 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452802+0000", 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.72e-07 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452804+0000", 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.979e-06 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452811+0000", 2024-04-23T23:38:01.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0319999999999998e-06 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452816+0000", 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483962+0000", 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031146258999999999 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484069+0000", 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106846 2024-04-23T23:38:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484224+0000", 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015536799999999999 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3261 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2113536~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784465816000001, 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031579572, 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.268 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3261 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452822+0000", 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452824+0000", 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8419999999999999e-06 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452829+0000", 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7089999999999999e-06 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452835+0000", 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3120000000000001e-06 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484254+0000", 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031419152999999998 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484305+0000", 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1363000000000003e-05 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484401+0000", 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5784000000000003e-05 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3262 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2342912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.272 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784446448000001, 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031829887000000001, 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3262 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452843+0000", 2024-04-23T23:38:01.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452852+0000", 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5189999999999992e-06 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452857+0000", 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1259999999999997e-06 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484440+0000", 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031583133999999999 2024-04-23T23:38:01.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484537+0000", 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7248000000000001e-05 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484671+0000", 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013340800000000001 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.276 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3263 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2572288~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784421694999999, 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032059593999999997, 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3263 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452866+0000", 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452868+0000", 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1560000000000002e-06 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452875+0000", 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5209999999999999e-06 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452879+0000", 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484704+0000", 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031825141000000001 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484797+0000", 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3107000000000002e-05 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484925+0000", 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000127711 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.280 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3264 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2801664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784394871, 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032190086, 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3264 2024-04-23T23:38:01.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452893+0000", 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452895+0000", 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.367e-06 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452902+0000", 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1919999999999999e-06 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452908+0000", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.152e-06 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484951+0000", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032043673000000002 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485011+0000", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9840999999999998e-05 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485082+0000", 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1308000000000002e-05 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3265 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3031040~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784372767000001, 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032433114999999998, 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3265 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:38:01.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452915+0000", 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9399999999999995e-07 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452917+0000", 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0650000000000001e-06 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452923+0000", 2024-04-23T23:38:01.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5010000000000001e-06 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452928+0000", 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.746e-06 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485122+0000", 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032193745000000003 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485218+0000", 2024-04-23T23:38:01.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6427000000000004e-05 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485347+0000", 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012913700000000001 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3266 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3260416~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784352950999999, 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032550864999999998, 2024-04-23T23:38:01.289 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3266 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452935+0000", 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452937+0000", 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:38:01.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452943+0000", 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0630000000000002e-06 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452947+0000", 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7079999999999996e-06 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485376+0000", 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032428750999999999 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485423+0000", 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6597999999999997e-05 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485485+0000", 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2297000000000003e-05 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3267 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3489792~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784333947, 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032811840000000002, 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3267 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452954+0000", 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452955+0000", 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.877e-06 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452962+0000", 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6760000000000001e-06 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452966+0000", 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3089999999999997e-06 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485525+0000", 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032558746 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485632+0000", 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107179 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485765+0000", 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013261600000000001 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.297 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3268 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3719168~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784309878999998, 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032909676999999998, 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3268 2024-04-23T23:38:01.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452978+0000", 2024-04-23T23:38:01.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452980+0000", 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2290000000000002e-06 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452987+0000", 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5869999999999998e-06 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452992+0000", 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9949999999999996e-06 2024-04-23T23:38:01.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485780+0000", 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032788386000000003 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485826+0000", 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5744000000000001e-05 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485887+0000", 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1254999999999995e-05 2024-04-23T23:38:01.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3269 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3948544~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784288038, 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033158813000000002, 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.302 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3269 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453000+0000", 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453007+0000", 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2320000000000004e-06 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453015+0000", 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453020+0000", 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485924+0000", 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032904299999999997 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486025+0000", 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101184 2024-04-23T23:38:01.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486158+0000", 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000132521 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3270 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4177920~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.784260460999999, 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033252354999999997, 2024-04-23T23:38:01.306 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3270 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453029+0000", 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0430000000000002e-06 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453036+0000", 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.545e-06 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453040+0000", 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6450000000000004e-06 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486175+0000", 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033134469999999999 2024-04-23T23:38:01.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486220+0000", 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000001e-05 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486279+0000", 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9021999999999998e-05 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:01.310 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:01.312 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:01.313 INFO:teuthology.orchestra.run.smithi077.stdout:1328 write 0xe352c2d thru 0xe353990 (0xd64 bytes) 2024-04-23T23:38:01.313 INFO:teuthology.orchestra.run.smithi077.stdout:1329 write 0x553ad21 thru 0x554a3c7 (0xf6a7 bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1331 read 0xc826020 thru 0xc82d530 (0x7511 bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1332 writesame 0xa461f3f thru 0xa4675ed data_size 0xd(0x56af bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1334 read 0xa6588b2 thru 0xa65f540 (0x6c8f bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1335 write 0x8468644 thru 0x8476104 (0xdac1 bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1336 write 0x9f1c6b3 thru 0x9f2336e (0x6cbc bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1337 write 0x218d889 thru 0x21924c3 (0x4c3b bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1338 write 0x4c9bd0c thru 0x4caa382 (0xe677 bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1339 read 0x2aee3a4 thru 0x2afaf72 (0xcbcf bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1340 read 0x937c382 thru 0x938a2e2 (0xdf61 bytes) 2024-04-23T23:38:01.314 INFO:teuthology.orchestra.run.smithi077.stdout:1341 writesame 0x657099d thru 0x6576c99 data_size 0x1(0x62fd bytes) 2024-04-23T23:38:01.319 INFO:teuthology.orchestra.run.smithi077.stdout:1343 writesame 0x8403f45 thru 0x840d96f data_size 0x1(0x9a2b bytes) 2024-04-23T23:38:01.324 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:01.336+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:01.330 INFO:teuthology.orchestra.run.smithi077.stdout:1344 read 0x67d4a0c thru 0x67dfce3 (0xb2d8 bytes) 2024-04-23T23:38:01.330 INFO:teuthology.orchestra.run.smithi077.stdout:1345 write 0x8ff218b thru 0x8ff4628 (0x249e bytes) 2024-04-23T23:38:01.333 INFO:teuthology.orchestra.run.smithi077.stdout:1346 read 0x8afd278 thru 0x8b0cb5d (0xf8e6 bytes) 2024-04-23T23:38:01.340 INFO:teuthology.orchestra.run.smithi077.stdout:1348 write 0xee58fb3 thru 0xee625a7 (0x95f5 bytes) 2024-04-23T23:38:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:1349 trunc from 0xee625a8 to 0x4c9a51b 2024-04-23T23:38:01.398 INFO:teuthology.orchestra.run.smithi077.stdout:1350 writesame 0x7134c2f thru 0x713cbf7 data_size 0x1(0x7fc9 bytes) 2024-04-23T23:38:01.405 INFO:teuthology.orchestra.run.smithi077.stdout:1351 write 0x7cd5b92 thru 0x7cddfec (0x845b bytes) 2024-04-23T23:38:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.415 INFO:teuthology.orchestra.run.smithi077.stdout:1356 write 0x61adc5f thru 0x61b17ab (0x3b4d bytes) 2024-04-23T23:38:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:1359 write 0x194cf45 thru 0x1953766 (0x6822 bytes) 2024-04-23T23:38:01.425 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:01.437+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:01.429 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:01.429 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:01.429 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:01.429 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:01.435 INFO:teuthology.orchestra.run.smithi077.stdout:1360 write 0xb09c514 thru 0xb0ac181 (0xfc6e bytes) 2024-04-23T23:38:01.438 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:01.447 INFO:teuthology.orchestra.run.smithi077.stdout:1361 write 0x204315a thru 0x2044ca3 (0x1b4a bytes) 2024-04-23T23:38:01.454 INFO:teuthology.orchestra.run.smithi077.stdout:1363 writesame 0x6c2a02f thru 0x6c31a5c data_size 0x6(0x7a2e bytes) 2024-04-23T23:38:01.464 INFO:teuthology.orchestra.run.smithi077.stdout:1364 write 0x38c11b1 thru 0x38c6a54 (0x58a4 bytes) 2024-04-23T23:38:01.469 INFO:teuthology.orchestra.run.smithi077.stdout:1365 read 0x3e9f7b3 thru 0x3eaaae4 (0xb332 bytes) 2024-04-23T23:38:01.469 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.469 INFO:teuthology.orchestra.run.smithi077.stdout:1367 read 0x9c7d024 thru 0x9c89390 (0xc36d bytes) 2024-04-23T23:38:01.469 INFO:teuthology.orchestra.run.smithi077.stdout:1368 read 0xad50e69 thru 0xad58095 (0x722d bytes) 2024-04-23T23:38:01.472 INFO:teuthology.orchestra.run.smithi077.stdout:1369 trunc from 0xb0ac182 to 0x80f5d72 2024-04-23T23:38:01.482 INFO:teuthology.orchestra.run.smithi077.stdout:1371 read 0x80f8d8 thru 0x8193fd (0x9b26 bytes) 2024-04-23T23:38:01.495 INFO:teuthology.orchestra.run.smithi077.stdout:1372 writesame 0xd7f5888 thru 0xd7f5f0b data_size 0x6(0x684 bytes) 2024-04-23T23:38:01.495 INFO:teuthology.orchestra.run.smithi077.stdout:1373 write 0x4770e44 thru 0x477b154 (0xa311 bytes) 2024-04-23T23:38:01.501 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.501 INFO:teuthology.orchestra.run.smithi077.stdout:1378 write 0xaa9506f thru 0xaa9cb05 (0x7a97 bytes) 2024-04-23T23:38:01.507 INFO:teuthology.orchestra.run.smithi077.stdout:1379 writesame 0x4988f5b thru 0x498aa54 data_size 0x3(0x1afa bytes) 2024-04-23T23:38:01.509 INFO:teuthology.orchestra.run.smithi077.stdout:1380 read 0xb7e39e8 thru 0xb7ea886 (0x6e9f bytes) 2024-04-23T23:38:01.509 INFO:teuthology.orchestra.run.smithi077.stdout:1381 read 0xf6b938 thru 0xf6c472 (0xb3b bytes) 2024-04-23T23:38:01.518 INFO:teuthology.orchestra.run.smithi077.stdout:1382 trunc from 0xd7f5f0c to 0x5cc8ff0 2024-04-23T23:38:01.525 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:01.538+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:1384 read 0x51a6288 thru 0x51b069d (0xa416 bytes) 2024-04-23T23:38:01.531 INFO:teuthology.orchestra.run.smithi077.stdout:1386 writesame 0x3865243 thru 0x386d707 data_size 0x1(0x84c5 bytes) 2024-04-23T23:38:01.541 INFO:teuthology.orchestra.run.smithi077.stdout:1387 read 0x3e812f thru 0x3eb8c1 (0x3793 bytes) 2024-04-23T23:38:01.549 INFO:teuthology.orchestra.run.smithi077.stdout:1388 write 0x7651c94 thru 0x765e585 (0xc8f2 bytes) 2024-04-23T23:38:01.555 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:01.555 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:01.555 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:01.555 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:01.555 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.562 INFO:teuthology.orchestra.run.smithi077.stdout:1391 writesame 0x2560203 thru 0x2561354 data_size 0x3(0x1152 bytes) 2024-04-23T23:38:01.564 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:01.581 INFO:teuthology.orchestra.run.smithi077.stdout:1393 writesame 0xe78a768 thru 0xe79807b data_size 0x21(0xd914 bytes) 2024-04-23T23:38:01.581 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.581 INFO:teuthology.orchestra.run.smithi077.stdout:1397 punch from 0x94f4cfd to 0x94f5aad, (0xdb0 bytes) 2024-04-23T23:38:01.581 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.586 INFO:teuthology.orchestra.run.smithi077.stdout:1400 write 0xec2f081 thru 0xec3a1be (0xb13e bytes) 2024-04-23T23:38:01.599 INFO:teuthology.orchestra.run.smithi077.stdout:1401 writesame 0xd8cf1a8 thru 0xd8d05a7 data_size 0x14(0x1400 bytes) 2024-04-23T23:38:01.605 INFO:teuthology.orchestra.run.smithi077.stdout:1402 read 0x61d8e96 thru 0x61da782 (0x18ed bytes) 2024-04-23T23:38:01.605 INFO:teuthology.orchestra.run.smithi077.stdout:1403 read 0x10f8606 thru 0x1107a09 (0xf404 bytes) 2024-04-23T23:38:01.606 INFO:teuthology.orchestra.run.smithi077.stdout:1404 read 0xdc53c05 thru 0xdc54676 (0xa72 bytes) 2024-04-23T23:38:01.606 INFO:teuthology.orchestra.run.smithi077.stdout:1406 read 0xdc8e07a thru 0xdc9cf3f (0xeec6 bytes) 2024-04-23T23:38:01.606 INFO:teuthology.orchestra.run.smithi077.stdout:1408 read 0x1123c90 thru 0x1129547 (0x58b8 bytes) 2024-04-23T23:38:01.620 INFO:teuthology.orchestra.run.smithi077.stdout:1409 trunc from 0xec3a1bf to 0x2b47a00 2024-04-23T23:38:01.639 INFO:teuthology.orchestra.run.smithi077.stdout:1410 writesame 0x2358720 thru 0x235dccd data_size 0xb(0x55ae bytes) 2024-04-23T23:38:01.643 INFO:teuthology.orchestra.run.smithi077.stdout:1412 read 0x159f50d thru 0x15a4547 (0x503b bytes) 2024-04-23T23:38:01.648 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:01.661+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:01.657 INFO:teuthology.orchestra.run.smithi077.stdout:1413 write 0x6fcfe37 thru 0x6fdfb5f (0xfd29 bytes) 2024-04-23T23:38:01.667 INFO:teuthology.orchestra.run.smithi077.stdout:1414 read 0x4eb4991 thru 0x4eb568a (0xcfa bytes) 2024-04-23T23:38:01.682 INFO:teuthology.orchestra.run.smithi077.stdout:1417 writesame 0xe9f2621 thru 0xe9f4bf5 data_size 0xd(0x25d5 bytes) 2024-04-23T23:38:01.682 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.682 INFO:teuthology.orchestra.run.smithi077.stdout:1422 read 0x6d68b59 thru 0x6d74226 (0xb6ce bytes) 2024-04-23T23:38:01.689 INFO:teuthology.orchestra.run.smithi077.stdout:1423 trunc from 0xe9f4bf6 to 0x8a5de66 2024-04-23T23:38:01.696 INFO:teuthology.orchestra.run.smithi077.stdout:1424 trunc from 0x8a5de66 to 0x984073a 2024-04-23T23:38:01.701 INFO:teuthology.orchestra.run.smithi077.stdout:1425 writesame 0x43623fe thru 0x436a956 data_size 0x3(0x8559 bytes) 2024-04-23T23:38:01.710 INFO:teuthology.orchestra.run.smithi077.stdout:1426 write 0xe5540c thru 0xe5aaad (0x56a2 bytes) 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14675 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 263168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.726 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8103451429999993, 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027949024999999999, 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14675 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926011+0000", 2024-04-23T23:38:01.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.046e-06 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926014+0000", 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.88e-06 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926016+0000", 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.548e-06 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.953835+0000", 2024-04-23T23:38:01.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027818315 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.953873+0000", 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8141e-05 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.953959+0000", 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5883000000000004e-05 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14769 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 436224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8063206829999991, 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027826594999999999, 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14769 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:01.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930036+0000", 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.846e-06 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930042+0000", 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-06 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930047+0000", 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4619999999999998e-06 2024-04-23T23:38:01.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957763+0000", 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027716507000000001 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957805+0000", 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1462999999999999e-05 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957861+0000", 2024-04-23T23:38:01.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5973000000000001e-05 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14776 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 425984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8063027050000002, 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027931536999999999, 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.735 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14776 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930054+0000", 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7889999999999999e-06 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930060+0000", 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.066e-06 2024-04-23T23:38:01.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930066+0000", 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957887+0000", 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027821452999999999 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957928+0000", 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1068000000000001e-05 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957983+0000", 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5381999999999999e-05 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14777 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 437248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930072+0000", 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8062822799999996, 2024-04-23T23:38:01.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028031667, 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14777 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930072+0000", 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930072+0000", 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930073+0000", 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930075+0000", 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9230000000000001e-06 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930080+0000", 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7660000000000004e-06 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930085+0000", 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958008+0000", 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.02792321 2024-04-23T23:38:01.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958049+0000", 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0596000000000002e-05 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958104+0000", 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5312999999999997e-05 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.743 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14783 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 497664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8062640959999996, 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028133212000000001, 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14783 2024-04-23T23:38:01.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:01.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930093+0000", 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930099+0000", 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8719999999999999e-06 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930103+0000", 2024-04-23T23:38:01.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8230000000000002e-06 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958129+0000", 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028026051999999999 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958170+0000", 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0179999999999998e-05 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958224+0000", 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14792 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 498688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8062449259999998, 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028235653999999999, 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14792 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930112+0000", 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7239999999999999e-06 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930118+0000", 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7749999999999998e-06 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930128+0000", 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0895e-05 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958248+0000", 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028119890000000002 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958289+0000", 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1108e-05 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958345+0000", 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5886e-05 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14799 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 428032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8062159159999993, 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028325426000000001, 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14799 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.753 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:01.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930142+0000", 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5330000000000001e-06 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930148+0000", 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0650000000000004e-06 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930152+0000", 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6500000000000004e-06 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958369+0000", 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028216370000000001 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958409+0000", 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0398999999999997e-05 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958464+0000", 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4963999999999998e-05 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14800 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 439296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930170+0000", 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8061842479999992, 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028421986999999999, 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14800 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930170+0000", 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930170+0000", 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930171+0000", 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:38:01.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930173+0000", 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.306e-06 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930180+0000", 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7449999999999998e-06 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930185+0000", 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1059999999999999e-06 2024-04-23T23:38:01.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958495+0000", 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028309969000000001 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958536+0000", 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0893000000000003e-05 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958592+0000", 2024-04-23T23:38:01.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6484999999999999e-05 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14806 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8061578780000005, 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028517022, 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14806 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:01.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:01.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2900000000000003e-07 2024-04-23T23:38:01.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930200+0000", 2024-04-23T23:38:01.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.413e-06 2024-04-23T23:38:01.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930206+0000", 2024-04-23T23:38:01.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2369999999999997e-06 2024-04-23T23:38:01.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930211+0000", 2024-04-23T23:38:01.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:38:01.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958618+0000", 2024-04-23T23:38:01.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028406332999999999 2024-04-23T23:38:01.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958658+0000", 2024-04-23T23:38:01.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0488000000000003e-05 2024-04-23T23:38:01.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958714+0000", 2024-04-23T23:38:01.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5640000000000003e-05 2024-04-23T23:38:01.769 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.770 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.770 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14813 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 427008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930217+0000", 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.806137369, 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028619087000000001, 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.771 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14813 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930217+0000", 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930217+0000", 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930218+0000", 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930219+0000", 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.753e-06 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930225+0000", 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5169999999999999e-06 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930229+0000", 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.053e-06 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958738+0000", 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028509517000000002 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958781+0000", 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2259999999999999e-05 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958836+0000", 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5608e-05 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14815 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 438272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8061198300000001, 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028724113999999999, 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.775 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14815 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:01.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930237+0000", 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930243+0000", 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7729999999999996e-06 2024-04-23T23:38:01.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930247+0000", 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.561e-06 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958862+0000", 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028614701999999999 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958904+0000", 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1791e-05 2024-04-23T23:38:01.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958959+0000", 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5124999999999998e-05 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14817 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 429056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8061018359999998, 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028828659999999999, 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14817 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:01.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0200000000000003e-07 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930255+0000", 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8160000000000001e-06 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930261+0000", 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6489999999999996e-06 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930265+0000", 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5519999999999998e-06 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958984+0000", 2024-04-23T23:38:01.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028718635999999999 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959026+0000", 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2227000000000001e-05 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959081+0000", 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5377999999999997e-05 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14819 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 440320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8060837809999999, 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028931264000000002, 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14819 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4499999999999998e-07 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930273+0000", 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.795e-06 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930279+0000", 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3430000000000001e-06 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930284+0000", 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7690000000000004e-06 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959107+0000", 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028822687 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959148+0000", 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1189000000000002e-05 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959202+0000", 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4135999999999998e-05 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14826 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 500736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8060651100000005, 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029030970999999999, 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14826 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930292+0000", 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.824e-06 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930297+0000", 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6250000000000004e-06 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930302+0000", 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6090000000000003e-06 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959227+0000", 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028925036000000001 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959267+0000", 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9733000000000001e-05 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959321+0000", 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3743999999999999e-05 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14832 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 430080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:01.792 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8060470570000007, 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029135000000000001, 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14832 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930310+0000", 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.793e-06 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930315+0000", 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7169999999999996e-06 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930329+0000", 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3190000000000001e-05 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959346+0000", 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029017389000000001 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959386+0000", 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9986e-05 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959443+0000", 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6538e-05 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14834 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 441344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930335+0000", 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8060192910000001, 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029235258, 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14834 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930335+0000", 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930335+0000", 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930336+0000", 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:01.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930338+0000", 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2019999999999998e-06 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930344+0000", 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930349+0000", 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7119999999999999e-06 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959471+0000", 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029121998 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959513+0000", 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.261e-05 2024-04-23T23:38:01.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959571+0000", 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7259000000000002e-05 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14839 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 501760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930354+0000", 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8060003479999995, 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029338706999999999, 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.801 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14839 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930354+0000", 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930354+0000", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930355+0000", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5999999999999999e-07 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930356+0000", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6419999999999999e-06 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930362+0000", 2024-04-23T23:38:01.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7300000000000002e-06 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930367+0000", 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5789999999999997e-06 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959597+0000", 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029230069000000001 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959637+0000", 2024-04-23T23:38:01.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0318000000000003e-05 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959693+0000", 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5909000000000003e-05 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14843 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 431104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930372+0000", 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8059824209999995, 2024-04-23T23:38:01.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029441042000000001, 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14843 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930372+0000", 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930372+0000", 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930373+0000", 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4299999999999999e-07 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930380+0000", 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0609999999999998e-06 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930387+0000", 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1969999999999999e-06 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930392+0000", 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9019999999999998e-06 2024-04-23T23:38:01.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959716+0000", 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029324658999999999 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959757+0000", 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0397e-05 2024-04-23T23:38:01.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959813+0000", 2024-04-23T23:38:01.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6483000000000001e-05 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14850 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8059566819999997, 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029534845000000001, 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.811 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.812 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14850 2024-04-23T23:38:01.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.812 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:01.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930406+0000", 2024-04-23T23:38:01.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.452e-06 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930412+0000", 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4500000000000001e-06 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930418+0000", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.366e-06 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959837+0000", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029419635 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959878+0000", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0837999999999998e-05 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959933+0000", 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4713999999999998e-05 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14851 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 502784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.8059299709999994, 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029625881999999999, 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:01.817 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14851 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930427+0000", 2024-04-23T23:38:01.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1390000000000002e-06 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930433+0000", 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9789999999999998e-06 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930438+0000", 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5680000000000001e-06 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959956+0000", 2024-04-23T23:38:01.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029518328999999999 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959996+0000", 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9610000000000002e-05 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.960051+0000", 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4793999999999997e-05 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.821 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:01.822 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:01.822 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:01.824 INFO:teuthology.orchestra.run.smithi077.stdout:1427 trunc from 0x984073a to 0x80fb1a9 2024-04-23T23:38:01.824 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:01.824 INFO:teuthology.orchestra.run.smithi077.stdout:1429 write 0x63c3642 thru 0x63d16cb (0xe08a bytes) 2024-04-23T23:38:01.824 INFO:teuthology.orchestra.run.smithi077.stdout:1430 trunc from 0x80fb1a9 to 0x8c236e 2024-04-23T23:38:01.824 INFO:teuthology.orchestra.run.smithi077.stdout:1431 clone 7 order 20 su 4096 sc 5 2024-04-23T23:38:01.824 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:01.825 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:01.835+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:01.923 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:01.935+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:01.949 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone6 intact 2024-04-23T23:38:01.970 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:01.970 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:01.971 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:01.971 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:01.979 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:01.989 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-04-23T23:38:02.024 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:02.036+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:02.026 INFO:teuthology.orchestra.run.smithi077.stdout:1432 writesame 0xb1840b thru 0xb1d9d3 data_size 0x1(0x55c9 bytes) 2024-04-23T23:38:02.034 INFO:teuthology.orchestra.run.smithi077.stdout:1435 trunc from 0xb1d9d4 to 0x70b5949 2024-04-23T23:38:02.047 INFO:teuthology.orchestra.run.smithi077.stdout:1436 trunc from 0x70b5949 to 0xde58597 2024-04-23T23:38:02.052 INFO:teuthology.orchestra.run.smithi077.stdout:1438 read 0x4973cc4 thru 0x497fe59 (0xc196 bytes) 2024-04-23T23:38:02.052 INFO:teuthology.orchestra.run.smithi077.stdout:1439 writesame 0xd3fd52b thru 0xd4004d8 data_size 0x11(0x2fae bytes) 2024-04-23T23:38:02.059 INFO:teuthology.orchestra.run.smithi077.stdout:1440 trunc from 0xde58597 to 0xccef149 2024-04-23T23:38:02.068 INFO:teuthology.orchestra.run.smithi077.stdout:1443 read 0x213185c thru 0x213b654 (0x9df9 bytes) 2024-04-23T23:38:02.069 INFO:teuthology.orchestra.run.smithi077.stdout:1444 punch from 0x79e3924 to 0x79efb53, (0xc22f bytes) 2024-04-23T23:38:02.069 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.069 INFO:teuthology.orchestra.run.smithi077.stdout:1447 punch from 0x797acfa to 0x7982a9b, (0x7da1 bytes) 2024-04-23T23:38:02.069 INFO:teuthology.orchestra.run.smithi077.stdout:1448 read 0x1022a3 thru 0x1080dd (0x5e3b bytes) 2024-04-23T23:38:02.082 INFO:teuthology.orchestra.run.smithi077.stdout:1449 trunc from 0xccef149 to 0x1abf67e 2024-04-23T23:38:02.088 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:02.088 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:02.088 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:02.088 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:02.089 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:02.098 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:02.098 INFO:teuthology.orchestra.run.smithi077.stdout:1451 writesame 0x618e95e thru 0x619d599 data_size 0x1a(0xec3c bytes) 2024-04-23T23:38:02.098 INFO:teuthology.orchestra.run.smithi077.stdout:1454 write 0x4d778a6 thru 0x4d7b1dc (0x3937 bytes) 2024-04-23T23:38:02.104 INFO:teuthology.orchestra.run.smithi077.stdout:1455 read 0x16e68d1 thru 0x16f3329 (0xca59 bytes) 2024-04-23T23:38:02.104 INFO:teuthology.orchestra.run.smithi077.stdout:1456 read 0x1cd8297 thru 0x1ce4442 (0xc1ac bytes) 2024-04-23T23:38:02.109 INFO:teuthology.orchestra.run.smithi077.stdout:1458 write 0x6805a85 thru 0x680c1be (0x673a bytes) 2024-04-23T23:38:02.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:02.131 INFO:teuthology.orchestra.run.smithi077.stdout:1459 writesame 0xa5b8087 thru 0xa5c4b6b data_size 0x1(0xcae5 bytes) 2024-04-23T23:38:02.131 INFO:teuthology.orchestra.run.smithi077.stdout:1460 write 0x1c47f10 thru 0x1c4c945 (0x4a36 bytes) 2024-04-23T23:38:02.137 INFO:teuthology.orchestra.run.smithi077.stdout:1461 read 0xa3d15db thru 0xa3e0446 (0xee6c bytes) 2024-04-23T23:38:02.137 INFO:teuthology.orchestra.run.smithi077.stdout:1466 write 0x8725ba5 thru 0x87339ae (0xde0a bytes) 2024-04-23T23:38:02.141 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:02.154+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:02.153 INFO:teuthology.orchestra.run.smithi077.stdout:1467 write 0xe65da8d thru 0xe665712 (0x7c86 bytes) 2024-04-23T23:38:02.160 INFO:teuthology.orchestra.run.smithi077.stdout:1468 punch from 0xbf1fb78 to 0xbf2803e, (0x84c6 bytes) 2024-04-23T23:38:02.160 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.160 INFO:teuthology.orchestra.run.smithi077.stdout:1473 write 0x46e5521 thru 0x46e8666 (0x3146 bytes) 2024-04-23T23:38:02.166 INFO:teuthology.orchestra.run.smithi077.stdout:1474 punch from 0x9a52018 to 0x9a59070, (0x7058 bytes) 2024-04-23T23:38:02.166 INFO:teuthology.orchestra.run.smithi077.stdout:1475 read 0xaedf8e1 thru 0xaee67f0 (0x6f10 bytes) 2024-04-23T23:38:02.166 INFO:teuthology.orchestra.run.smithi077.stdout:1476 read 0x29bf091 thru 0x29c3bcc (0x4b3c bytes) 2024-04-23T23:38:02.166 INFO:teuthology.orchestra.run.smithi077.stdout:1477 punch from 0x7e6378 to 0x7f0081, (0x9d09 bytes) 2024-04-23T23:38:02.166 INFO:teuthology.orchestra.run.smithi077.stdout:1479 write 0x85e21cc thru 0x85e8da5 (0x6bda bytes) 2024-04-23T23:38:02.173 INFO:teuthology.orchestra.run.smithi077.stdout:1480 writesame 0x19ff6f5 thru 0x1a0d9c4 data_size 0x4c(0xe2d0 bytes) 2024-04-23T23:38:02.175 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.175 INFO:teuthology.orchestra.run.smithi077.stdout:1482 read 0xe31f10 thru 0xe3c027 (0xa118 bytes) 2024-04-23T23:38:02.176 INFO:teuthology.orchestra.run.smithi077.stdout:1483 read 0x6992394 thru 0x699d848 (0xb4b5 bytes) 2024-04-23T23:38:02.184 INFO:teuthology.orchestra.run.smithi077.stdout:1484 trunc from 0xe665713 to 0x6fdbf95 2024-04-23T23:38:02.195 INFO:teuthology.orchestra.run.smithi077.stdout:1485 writesame 0x4ab8f29 thru 0x4abf5c6 data_size 0x5(0x669e bytes) 2024-04-23T23:38:02.200 INFO:teuthology.orchestra.run.smithi077.stdout:1486 read 0x6d5021f thru 0x6d57331 (0x7113 bytes) 2024-04-23T23:38:02.204 INFO:teuthology.orchestra.run.smithi077.stdout:1487 trunc from 0x6fdbf95 to 0xa4ed1c9 2024-04-23T23:38:02.210 INFO:teuthology.orchestra.run.smithi077.stdout:1489 read 0x41769d0 thru 0x4183aa4 (0xd0d5 bytes) 2024-04-23T23:38:02.210 INFO:teuthology.orchestra.run.smithi077.stdout:1491 punch from 0x440db1c to 0x4412c96, (0x517a bytes) 2024-04-23T23:38:02.210 INFO:teuthology.orchestra.run.smithi077.stdout:1492 punch from 0x21d9443 to 0x21ded93, (0x5950 bytes) 2024-04-23T23:38:02.214 INFO:teuthology.orchestra.run.smithi077.stdout:1493 trunc from 0xa4ed1c9 to 0xe157c3e 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13704 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 432128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:02.220 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3221318530000001, 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030259801999999999, 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13704 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909423+0000", 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:38:02.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909426+0000", 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8320000000000002e-06 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909432+0000", 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1090000000000003e-06 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909443+0000", 2024-04-23T23:38:02.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1014e-05 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939489+0000", 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030046209000000001 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939570+0000", 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1037000000000004e-05 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939682+0000", 2024-04-23T23:38:02.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011209000000000001 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3211633539999994, 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:02.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:02.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:02.229 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3211291529999993, 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:02.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3210955630000001, 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:02.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:02.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:02.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3210580279999995, 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.240 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:02.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:02.244 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3210344920000008, 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:02.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:02.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3196452759999993, 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:02.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:02.253 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3196168890000006, 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.257 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3195945800000004, 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.258 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:02.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3194263569999993, 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.262 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3193776310000001, 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.266 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:02.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.270 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3192824359999999, 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.271 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:02.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3192504859999996, 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.275 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:02.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:02.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3192281860000001, 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:02.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3191979899999993, 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.284 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.288 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3190382249999999, 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:02.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:02.292 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3190026059999997, 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.293 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:02.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3189033250000008, 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.297 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.301 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3188737590000006, 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.305 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.3188513349999997, 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:02.306 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:02.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:02.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:02.310 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:02.312 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:1494 write 0xdb0ebb8 thru 0xdb1e73d (0xfb86 bytes) 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:1495 punch from 0x5daf02c to 0x5db7853, (0x8827 bytes) 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:1496 trunc from 0xe157c3e to 0xb5f7c3d 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:1500 read 0x9f2c5d6 thru 0x9f32959 (0x6384 bytes) 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:1502 punch from 0x631f01e to 0x632d661, (0xe643 bytes) 2024-04-23T23:38:02.313 INFO:teuthology.orchestra.run.smithi077.stdout:1504 writesame 0xe98b7fd thru 0xe994632 data_size 0x2(0x8e36 bytes) 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stdout:1506 punch from 0xcfd6ad6 to 0xcfdde73, (0x739d bytes) 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stdout:1507 read 0xda3f4f9 thru 0xda44941 (0x5449 bytes) 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stdout:1508 writesame 0x1b3c394 thru 0x1b4668f data_size 0x72(0xa2fc bytes) 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stdout:1514 write 0x9611d7b thru 0x961b3fc (0x9682 bytes) 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:02.314 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:02.315 INFO:teuthology.orchestra.run.smithi077.stdout:1515 trunc from 0xe994633 to 0x1ba6ffc 2024-04-23T23:38:02.315 INFO:teuthology.orchestra.run.smithi077.stdout:1517 read 0xf9abf7 thru 0xfa3e2d (0x9237 bytes) 2024-04-23T23:38:02.315 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xecbe862 2024-04-23T23:38:02.315 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:02.316 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:02.316 INFO:teuthology.orchestra.run.smithi077.stdout:1518 trunc from 0x1ba6ffc to 0xecbe862 2024-04-23T23:38:02.316 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.316 INFO:teuthology.orchestra.run.smithi077.stdout:1521 write 0x9d92a66 thru 0x9d93bbb (0x1156 bytes) 2024-04-23T23:38:02.317 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:02.317 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:02.317 INFO:teuthology.orchestra.run.smithi077.stdout:1522 write 0x60e117b thru 0x60e6126 (0x4fac bytes) 2024-04-23T23:38:02.317 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:02.323+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:02.318 INFO:teuthology.orchestra.run.smithi077.stdout:1523 writesame 0x2ed580d thru 0x2ee3fe3 data_size 0x1(0xe7d7 bytes) 2024-04-23T23:38:02.331 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:02.331 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:02.331 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.331 INFO:teuthology.orchestra.run.smithi077.stdout:1525 write 0x50d09db thru 0x50de78b (0xddb1 bytes) 2024-04-23T23:38:02.337 INFO:teuthology.orchestra.run.smithi077.stdout:1526 write 0x64b75ad thru 0x64c4a70 (0xd4c4 bytes) 2024-04-23T23:38:02.344 INFO:teuthology.orchestra.run.smithi077.stdout:1527 read 0x340c164 thru 0x3418591 (0xc42e bytes) 2024-04-23T23:38:02.344 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.344 INFO:teuthology.orchestra.run.smithi077.stdout:1529 read 0xa17f0ac thru 0xa185095 (0x5fea bytes) 2024-04-23T23:38:02.344 INFO:teuthology.orchestra.run.smithi077.stdout:1530 read 0xc8022df thru 0xc80de17 (0xbb39 bytes) 2024-04-23T23:38:02.344 INFO:teuthology.orchestra.run.smithi077.stdout:1531 read 0x442ecdb thru 0x443b8cb (0xcbf1 bytes) 2024-04-23T23:38:02.344 INFO:teuthology.orchestra.run.smithi077.stdout:1532 read 0x82153e9 thru 0x82211d0 (0xbde8 bytes) 2024-04-23T23:38:02.349 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:02.349 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:02.354 INFO:teuthology.orchestra.run.smithi077.stdout:1533 trunc from 0xecbe862 to 0x5947b49 2024-04-23T23:38:02.366 INFO:teuthology.orchestra.run.smithi077.stdout:1535 write 0x157a3e9 thru 0x1586eb7 (0xcacf bytes) 2024-04-23T23:38:02.370 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:02.374 INFO:teuthology.orchestra.run.smithi077.stdout:1536 trunc from 0x5947b49 to 0x459276f 2024-04-23T23:38:02.389 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:02.389 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:02.393 INFO:teuthology.orchestra.run.smithi077.stdout:1537 writesame 0x818310f thru 0x819260e data_size 0xa0(0xf500 bytes) 2024-04-23T23:38:02.393 INFO:teuthology.orchestra.run.smithi077.stdout:1538 read 0x69a9975 thru 0x69ab2ca (0x1956 bytes) 2024-04-23T23:38:02.399 INFO:teuthology.orchestra.run.smithi077.stdout:1539 write 0x8ca8f03 thru 0x8cb15b8 (0x86b6 bytes) 2024-04-23T23:38:02.410 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:02.410 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:02.413 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:02.425+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:02.415 INFO:teuthology.orchestra.run.smithi077.stdout:1540 write 0xb80caa1 thru 0xb816c8d (0xa1ed bytes) 2024-04-23T23:38:02.423 INFO:teuthology.orchestra.run.smithi077.stdout:1541 flatten 2024-04-23T23:38:02.501 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:02.501 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:02.514 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:02.514 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:02.525+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:02.552 INFO:teuthology.orchestra.run.smithi077.stdout:1542 read 0x82d6eea thru 0x82dbc40 (0x4d57 bytes) 2024-04-23T23:38:02.556 INFO:teuthology.orchestra.run.smithi077.stdout:1544 write 0xba9a36b thru 0xbaa9af2 (0xf788 bytes) 2024-04-23T23:38:02.567 INFO:teuthology.orchestra.run.smithi077.stdout:1545 read 0x6174086 thru 0x618370c (0xf687 bytes) 2024-04-23T23:38:02.567 INFO:teuthology.orchestra.run.smithi077.stdout:1546 write 0x28f7d6c thru 0x2901d3b (0x9fd0 bytes) 2024-04-23T23:38:02.573 INFO:teuthology.orchestra.run.smithi077.stdout:1547 writesame 0xf4bdbc thru 0xf4be26 data_size 0x1(0x6b bytes) 2024-04-23T23:38:02.576 INFO:teuthology.orchestra.run.smithi077.stdout:1550 write 0xba55d30 thru 0xba5ac91 (0x4f62 bytes) 2024-04-23T23:38:02.578 INFO:teuthology.orchestra.run.smithi077.stdout:1551 writesame 0x98fed59 thru 0x990574e data_size 0x63(0x69f6 bytes) 2024-04-23T23:38:02.585 INFO:teuthology.orchestra.run.smithi077.stdout:1552 read 0x82cf743 thru 0x82da73d (0xaffb bytes) 2024-04-23T23:38:02.585 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.585 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.585 INFO:teuthology.orchestra.run.smithi077.stdout:1557 punch from 0xab44755 to 0xab4d5bc, (0x8e67 bytes) 2024-04-23T23:38:02.585 INFO:teuthology.orchestra.run.smithi077.stdout:1558 read 0x70b876 thru 0x718cd5 (0xd460 bytes) 2024-04-23T23:38:02.586 INFO:teuthology.orchestra.run.smithi077.stdout:1559 write 0x5f4acac thru 0x5f4f66f (0x49c4 bytes) 2024-04-23T23:38:02.592 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:02.592 INFO:teuthology.orchestra.run.smithi077.stdout:1561 clone 8 order 19 su 262144 sc 14 2024-04-23T23:38:02.614 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:02.626+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:02.661 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:02.661 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:02.670 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:02.715 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:02.727+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:02.771 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:02.771 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:02.780 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:02.823 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:02.836+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:02.884 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:02.884 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:02.893 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:02.905 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:38:02.934 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:02.946+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:03.018 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:03.030+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:03.037 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.037 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.046 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:03.085 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-04-23T23:38:03.119 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:03.131+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:03.134 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.134 INFO:teuthology.orchestra.run.smithi077.stdout:1563 write 0x7bdbf26 thru 0x7be97b7 (0xd892 bytes) 2024-04-23T23:38:03.150 INFO:teuthology.orchestra.run.smithi077.stdout:1564 trunc from 0xbaa9af3 to 0x3a175a1 2024-04-23T23:38:03.171 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.171 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:03.183 INFO:teuthology.orchestra.run.smithi077.stdout:1566 writesame 0x8f4613c thru 0x8f50f3b data_size 0x80(0xae00 bytes) 2024-04-23T23:38:03.192 INFO:teuthology.orchestra.run.smithi077.stdout:1567 writesame 0xd61de65 thru 0xd622e30 data_size 0x2(0x4fcc bytes) 2024-04-23T23:38:03.197 INFO:teuthology.orchestra.run.smithi077.stdout:1568 trunc from 0xd622e31 to 0x969cbf9 2024-04-23T23:38:03.202 INFO:teuthology.orchestra.run.smithi077.stdout:1569 read 0x357584b thru 0x357c6cf (0x6e85 bytes) 2024-04-23T23:38:03.209 INFO:teuthology.orchestra.run.smithi077.stdout:1570 write 0xaea64a0 thru 0xaeb3175 (0xccd6 bytes) 2024-04-23T23:38:03.212 INFO:teuthology.orchestra.run.smithi077.stdout:1572 punch from 0x1ca340 to 0x1d1e3d, (0x7afd bytes) 2024-04-23T23:38:03.212 INFO:teuthology.orchestra.run.smithi077.stdout:1573 write 0x2fce559 thru 0x2fd8039 (0x9ae1 bytes) 2024-04-23T23:38:03.216 INFO:teuthology.orchestra.run.smithi077.stdout:1574 read 0x178cd5 thru 0x17fdde (0x710a bytes) 2024-04-23T23:38:03.218 INFO:teuthology.orchestra.run.smithi077.stdout:1577 punch from 0x17d24e7 to 0x17d5db0, (0x38c9 bytes) 2024-04-23T23:38:03.218 INFO:teuthology.orchestra.run.smithi077.stdout:1579 write 0x364a66a thru 0x365779f (0xd136 bytes) 2024-04-23T23:38:03.222 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:03.234+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:03.224 INFO:teuthology.orchestra.run.smithi077.stdout:1582 trunc from 0xaeb3176 to 0xe3ad29a 2024-04-23T23:38:03.230 INFO:teuthology.orchestra.run.smithi077.stdout:1584 write 0xe2d1a2c thru 0xe2e1748 (0xfd1d bytes) 2024-04-23T23:38:03.238 INFO:teuthology.orchestra.run.smithi077.stdout:1585 write 0xea64a1f thru 0xea68ea4 (0x4486 bytes) 2024-04-23T23:38:03.241 INFO:teuthology.orchestra.run.smithi077.stdout:1587 punch from 0xbc50664 to 0xbc5eff4, (0xe990 bytes) 2024-04-23T23:38:03.254 INFO:teuthology.orchestra.run.smithi077.stdout:1588 trunc from 0xea68ea5 to 0x463f148 2024-04-23T23:38:03.273 INFO:teuthology.orchestra.run.smithi077.stdout:1589 write 0x80a53de thru 0x80b3793 (0xe3b6 bytes) 2024-04-23T23:38:03.276 INFO:teuthology.orchestra.run.smithi077.stdout:1590 writesame 0x7bec49d thru 0x7bfbd45 data_size 0xb(0xf8a9 bytes) 2024-04-23T23:38:03.281 INFO:teuthology.orchestra.run.smithi077.stdout:1591 read 0x424f623 thru 0x4254ec4 (0x58a2 bytes) 2024-04-23T23:38:03.286 INFO:teuthology.orchestra.run.smithi077.stdout:1592 trunc from 0x80b3794 to 0x3793ba5 2024-04-23T23:38:03.298 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.299 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.307 INFO:teuthology.orchestra.run.smithi077.stdout:1593 write 0x4f0ebfb thru 0x4f18080 (0x9486 bytes) 2024-04-23T23:38:03.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:03.310 INFO:teuthology.orchestra.run.smithi077.stdout:1595 write 0x4f12ae thru 0x4f2e84 (0x1bd7 bytes) 2024-04-23T23:38:03.327 INFO:teuthology.orchestra.run.smithi077.stdout:1599 write 0x948eef4 thru 0x9491a89 (0x2b96 bytes) 2024-04-23T23:38:03.327 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:03.339+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:03.340 INFO:teuthology.orchestra.run.smithi077.stdout:1601 write 0xd3b92dc thru 0xd3c35b1 (0xa2d6 bytes) 2024-04-23T23:38:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:1602 read 0xcaeb3c1 thru 0xcaf986a (0xe4aa bytes) 2024-04-23T23:38:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.345 INFO:teuthology.orchestra.run.smithi077.stdout:1607 read 0x1b6d42e thru 0x1b6edc0 (0x1993 bytes) 2024-04-23T23:38:03.345 INFO:teuthology.orchestra.run.smithi077.stdout:1608 read 0xcefcc63 thru 0xcf0bfe8 (0xf386 bytes) 2024-04-23T23:38:03.345 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.345 INFO:teuthology.orchestra.run.smithi077.stdout:1614 punch from 0x3861e3f to 0x386e023, (0xc1e4 bytes) 2024-04-23T23:38:03.349 INFO:teuthology.orchestra.run.smithi077.stdout:1615 trunc from 0xd3c35b2 to 0x979ca77 2024-04-23T23:38:03.360 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.361 INFO:teuthology.orchestra.run.smithi077.stdout:1618 trunc from 0x979ca77 to 0xa925af1 2024-04-23T23:38:03.367 INFO:teuthology.orchestra.run.smithi077.stdout:1620 punch from 0x565e015 to 0x56679c8, (0x99b3 bytes) 2024-04-23T23:38:03.367 INFO:teuthology.orchestra.run.smithi077.stdout:1621 writesame 0x99776f2 thru 0x997c0bb data_size 0xa(0x49ca bytes) 2024-04-23T23:38:03.380 INFO:teuthology.orchestra.run.smithi077.stdout:1622 writesame 0xe67f842 thru 0xe68a909 data_size 0x4(0xb0c8 bytes) 2024-04-23T23:38:03.380 INFO:teuthology.orchestra.run.smithi077.stdout:1625 write 0xca1bc1 thru 0xcac16a (0xa5aa bytes) 2024-04-23T23:38:03.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.384 INFO:teuthology.orchestra.run.smithi077.stdout:1628 read 0x463e27e thru 0x463e749 (0x4cc bytes) 2024-04-23T23:38:03.384 INFO:teuthology.orchestra.run.smithi077.stdout:1629 read 0x342657 thru 0x34fe50 (0xd7fa bytes) 2024-04-23T23:38:03.394 INFO:teuthology.orchestra.run.smithi077.stdout:1630 trunc from 0xe68a90a to 0x6977e12 2024-04-23T23:38:03.403 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.409 INFO:teuthology.orchestra.run.smithi077.stdout:1633 write 0x759c0f5 thru 0x75a3af9 (0x7a05 bytes) 2024-04-23T23:38:03.418 INFO:teuthology.orchestra.run.smithi077.stdout:1636 trunc from 0x75a3afa to 0x2784f09 2024-04-23T23:38:03.421 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:03.434+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:03.426 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.426 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:03.450 INFO:teuthology.orchestra.run.smithi077.stdout:1637 writesame 0x5c0467f thru 0x5c12365 data_size 0xb(0xdce7 bytes) 2024-04-23T23:38:03.461 INFO:teuthology.orchestra.run.smithi077.stdout:1638 writesame 0xa157b10 thru 0xa15aae9 data_size 0x19(0x2fda bytes) 2024-04-23T23:38:03.461 INFO:teuthology.orchestra.run.smithi077.stdout:1639 read 0x45d86fe thru 0x45dd656 (0x4f59 bytes) 2024-04-23T23:38:03.461 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.461 INFO:teuthology.orchestra.run.smithi077.stdout:1641 read 0x53250c5 thru 0x532ab9f (0x5adb bytes) 2024-04-23T23:38:03.461 INFO:teuthology.orchestra.run.smithi077.stdout:1642 writesame 0x4c376a1 thru 0x4c3d51b data_size 0x13(0x5e7b bytes) 2024-04-23T23:38:03.464 INFO:teuthology.orchestra.run.smithi077.stdout:1643 read 0x1a40f9f thru 0x1a4be14 (0xae76 bytes) 2024-04-23T23:38:03.464 INFO:teuthology.orchestra.run.smithi077.stdout:1644 read 0x6b26f1f thru 0x6b32691 (0xb773 bytes) 2024-04-23T23:38:03.470 INFO:teuthology.orchestra.run.smithi077.stdout:1645 writesame 0xb110e6c thru 0xb11491f data_size 0x34(0x3ab4 bytes) 2024-04-23T23:38:03.478 INFO:teuthology.orchestra.run.smithi077.stdout:1647 trunc from 0xb114920 to 0x487f740 2024-04-23T23:38:03.487 INFO:teuthology.orchestra.run.smithi077.stdout:1648 write 0x31dce43 thru 0x31dddf9 (0xfb7 bytes) 2024-04-23T23:38:03.490 INFO:teuthology.orchestra.run.smithi077.stdout:1650 read 0x3876f04 thru 0x387b703 (0x4800 bytes) 2024-04-23T23:38:03.490 INFO:teuthology.orchestra.run.smithi077.stdout:1652 read 0x25a933f thru 0x25b7b68 (0xe82a bytes) 2024-04-23T23:38:03.490 INFO:teuthology.orchestra.run.smithi077.stdout:1653 trunc from 0x487f740 to 0x48779c1 2024-04-23T23:38:03.512 INFO:teuthology.orchestra.run.smithi077.stdout:1655 writesame 0xe162b36 thru 0xe1679d6 data_size 0x1(0x4ea1 bytes) 2024-04-23T23:38:03.512 INFO:teuthology.orchestra.run.smithi077.stdout:1656 read 0x81c8a13 thru 0x81ca84f (0x1e3d bytes) 2024-04-23T23:38:03.512 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.512 INFO:teuthology.orchestra.run.smithi077.stdout:1658 punch from 0x641df7a to 0x6423a31, (0x5ab7 bytes) 2024-04-23T23:38:03.512 INFO:teuthology.orchestra.run.smithi077.stdout:1659 write 0x6a1eccc thru 0x6a22e92 (0x41c7 bytes) 2024-04-23T23:38:03.515 INFO:teuthology.orchestra.run.smithi077.stdout:1660 read 0x253a928 thru 0x253d646 (0x2d1f bytes) 2024-04-23T23:38:03.515 INFO:teuthology.orchestra.run.smithi077.stdout:1661 write 0x73b9d57 thru 0x73b9e3d (0xe7 bytes) 2024-04-23T23:38:03.522 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:03.535+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:03.523 INFO:teuthology.orchestra.run.smithi077.stdout:1662 write 0xe8c4dc1 thru 0xe8cc66b (0x78ab bytes) 2024-04-23T23:38:03.526 INFO:teuthology.orchestra.run.smithi077.stdout:1663 write 0xd61ae29 thru 0xd62571f (0xa8f7 bytes) 2024-04-23T23:38:03.529 INFO:teuthology.orchestra.run.smithi077.stdout:1665 writesame 0xca41d54 thru 0xca4cf76 data_size 0x1b(0xb223 bytes) 2024-04-23T23:38:03.533 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.533 INFO:teuthology.orchestra.run.smithi077.stdout:1670 read 0x5d38da6 thru 0x5d40943 (0x7b9e bytes) 2024-04-23T23:38:03.533 INFO:teuthology.orchestra.run.smithi077.stdout:1671 punch from 0x99867b1 to 0x998f582, (0x8dd1 bytes) 2024-04-23T23:38:03.533 INFO:teuthology.orchestra.run.smithi077.stdout:1672 writesame 0xdf3d89d thru 0xdf4cd27 data_size 0x1(0xf48b bytes) 2024-04-23T23:38:03.563 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.564 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.564 INFO:teuthology.orchestra.run.smithi077.stdout:1673 trunc from 0xe8cc66c to 0xbad3004 2024-04-23T23:38:03.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:03.574 INFO:teuthology.orchestra.run.smithi077.stdout:1674 write 0x56a2389 thru 0x56b1877 (0xf4ef bytes) 2024-04-23T23:38:03.577 INFO:teuthology.orchestra.run.smithi077.stdout:1676 trunc from 0xbad3004 to 0xb35373e 2024-04-23T23:38:03.583 INFO:teuthology.orchestra.run.smithi077.stdout:1679 trunc from 0xb35373e to 0xbe65b06 2024-04-23T23:38:03.588 INFO:teuthology.orchestra.run.smithi077.stdout:1680 read 0x8cfd83f thru 0x8cfeca0 (0x1462 bytes) 2024-04-23T23:38:03.588 INFO:teuthology.orchestra.run.smithi077.stdout:1681 write 0x1229885 thru 0x1233472 (0x9bee bytes) 2024-04-23T23:38:03.591 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.597 INFO:teuthology.orchestra.run.smithi077.stdout:1683 write 0xc65b263 thru 0xc668cf5 (0xda93 bytes) 2024-04-23T23:38:03.600 INFO:teuthology.orchestra.run.smithi077.stdout:1684 read 0x5bbb51e thru 0x5bbdd42 (0x2825 bytes) 2024-04-23T23:38:03.600 INFO:teuthology.orchestra.run.smithi077.stdout:1685 writesame 0xc57bccc thru 0xc589a18 data_size 0x1(0xdd4d bytes) 2024-04-23T23:38:03.623 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:03.635+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:03.637 INFO:teuthology.orchestra.run.smithi077.stdout:1686 trunc from 0xc668cf6 to 0x2102c84 2024-04-23T23:38:03.662 INFO:teuthology.orchestra.run.smithi077.stdout:1688 read 0x13cd8fb thru 0x13d1f06 (0x460c bytes) 2024-04-23T23:38:03.667 INFO:teuthology.orchestra.run.smithi077.stdout:1689 trunc from 0x2102c84 to 0x5fc84b9 2024-04-23T23:38:03.671 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.671 INFO:teuthology.orchestra.run.smithi077.stdout:1693 punch from 0x1fda3d to 0x207013, (0x95d6 bytes) 2024-04-23T23:38:03.672 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.672 INFO:teuthology.orchestra.run.smithi077.stdout:1695 read 0xbf57cc thru 0xbf85fb (0x2e30 bytes) 2024-04-23T23:38:03.677 INFO:teuthology.orchestra.run.smithi077.stdout:1696 trunc from 0x5fc84b9 to 0xa758626 2024-04-23T23:38:03.681 INFO:teuthology.orchestra.run.smithi077.stdout:1697 write 0x174f284 thru 0x1754e66 (0x5be3 bytes) 2024-04-23T23:38:03.684 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.684 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.685 INFO:teuthology.orchestra.run.smithi077.stdout:1698 writesame 0xa4fbb00 thru 0xa508927 data_size 0x24(0xce28 bytes) 2024-04-23T23:38:03.690 INFO:teuthology.orchestra.run.smithi077.stdout:1701 trunc from 0xa758626 to 0xb867a09 2024-04-23T23:38:03.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:03.695 INFO:teuthology.orchestra.run.smithi077.stdout:1702 writesame 0x37400e6 thru 0x374eefa data_size 0x1(0xee15 bytes) 2024-04-23T23:38:03.722 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.722 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.723 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:03.736+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:03.727 INFO:teuthology.orchestra.run.smithi077.stdout:1707 trunc from 0xb867a09 to 0x794f781 2024-04-23T23:38:03.736 INFO:teuthology.orchestra.run.smithi077.stdout:1708 read 0x6080689 thru 0x6087d0c (0x7684 bytes) 2024-04-23T23:38:03.736 INFO:teuthology.orchestra.run.smithi077.stdout:1709 read 0x7626efe thru 0x76338bc (0xc9bf bytes) 2024-04-23T23:38:03.744 INFO:teuthology.orchestra.run.smithi077.stdout:1712 writesame 0x999dc38 thru 0x99ad16b data_size 0x6(0xf534 bytes) 2024-04-23T23:38:03.744 INFO:teuthology.orchestra.run.smithi077.stdout:1713 read 0x765ee6a thru 0x7665509 (0x66a0 bytes) 2024-04-23T23:38:03.748 INFO:teuthology.orchestra.run.smithi077.stdout:1714 trunc from 0x99ad16c to 0xd0b968a 2024-04-23T23:38:03.753 INFO:teuthology.orchestra.run.smithi077.stdout:1715 write 0x7d1121e thru 0x7d183dc (0x71bf bytes) 2024-04-23T23:38:03.756 INFO:teuthology.orchestra.run.smithi077.stdout:1717 read 0x2ca53b thru 0x2d10bf (0x6b85 bytes) 2024-04-23T23:38:03.764 INFO:teuthology.orchestra.run.smithi077.stdout:1718 trunc from 0xd0b968a to 0x7701b54 2024-04-23T23:38:03.773 INFO:teuthology.orchestra.run.smithi077.stdout:1719 punch from 0x43e8bef to 0x43f8913, (0xfd24 bytes) 2024-04-23T23:38:03.773 INFO:teuthology.orchestra.run.smithi077.stdout:1720 read 0x4030293 thru 0x403d080 (0xcdee bytes) 2024-04-23T23:38:03.787 INFO:teuthology.orchestra.run.smithi077.stdout:1721 write 0xe702428 thru 0xe70f755 (0xd32e bytes) 2024-04-23T23:38:03.790 INFO:teuthology.orchestra.run.smithi077.stdout:1722 write 0xe4d3eb1 thru 0xe4d7c11 (0x3d61 bytes) 2024-04-23T23:38:03.797 INFO:teuthology.orchestra.run.smithi077.stdout:1723 trunc from 0xe70f756 to 0xace0ef3 2024-04-23T23:38:03.806 INFO:teuthology.orchestra.run.smithi077.stdout:1724 write 0x4714a9f thru 0x4722acd (0xe02f bytes) 2024-04-23T23:38:03.808 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.808 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.809 INFO:teuthology.orchestra.run.smithi077.stdout:1727 write 0x8f0327b thru 0x8f0dd10 (0xaa96 bytes) 2024-04-23T23:38:03.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:03.820 INFO:teuthology.orchestra.run.smithi077.stdout:1728 write 0xcd8e1d0 thru 0xcd909b0 (0x27e1 bytes) 2024-04-23T23:38:03.822 INFO:teuthology.orchestra.run.smithi077.stdout:1730 writesame 0x11ebc4e thru 0x11fb21a data_size 0x19(0xf5cd bytes) 2024-04-23T23:38:03.825 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:03.837+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:03.827 INFO:teuthology.orchestra.run.smithi077.stdout:1732 read 0x2174bec thru 0x21776a4 (0x2ab9 bytes) 2024-04-23T23:38:03.838 INFO:teuthology.orchestra.run.smithi077.stdout:1733 trunc from 0xcd909b1 to 0x3f8f969 2024-04-23T23:38:03.847 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:03.849 INFO:teuthology.orchestra.run.smithi077.stdout:1737 trunc from 0x3f8f969 to 0x20efebb 2024-04-23T23:38:03.879 INFO:teuthology.orchestra.run.smithi077.stdout:1738 write 0xbc4eab5 thru 0xbc517ef (0x2d3b bytes) 2024-04-23T23:38:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:1739 read 0x9c2311a thru 0x9c2860c (0x54f3 bytes) 2024-04-23T23:38:03.882 INFO:teuthology.orchestra.run.smithi077.stdout:1740 writesame 0x7533f89 thru 0x753c028 data_size 0x93(0x80a0 bytes) 2024-04-23T23:38:03.891 INFO:teuthology.orchestra.run.smithi077.stdout:1741 trunc from 0xbc517f0 to 0x6c67068 2024-04-23T23:38:03.900 INFO:teuthology.orchestra.run.smithi077.stdout:1743 read 0x196308e thru 0x196b186 (0x80f9 bytes) 2024-04-23T23:38:03.901 INFO:teuthology.orchestra.run.smithi077.stdout:1744 write 0x19f8461 thru 0x19ffacb (0x766b bytes) 2024-04-23T23:38:03.905 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:38:03.908 INFO:teuthology.orchestra.run.smithi077.stdout:1745 punch from 0x3cc300d to 0x3cc7cdd, (0x4cd0 bytes) 2024-04-23T23:38:03.908 INFO:teuthology.orchestra.run.smithi077.stdout:1746 read 0x5f672b6 thru 0x5f6774d (0x498 bytes) 2024-04-23T23:38:03.917 INFO:teuthology.orchestra.run.smithi077.stdout:1749 trunc from 0x6c67068 to 0x1c37ea 2024-04-23T23:38:03.925 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:03.937+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:03.948 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:03.948 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:03.957 INFO:teuthology.orchestra.run.smithi077.stdout:1750 read 0x17272e thru 0x17dea0 (0xb773 bytes) 2024-04-23T23:38:03.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:03.979 INFO:teuthology.orchestra.run.smithi077.stdout:1754 write 0xe26faa2 thru 0xe27598e (0x5eed bytes) 2024-04-23T23:38:03.988 INFO:teuthology.orchestra.run.smithi077.stdout:1755 trunc from 0xe27598f to 0x975c8f8 2024-04-23T23:38:03.997 INFO:teuthology.orchestra.run.smithi077.stdout:1756 read 0x50dc6d5 thru 0x50e46b6 (0x7fe2 bytes) 2024-04-23T23:38:04.005 INFO:teuthology.orchestra.run.smithi077.stdout:1757 write 0xca67200 thru 0xca67b4b (0x94c bytes) 2024-04-23T23:38:04.008 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.010 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:04.010 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:04.010 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-23T23:38:04.010 INFO:tasks.thrashosds.thrasher:Setting osd 7 primary_affinity to 0.744478 2024-04-23T23:38:04.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 0.7444778363319622 2024-04-23T23:38:04.016 INFO:teuthology.orchestra.run.smithi077.stdout:1760 write 0xdf57ef9 thru 0xdf67823 (0xf92b bytes) 2024-04-23T23:38:04.019 INFO:teuthology.orchestra.run.smithi077.stdout:1761 read 0x244b2d3 thru 0x245b1ca (0xfef8 bytes) 2024-04-23T23:38:04.019 INFO:teuthology.orchestra.run.smithi077.stdout:1762 read 0x3a7131b thru 0x3a7a8de (0x95c4 bytes) 2024-04-23T23:38:04.019 INFO:teuthology.orchestra.run.smithi077.stdout:1764 write 0x919b0f0 thru 0x91a53c3 (0xa2d4 bytes) 2024-04-23T23:38:04.022 INFO:teuthology.orchestra.run.smithi077.stdout:1765 read 0x484b3de thru 0x485ad9d (0xf9c0 bytes) 2024-04-23T23:38:04.022 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.022 INFO:teuthology.orchestra.run.smithi077.stdout:1767 writesame 0x318e3ee thru 0x3192170 data_size 0x1d(0x3d83 bytes) 2024-04-23T23:38:04.025 INFO:teuthology.orchestra.run.smithi077.stdout:1768 write 0xc985ea2 thru 0xc98fa20 (0x9b7f bytes) 2024-04-23T23:38:04.026 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:04.038+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:04.028 INFO:teuthology.orchestra.run.smithi077.stdout:1769 punch from 0x943a901 to 0x9443d23, (0x9422 bytes) 2024-04-23T23:38:04.028 INFO:teuthology.orchestra.run.smithi077.stdout:1770 write 0x8cab683 thru 0x8cb0831 (0x51af bytes) 2024-04-23T23:38:04.032 INFO:teuthology.orchestra.run.smithi077.stdout:1771 write 0x716a539 thru 0x717a165 (0xfc2d bytes) 2024-04-23T23:38:04.035 INFO:teuthology.orchestra.run.smithi077.stdout:1772 write 0x892e08a thru 0x8936609 (0x8580 bytes) 2024-04-23T23:38:04.039 INFO:teuthology.orchestra.run.smithi077.stdout:1773 punch from 0x197a6a9 to 0x197e28a, (0x3be1 bytes) 2024-04-23T23:38:04.039 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.039 INFO:teuthology.orchestra.run.smithi077.stdout:1776 read 0x27c8982 thru 0x27d64da (0xdb59 bytes) 2024-04-23T23:38:04.039 INFO:teuthology.orchestra.run.smithi077.stdout:1777 write 0x424c86f thru 0x424d436 (0xbc8 bytes) 2024-04-23T23:38:04.042 INFO:teuthology.orchestra.run.smithi077.stdout:1779 read 0xa75b9b5 thru 0xa76b25e (0xf8aa bytes) 2024-04-23T23:38:04.042 INFO:teuthology.orchestra.run.smithi077.stdout:1780 writesame 0x30220c9 thru 0x302b928 data_size 0x6a(0x9860 bytes) 2024-04-23T23:38:04.045 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.045 INFO:teuthology.orchestra.run.smithi077.stdout:1782 write 0xd9db9c2 thru 0xd9e52a2 (0x98e1 bytes) 2024-04-23T23:38:04.048 INFO:teuthology.orchestra.run.smithi077.stdout:1783 punch from 0x2ae57f9 to 0x2aeba01, (0x6208 bytes) 2024-04-23T23:38:04.048 INFO:teuthology.orchestra.run.smithi077.stdout:1785 punch from 0x7a8a36b to 0x7a9492e, (0xa5c3 bytes) 2024-04-23T23:38:04.055 INFO:teuthology.orchestra.run.smithi077.stdout:1788 trunc from 0xdf67824 to 0x7864daf 2024-04-23T23:38:04.065 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.066 INFO:teuthology.orchestra.run.smithi077.stdout:1791 read 0x7327666 thru 0x7335ac1 (0xe45c bytes) 2024-04-23T23:38:04.066 INFO:teuthology.orchestra.run.smithi077.stdout:1792 punch from 0x3f657a0 to 0x3f6c594, (0x6df4 bytes) 2024-04-23T23:38:04.071 INFO:teuthology.orchestra.run.smithi077.stdout:1793 trunc from 0x7864daf to 0xc394f28 2024-04-23T23:38:04.076 INFO:teuthology.orchestra.run.smithi077.stdout:1794 punch from 0x31548d2 to 0x315c415, (0x7b43 bytes) 2024-04-23T23:38:04.083 INFO:teuthology.orchestra.run.smithi077.stdout:1795 write 0xda61da9 thru 0xda6ef01 (0xd159 bytes) 2024-04-23T23:38:04.091 INFO:teuthology.orchestra.run.smithi077.stdout:1796 trunc from 0xda6ef02 to 0x9707411 2024-04-23T23:38:04.094 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:04.094 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:04.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:04.110 INFO:teuthology.orchestra.run.smithi077.stdout:1798 write 0xe180066 thru 0xe184ef4 (0x4e8f bytes) 2024-04-23T23:38:04.112 INFO:teuthology.orchestra.run.smithi077.stdout:1799 read 0xdb14c55 thru 0xdb1886a (0x3c16 bytes) 2024-04-23T23:38:04.113 INFO:teuthology.orchestra.run.smithi077.stdout:1803 write 0xcf598c1 thru 0xcf59de9 (0x529 bytes) 2024-04-23T23:38:04.115 INFO:teuthology.orchestra.run.smithi077.stdout:1804 writesame 0x15973b2 thru 0x15a47f1 data_size 0x60(0xd440 bytes) 2024-04-23T23:38:04.118 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.118 INFO:teuthology.orchestra.run.smithi077.stdout:1807 read 0x20cf293 thru 0x20dd926 (0xe694 bytes) 2024-04-23T23:38:04.118 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.119 INFO:teuthology.orchestra.run.smithi077.stdout:1811 trunc from 0xe184ef5 to 0xda99ed4 2024-04-23T23:38:04.127 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:04.139+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:04.127 INFO:teuthology.orchestra.run.smithi077.stdout:1812 punch from 0x9896beb to 0x989a46c, (0x3881 bytes) 2024-04-23T23:38:04.127 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.127 INFO:teuthology.orchestra.run.smithi077.stdout:1814 read 0x1584568 thru 0x158bf96 (0x7a2f bytes) 2024-04-23T23:38:04.128 INFO:teuthology.orchestra.run.smithi077.stdout:1816 writesame 0x185ca79 thru 0x185e0b4 data_size 0x1(0x163c bytes) 2024-04-23T23:38:04.133 INFO:teuthology.orchestra.run.smithi077.stdout:1817 writesame 0x2a0981a thru 0x2a17768 data_size 0x1(0xdf4f bytes) 2024-04-23T23:38:04.166 INFO:teuthology.orchestra.run.smithi077.stdout:1818 write 0xddb2b07 thru 0xddc276d (0xfc67 bytes) 2024-04-23T23:38:04.173 INFO:teuthology.orchestra.run.smithi077.stdout:1820 punch from 0x5254dd0 to 0x525b24e, (0x647e bytes) 2024-04-23T23:38:04.173 INFO:teuthology.orchestra.run.smithi077.stdout:1821 punch from 0xa67b02d to 0xa683aec, (0x8abf bytes) 2024-04-23T23:38:04.173 INFO:teuthology.orchestra.run.smithi077.stdout:1822 punch from 0x511d208 to 0x511dcc6, (0xabe bytes) 2024-04-23T23:38:04.173 INFO:teuthology.orchestra.run.smithi077.stdout:1823 read 0x5b60d26 thru 0x5b6bc5a (0xaf35 bytes) 2024-04-23T23:38:04.173 INFO:teuthology.orchestra.run.smithi077.stdout:1824 writesame 0x8a85f63 thru 0x8a8c1b8 data_size 0x29(0x6256 bytes) 2024-04-23T23:38:04.176 INFO:teuthology.orchestra.run.smithi077.stdout:1825 write 0x1ed97ac thru 0x1ee5cb3 (0xc508 bytes) 2024-04-23T23:38:04.179 INFO:teuthology.orchestra.run.smithi077.stdout:1827 read 0x2c0817d thru 0x2c15b64 (0xd9e8 bytes) 2024-04-23T23:38:04.179 INFO:teuthology.orchestra.run.smithi077.stdout:1828 writesame 0x4187087 thru 0x4196b5a data_size 0x6(0xfad4 bytes) 2024-04-23T23:38:04.200 INFO:teuthology.orchestra.run.smithi077.stdout:1829 trunc from 0xddc276e to 0x2409464 2024-04-23T23:38:04.215 INFO:teuthology.orchestra.run.smithi077.stdout:1831 trunc from 0x2409464 to 0x585c315 2024-04-23T23:38:04.220 INFO:teuthology.orchestra.run.smithi077.stdout:1833 writesame 0x4bdc998 thru 0x4be1ea1 data_size 0x23(0x550a bytes) 2024-04-23T23:38:04.225 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:04.225 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:04.228 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:04.240+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:04.235 INFO:teuthology.orchestra.run.smithi077.stdout:1834 writesame 0x7f9f06c thru 0x7fa3560 data_size 0x1(0x44f5 bytes) 2024-04-23T23:38:04.236 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:04.243 INFO:teuthology.orchestra.run.smithi077.stdout:1835 trunc from 0x7fa3561 to 0xec29dbc 2024-04-23T23:38:04.248 INFO:teuthology.orchestra.run.smithi077.stdout:1836 write 0x3d047c1 thru 0x3d140f8 (0xf938 bytes) 2024-04-23T23:38:04.251 INFO:teuthology.orchestra.run.smithi077.stdout:1838 read 0xe249264 thru 0xe254e99 (0xbc36 bytes) 2024-04-23T23:38:04.251 INFO:teuthology.orchestra.run.smithi077.stdout:1840 writesame 0x18d615a thru 0x18dc85c data_size 0x1(0x6703 bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1841 punch from 0x40321fd to 0x4032eda, (0xcdd bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1843 read 0x6a01944 thru 0x6a04390 (0x2a4d bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1844 read 0xd3b5f71 thru 0xd3be7d7 (0x8867 bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1845 read 0x799d520 thru 0x79aa8bf (0xd3a0 bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1846 read 0x221bc0b thru 0x2221db8 (0x61ae bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1848 read 0x1331d58 thru 0x1340373 (0xe61c bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1849 punch from 0x16dd6e4 to 0x16e1ce3, (0x45ff bytes) 2024-04-23T23:38:04.263 INFO:teuthology.orchestra.run.smithi077.stdout:1850 write 0x4344bee thru 0x434e7c2 (0x9bd5 bytes) 2024-04-23T23:38:04.265 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.272 INFO:teuthology.orchestra.run.smithi077.stdout:1853 trunc from 0xec29dbc to 0x94b38ea 2024-04-23T23:38:04.277 INFO:teuthology.orchestra.run.smithi077.stdout:1856 read 0x5ed6fa3 thru 0x5ee15e3 (0xa641 bytes) 2024-04-23T23:38:04.277 INFO:teuthology.orchestra.run.smithi077.stdout:1857 write 0x57e1984 thru 0x57e8920 (0x6f9d bytes) 2024-04-23T23:38:04.280 INFO:teuthology.orchestra.run.smithi077.stdout:1858 read 0x576a04a thru 0x5773a52 (0x9a09 bytes) 2024-04-23T23:38:04.280 INFO:teuthology.orchestra.run.smithi077.stdout:1860 read 0x86e6bbe thru 0x86eda51 (0x6e94 bytes) 2024-04-23T23:38:04.280 INFO:teuthology.orchestra.run.smithi077.stdout:1861 punch from 0x132241 to 0x1419b3, (0xf772 bytes) 2024-04-23T23:38:04.280 INFO:teuthology.orchestra.run.smithi077.stdout:1862 read 0x11c3e60 thru 0x11d0009 (0xc1aa bytes) 2024-04-23T23:38:04.280 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.280 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.281 INFO:teuthology.orchestra.run.smithi077.stdout:1865 write 0x7411c06 thru 0x74170be (0x54b9 bytes) 2024-04-23T23:38:04.292 INFO:teuthology.orchestra.run.smithi077.stdout:1867 writesame 0xcbcf69a thru 0xcbdc10e data_size 0x1(0xca75 bytes) 2024-04-23T23:38:04.292 INFO:teuthology.orchestra.run.smithi077.stdout:1868 read 0xc08ef54 thru 0xc092eba (0x3f67 bytes) 2024-04-23T23:38:04.292 INFO:teuthology.orchestra.run.smithi077.stdout:1869 write 0x6ae3966 thru 0x6aea465 (0x6b00 bytes) 2024-04-23T23:38:04.295 INFO:teuthology.orchestra.run.smithi077.stdout:1870 write 0xb49fab2 thru 0xb4a6ccc (0x721b bytes) 2024-04-23T23:38:04.298 INFO:teuthology.orchestra.run.smithi077.stdout:1873 punch from 0x37f7a27 to 0x37fd2b3, (0x588c bytes) 2024-04-23T23:38:04.298 INFO:teuthology.orchestra.run.smithi077.stdout:1874 write 0x49c558c thru 0x49d257f (0xcff4 bytes) 2024-04-23T23:38:04.302 INFO:teuthology.orchestra.run.smithi077.stdout:1876 punch from 0x36c360c to 0x36d0de2, (0xd7d6 bytes) 2024-04-23T23:38:04.302 INFO:teuthology.orchestra.run.smithi077.stdout:1878 write 0xc53f159 thru 0xc54f047 (0xfeef bytes) 2024-04-23T23:38:04.305 INFO:teuthology.orchestra.run.smithi077.stdout:1879 write 0x6293a82 thru 0x629ea43 (0xafc2 bytes) 2024-04-23T23:38:04.308 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.308 INFO:teuthology.orchestra.run.smithi077.stdout:1882 write 0x56bdaf8 thru 0x56cd150 (0xf659 bytes) 2024-04-23T23:38:04.312 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.312 INFO:teuthology.orchestra.run.smithi077.stdout:1884 write 0x332b84e thru 0x3334906 (0x90b9 bytes) 2024-04-23T23:38:04.318 INFO:teuthology.orchestra.run.smithi077.stdout:1885 trunc from 0xcbdc10f to 0x9dcae3f 2024-04-23T23:38:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:1886 read 0x348a90e thru 0x349710c (0xc7ff bytes) 2024-04-23T23:38:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:1887 read 0x8d9582f thru 0x8d984df (0x2cb1 bytes) 2024-04-23T23:38:04.327 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.328 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:04.341+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:04.335 INFO:teuthology.orchestra.run.smithi077.stdout:1889 trunc from 0x9dcae3f to 0x50c0177 2024-04-23T23:38:04.343 INFO:teuthology.orchestra.run.smithi077.stdout:1890 write 0x4df10c2 thru 0x4df2ba9 (0x1ae8 bytes) 2024-04-23T23:38:04.346 INFO:teuthology.orchestra.run.smithi077.stdout:1891 read 0x48fb9c9 thru 0x490447d (0x8ab5 bytes) 2024-04-23T23:38:04.346 INFO:teuthology.orchestra.run.smithi077.stdout:1892 read 0x47fef15 thru 0x4809f2d (0xb019 bytes) 2024-04-23T23:38:04.346 INFO:teuthology.orchestra.run.smithi077.stdout:1893 punch from 0x4b790fb to 0x4b85fec, (0xcef1 bytes) 2024-04-23T23:38:04.346 INFO:teuthology.orchestra.run.smithi077.stdout:1897 punch from 0x356a258 to 0x356d12b, (0x2ed3 bytes) 2024-04-23T23:38:04.356 INFO:teuthology.orchestra.run.smithi077.stdout:1898 write 0x851f4c7 thru 0x852accf (0xb809 bytes) 2024-04-23T23:38:04.359 INFO:teuthology.orchestra.run.smithi077.stdout:1899 punch from 0x748c74a to 0x7495d9e, (0x9654 bytes) 2024-04-23T23:38:04.359 INFO:teuthology.orchestra.run.smithi077.stdout:1900 punch from 0x2211a49 to 0x221a222, (0x87d9 bytes) 2024-04-23T23:38:04.362 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:04.362 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:04.365 INFO:teuthology.orchestra.run.smithi077.stdout:1902 write 0x8c71a02 thru 0x8c7b8fd (0x9efc bytes) 2024-04-23T23:38:04.368 INFO:teuthology.orchestra.run.smithi077.stdout:1903 write 0x34ed269 thru 0x34f33d1 (0x6169 bytes) 2024-04-23T23:38:04.371 INFO:teuthology.orchestra.run.smithi077.stdout:1905 read 0x4ddd914 thru 0x4de8e9a (0xb587 bytes) 2024-04-23T23:38:04.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:04.372 INFO:teuthology.orchestra.run.smithi077.stdout:1907 write 0x53794bd thru 0x5381d2c (0x8870 bytes) 2024-04-23T23:38:04.375 INFO:teuthology.orchestra.run.smithi077.stdout:1908 writesame 0x1a7d5c0 thru 0x1a8c9c0 data_size 0x41(0xf401 bytes) 2024-04-23T23:38:04.384 INFO:teuthology.orchestra.run.smithi077.stdout:1909 write 0x9692046 thru 0x969ca4b (0xaa06 bytes) 2024-04-23T23:38:04.387 INFO:teuthology.orchestra.run.smithi077.stdout:1910 write 0x7418e9a thru 0x741c00c (0x3173 bytes) 2024-04-23T23:38:04.390 INFO:teuthology.orchestra.run.smithi077.stdout:1911 read 0x5d19acb thru 0x5d1fe86 (0x63bc bytes) 2024-04-23T23:38:04.391 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:04.391 INFO:teuthology.orchestra.run.smithi077.stdout:1913 write 0x8d998fd thru 0x8d9f158 (0x585c bytes) 2024-04-23T23:38:04.393 INFO:teuthology.orchestra.run.smithi077.stdout:1915 write 0x6e10b2a thru 0x6e11c0c (0x10e3 bytes) 2024-04-23T23:38:04.401 INFO:teuthology.orchestra.run.smithi077.stdout:1916 trunc from 0x969ca4c to 0x5613d48 2024-04-23T23:38:04.413 INFO:teuthology.orchestra.run.smithi077.stdout:1917 trunc from 0x5613d48 to 0x4814304 2024-04-23T23:38:04.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:04.426 INFO:teuthology.orchestra.run.smithi077.stdout:1918 punch from 0x20907b5 to 0x209fd91, (0xf5dc bytes) 2024-04-23T23:38:04.426 INFO:teuthology.orchestra.run.smithi077.stdout:1919 punch from 0x1058036 to 0x105913b, (0x1105 bytes) 2024-04-23T23:38:04.426 INFO:teuthology.orchestra.run.smithi077.stdout:1920 clone 9 order 24 su 65536 sc 6 2024-04-23T23:38:04.429 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:04.442+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:04.484 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:04.484 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:04.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:04.530 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:04.543+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:04.543 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:04.544 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:04.562 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:04.562 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:04.579 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:04.579 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:04.595 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:04.596 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:04.613 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:04.614 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:04.631 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:04.644+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:04.631 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:04.632 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:04.638 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:04.638 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:04.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:04.649 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:04.649 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:04.667 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:04.667 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:04.733 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:04.745+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:04.753 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3238 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4161536~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312467533, 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029291145000000001, 2024-04-23T23:38:04.754 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3238 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452572+0000", 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452574+0000", 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9709999999999998e-06 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452582+0000", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8930000000000005e-06 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452587+0000", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3000000000000001e-06 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481755+0000", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029167226000000001 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481797+0000", 2024-04-23T23:38:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2651999999999998e-05 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481863+0000", 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5685999999999994e-05 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.758 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3252 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 49152~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312445153999999, 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029578383999999999, 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3252 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452594+0000", 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452595+0000", 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452597+0000", 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452604+0000", 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2660000000000004e-06 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452610+0000", 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8429999999999998e-06 2024-04-23T23:38:04.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.481898+0000", 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029288338000000001 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482013+0000", 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000114746 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482172+0000", 2024-04-23T23:38:04.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015978300000000001 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3253 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 278528~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312423389999999, 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029686714999999999, 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.763 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3253 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452616+0000", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452618+0000", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1210000000000001e-06 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452627+0000", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3489999999999992e-06 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452632+0000", 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1479999999999997e-06 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482187+0000", 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029555272 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482230+0000", 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2750999999999998e-05 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482303+0000", 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2669000000000005e-05 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3254 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 507904~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312400693000001, 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029953305999999999, 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.767 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3254 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452639+0000", 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452641+0000", 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1459999999999999e-06 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452647+0000", 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2620000000000004e-06 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452652+0000", 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482338+0000", 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029685554999999999 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482432+0000", 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4643999999999997e-05 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482592+0000", 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015951100000000001 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3255 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 737280~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312380582999999, 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030178470999999998, 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3255 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452659+0000", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452661+0000", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9659999999999999e-06 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452667+0000", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2639999999999997e-06 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452672+0000", 2024-04-23T23:38:04.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.848e-06 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482635+0000", 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.029962494999999999 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482709+0000", 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4445999999999998e-05 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482837+0000", 2024-04-23T23:38:04.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012805100000000001 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3256 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 966656~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312345524000001, 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030449868000000001, 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3256 2024-04-23T23:38:04.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452694+0000", 2024-04-23T23:38:04.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3900000000000004e-07 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452697+0000", 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452704+0000", 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.362e-06 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452710+0000", 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5609999999999998e-06 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482891+0000", 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030181050000000001 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.482991+0000", 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9586000000000005e-05 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483144+0000", 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015305000000000001 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3257 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1196032~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.779 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312322062, 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030595397999999999, 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3257 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452717+0000", 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452718+0000", 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452724+0000", 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452730+0000", 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5320000000000003e-06 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452738+0000", 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7579999999999992e-06 2024-04-23T23:38:04.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483178+0000", 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030439931 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483232+0000", 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3695e-05 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483313+0000", 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0858000000000004e-05 2024-04-23T23:38:04.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3258 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1425408~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312293445000002, 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030867680000000002, 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3258 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452746+0000", 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452748+0000", 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452765+0000", 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7003e-05 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452771+0000", 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483351+0000", 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030579967999999999 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483453+0000", 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010173100000000001 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483613+0000", 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016066400000000001 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3259 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1654784~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312261186000001, 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031145740000000002, 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.788 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3259 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452778+0000", 2024-04-23T23:38:04.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452779+0000", 2024-04-23T23:38:04.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:38:04.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452781+0000", 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0360000000000001e-06 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452787+0000", 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2809999999999997e-06 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452793+0000", 2024-04-23T23:38:04.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0870000000000003e-06 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483651+0000", 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.030858239999999999 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483759+0000", 2024-04-23T23:38:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107533 2024-04-23T23:38:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483924+0000", 2024-04-23T23:38:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016508199999999999 2024-04-23T23:38:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3260 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 1884160~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312238048000001, 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031422796000000003, 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3260 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452801+0000", 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452802+0000", 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.72e-07 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452804+0000", 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.979e-06 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452811+0000", 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0319999999999998e-06 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452816+0000", 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.483962+0000", 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031146258999999999 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484069+0000", 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106846 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484224+0000", 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015536799999999999 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.801 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3261 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2113536~16384] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312217946000001, 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031579572, 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.802 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3261 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452821+0000", 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452822+0000", 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452824+0000", 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8419999999999999e-06 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452829+0000", 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7089999999999999e-06 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452835+0000", 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3120000000000001e-06 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484254+0000", 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031419152999999998 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484305+0000", 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1363000000000003e-05 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484401+0000", 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5784000000000003e-05 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3262 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2342912~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312198578, 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031829887000000001, 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.806 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3262 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452841+0000", 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452843+0000", 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452852+0000", 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5189999999999992e-06 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452857+0000", 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1259999999999997e-06 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484440+0000", 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031583133999999999 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484537+0000", 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7248000000000001e-05 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484671+0000", 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013340800000000001 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.810 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3263 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2572288~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312173824999999, 2024-04-23T23:38:04.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032059593999999997, 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3263 2024-04-23T23:38:04.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.813 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:38:04.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452865+0000", 2024-04-23T23:38:04.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452866+0000", 2024-04-23T23:38:04.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:04.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452868+0000", 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1560000000000002e-06 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452875+0000", 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5209999999999999e-06 2024-04-23T23:38:04.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452879+0000", 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484704+0000", 2024-04-23T23:38:04.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031825141000000001 2024-04-23T23:38:04.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484797+0000", 2024-04-23T23:38:04.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3107000000000002e-05 2024-04-23T23:38:04.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484925+0000", 2024-04-23T23:38:04.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000127711 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3264 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 2801664~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312147001, 2024-04-23T23:38:04.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032190086, 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3264 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452892+0000", 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452893+0000", 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452895+0000", 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.367e-06 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452902+0000", 2024-04-23T23:38:04.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1919999999999999e-06 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452908+0000", 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.152e-06 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.484951+0000", 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032043673000000002 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485011+0000", 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9840999999999998e-05 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485082+0000", 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1308000000000002e-05 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3265 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3031040~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312124897, 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032433114999999998, 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3265 2024-04-23T23:38:04.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452914+0000", 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452915+0000", 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9399999999999995e-07 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452917+0000", 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0650000000000001e-06 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452923+0000", 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5010000000000001e-06 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452928+0000", 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.746e-06 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485122+0000", 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032193745000000003 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485218+0000", 2024-04-23T23:38:04.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6427000000000004e-05 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485347+0000", 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012913700000000001 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3266 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3260416~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312105080999999, 2024-04-23T23:38:04.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032550864999999998, 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3266 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452934+0000", 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452935+0000", 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452937+0000", 2024-04-23T23:38:04.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9980000000000002e-06 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452943+0000", 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0630000000000002e-06 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452947+0000", 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7079999999999996e-06 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485376+0000", 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032428750999999999 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485423+0000", 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6597999999999997e-05 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485485+0000", 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2297000000000003e-05 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.834 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3267 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3489792~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312086077, 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032811840000000002, 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.835 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3267 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452953+0000", 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452954+0000", 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452955+0000", 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.877e-06 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452962+0000", 2024-04-23T23:38:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6760000000000001e-06 2024-04-23T23:38:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452966+0000", 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3089999999999997e-06 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485525+0000", 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032558746 2024-04-23T23:38:04.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485632+0000", 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000107179 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485765+0000", 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013261600000000001 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3268 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3719168~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:38:04.841 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312062009000002, 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032909676999999998, 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3268 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452977+0000", 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452978+0000", 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452980+0000", 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2290000000000002e-06 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452987+0000", 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5869999999999998e-06 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452992+0000", 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9949999999999996e-06 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485780+0000", 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032788386000000003 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485826+0000", 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5744000000000001e-05 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485887+0000", 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1254999999999995e-05 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3269 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 3948544~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:38:04.847 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312040167999999, 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033158813000000002, 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3269 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.452999+0000", 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453000+0000", 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453007+0000", 2024-04-23T23:38:04.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2320000000000004e-06 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453015+0000", 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453020+0000", 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.485924+0000", 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032904299999999997 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486025+0000", 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101184 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486158+0000", 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000132521 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:3270 3.5 3:a710e774:::rbd_data.1194833257ef.0000000000000003:4 [read 4177920~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.312012590999998, 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033252354999999997, 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 3270 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:04.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:04.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453027+0000", 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453029+0000", 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0430000000000002e-06 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453036+0000", 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.545e-06 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.453040+0000", 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6450000000000004e-06 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486175+0000", 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033134469999999999 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486220+0000", 2024-04-23T23:38:04.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000001e-05 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.486279+0000", 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9021999999999998e-05 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:04.856 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:04.858 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:04.858 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:04.870+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:04.911 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.7 primary-affinity to 0.744478 (8487902) 2024-04-23T23:38:04.958 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:04.970+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:04.967 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:04.968 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:04.968 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:04.968 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:04.973 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone8 from 0x4814304 (overlap 0x1c37ea) to 0x8772c 2024-04-23T23:38:04.979 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:05.064 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:05.077+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:05.123 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:05.123 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:05.132 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:05.160 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:05.172+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:05.261 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:05.273+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:05.276 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14675 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 263168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.362277034, 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027949024999999999, 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.277 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14675 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926010+0000", 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926011+0000", 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.046e-06 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926014+0000", 2024-04-23T23:38:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.88e-06 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.926016+0000", 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.548e-06 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.953835+0000", 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027818315 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.953873+0000", 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8141e-05 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.953959+0000", 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5883000000000004e-05 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.281 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14769 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 436224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358252574, 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027826594999999999, 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14769 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.282 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930034+0000", 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:05.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930036+0000", 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.846e-06 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930042+0000", 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-06 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930047+0000", 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4619999999999998e-06 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957763+0000", 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027716507000000001 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957805+0000", 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1462999999999999e-05 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957861+0000", 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5973000000000001e-05 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14776 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 425984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358234596000001, 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027931536999999999, 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.286 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14776 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930052+0000", 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930054+0000", 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7889999999999999e-06 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930060+0000", 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.066e-06 2024-04-23T23:38:05.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930066+0000", 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957887+0000", 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027821452999999999 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957928+0000", 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1068000000000001e-05 2024-04-23T23:38:05.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.957983+0000", 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5381999999999999e-05 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.290 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14777 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 437248~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930072+0000", 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358214171, 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028031667, 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14777 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930072+0000", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930072+0000", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930073+0000", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930075+0000", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9230000000000001e-06 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930080+0000", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7660000000000004e-06 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930085+0000", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958008+0000", 2024-04-23T23:38:05.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.02792321 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958049+0000", 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0596000000000002e-05 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958104+0000", 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5312999999999997e-05 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.294 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14783 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 497664~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358195987, 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028133212000000001, 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14783 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:05.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930091+0000", 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930093+0000", 2024-04-23T23:38:05.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930099+0000", 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8719999999999999e-06 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930103+0000", 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8230000000000002e-06 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958129+0000", 2024-04-23T23:38:05.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028026051999999999 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958170+0000", 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0179999999999998e-05 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958224+0000", 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.298 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14792 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 498688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358176817, 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028235653999999999, 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14792 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930110+0000", 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930112+0000", 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7239999999999999e-06 2024-04-23T23:38:05.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930118+0000", 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7749999999999998e-06 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930128+0000", 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0895e-05 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958248+0000", 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028119890000000002 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958289+0000", 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1108e-05 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958345+0000", 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5886e-05 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.302 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14799 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 428032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358147807, 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028325426000000001, 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14799 2024-04-23T23:38:05.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930139+0000", 2024-04-23T23:38:05.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930142+0000", 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5330000000000001e-06 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930148+0000", 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0650000000000004e-06 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930152+0000", 2024-04-23T23:38:05.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6500000000000004e-06 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958369+0000", 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028216370000000001 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958409+0000", 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0398999999999997e-05 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958464+0000", 2024-04-23T23:38:05.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4963999999999998e-05 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14800 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 439296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930170+0000", 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358116139, 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028421986999999999, 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.307 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14800 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930170+0000", 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930170+0000", 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930171+0000", 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930173+0000", 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.306e-06 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930180+0000", 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7449999999999998e-06 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930185+0000", 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1059999999999999e-06 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958495+0000", 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028309969000000001 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958536+0000", 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0893000000000003e-05 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958592+0000", 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6484999999999999e-05 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14806 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 499712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358089768999999, 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028517022, 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14806 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930197+0000", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2900000000000003e-07 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930200+0000", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.413e-06 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930206+0000", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2369999999999997e-06 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930211+0000", 2024-04-23T23:38:05.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958618+0000", 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028406332999999999 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958658+0000", 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0488000000000003e-05 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958714+0000", 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5640000000000003e-05 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14813 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 427008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930217+0000", 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358069260000001, 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028619087000000001, 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14813 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930217+0000", 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930217+0000", 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930218+0000", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930219+0000", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.753e-06 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930225+0000", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5169999999999999e-06 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930229+0000", 2024-04-23T23:38:05.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.053e-06 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958738+0000", 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028509517000000002 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958781+0000", 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2259999999999999e-05 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958836+0000", 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5608e-05 2024-04-23T23:38:05.318 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14815 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 438272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358051721000001, 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028724113999999999, 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.319 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14815 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930235+0000", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930237+0000", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930243+0000", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7729999999999996e-06 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930247+0000", 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.561e-06 2024-04-23T23:38:05.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958862+0000", 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028614701999999999 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958904+0000", 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1791e-05 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958959+0000", 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5124999999999998e-05 2024-04-23T23:38:05.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14817 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 429056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358033727, 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028828659999999999, 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.323 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14817 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930253+0000", 2024-04-23T23:38:05.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0200000000000003e-07 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930255+0000", 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8160000000000001e-06 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930261+0000", 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6489999999999996e-06 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930265+0000", 2024-04-23T23:38:05.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5519999999999998e-06 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.958984+0000", 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028718635999999999 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959026+0000", 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2227000000000001e-05 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959081+0000", 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5377999999999997e-05 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14819 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 440320~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.358015672000001, 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028931264000000002, 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.327 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14819 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930271+0000", 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4499999999999998e-07 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930273+0000", 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.795e-06 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930279+0000", 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3430000000000001e-06 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930284+0000", 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7690000000000004e-06 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959107+0000", 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028822687 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959148+0000", 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1189000000000002e-05 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959202+0000", 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4135999999999998e-05 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.331 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14826 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 500736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357997000999999, 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029030970999999999, 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14826 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930290+0000", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930292+0000", 2024-04-23T23:38:05.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.824e-06 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930297+0000", 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6250000000000004e-06 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930302+0000", 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6090000000000003e-06 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959227+0000", 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028925036000000001 2024-04-23T23:38:05.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959267+0000", 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9733000000000001e-05 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959321+0000", 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3743999999999999e-05 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14832 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 430080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.335 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357978948, 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029135000000000001, 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14832 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930308+0000", 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930310+0000", 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.793e-06 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930315+0000", 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7169999999999996e-06 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930329+0000", 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3190000000000001e-05 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959346+0000", 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029017389000000001 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959386+0000", 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9986e-05 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959443+0000", 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6538e-05 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.339 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14834 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 441344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930335+0000", 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357951182000001, 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029235258, 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14834 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930335+0000", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930335+0000", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930336+0000", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930338+0000", 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2019999999999998e-06 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930344+0000", 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930349+0000", 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7119999999999999e-06 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959471+0000", 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029121998 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959513+0000", 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.261e-05 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959571+0000", 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7259000000000002e-05 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14839 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 501760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930354+0000", 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357932239, 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029338706999999999, 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14839 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930354+0000", 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930354+0000", 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930355+0000", 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5999999999999999e-07 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930356+0000", 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6419999999999999e-06 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930362+0000", 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7300000000000002e-06 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930367+0000", 2024-04-23T23:38:05.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5789999999999997e-06 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959597+0000", 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029230069000000001 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959637+0000", 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0318000000000003e-05 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959693+0000", 2024-04-23T23:38:05.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5909000000000003e-05 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14843 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 431104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930372+0000", 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357914312, 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029441042000000001, 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.348 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14843 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930372+0000", 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930372+0000", 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930373+0000", 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4299999999999999e-07 2024-04-23T23:38:05.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930380+0000", 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0609999999999998e-06 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930387+0000", 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1969999999999999e-06 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930392+0000", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9019999999999998e-06 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959716+0000", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029324658999999999 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959757+0000", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0397e-05 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959813+0000", 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6483000000000001e-05 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14850 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357888573, 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029534845000000001, 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14850 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930398+0000", 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930406+0000", 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.452e-06 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930412+0000", 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4500000000000001e-06 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930418+0000", 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.366e-06 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959837+0000", 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029419635 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959878+0000", 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0837999999999998e-05 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959933+0000", 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4713999999999998e-05 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14851 3.1d 3:be7e36ff:::rbd_data.1194137ed5d1.0000000000000024:5 [read 502784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.357861862, 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029625881999999999, 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.356 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14851 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930425+0000", 2024-04-23T23:38:05.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930427+0000", 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1390000000000002e-06 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930433+0000", 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9789999999999998e-06 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.930438+0000", 2024-04-23T23:38:05.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5680000000000001e-06 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959956+0000", 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029518328999999999 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.959996+0000", 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9610000000000002e-05 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.960051+0000", 2024-04-23T23:38:05.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4793999999999997e-05 2024-04-23T23:38:05.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.360 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:05.361 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:05.362 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:05.375+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:05.463 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:05.476+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:05.464 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:05.464 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:05.464 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:05.464 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:05.473 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:05.565 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:05.577+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:05.575 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:05.575 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:05.575 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:05.575 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:05.575 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:05.583 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:05.666 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:05.678+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:05.685 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:05.685 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13704 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 432128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.787628305, 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030259801999999999, 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13704 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909423+0000", 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909426+0000", 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8320000000000002e-06 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909432+0000", 2024-04-23T23:38:05.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1090000000000003e-06 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909443+0000", 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1014e-05 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939489+0000", 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030046209000000001 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939570+0000", 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1037000000000004e-05 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939682+0000", 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011209000000000001 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:05.690 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.786659805999999, 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:05.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:05.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.786625604999999, 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.695 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.699 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:05.700 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.786592015, 2024-04-23T23:38:05.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.702 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.78655448, 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.706 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:05.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:05.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.786530944000001, 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:05.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:05.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.785141727999999, 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:05.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:05.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.718 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.785113341000001, 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.722 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.785091032, 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:05.727 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784922808999999, 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:05.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:05.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784874083, 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.732 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:05.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:05.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:05.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784778888, 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:05.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784746938, 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:05.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784724638, 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.745 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:05.749 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784694441999999, 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:05.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784534677, 2024-04-23T23:38:05.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784499058, 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.758 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:05.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784399777000001, 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.762 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:05.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:05.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:05.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784370211000001, 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:05.766 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.784347787, 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:05.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.774 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:05.775 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:05.775 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:05.776 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:05.777 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:05.789+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:05.877 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:05.889+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:05.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:38:05.927 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:05.927 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:05.927 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:05.927 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:05.938 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:05.978 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:05.991+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:05.980 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-04-23T23:38:06.079 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:06.091+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:06.083 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:06.084 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:06.092 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:06.180 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:06.193+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:06.196 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 48.480276142000001, 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:38:06.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:38:06.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:38:06.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:7994 3.13 3:cbf42c78:::rbd_data.1194137ed5d1.0000000000000013:5 [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.747045980999999, 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034041705999999998, 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.203 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 7994 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:06.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461189+0000", 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5600000000000002e-07 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461190+0000", 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461193+0000", 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0860000000000002e-06 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461195+0000", 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3800000000000001e-06 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495064+0000", 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033868478 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495146+0000", 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1927000000000004e-05 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495230+0000", 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4598999999999994e-05 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8049 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 302080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746738737000001, 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024337000000002, 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8049 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2200000000000004e-07 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461500+0000", 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6739999999999999e-06 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461508+0000", 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6650000000000003e-06 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461513+0000", 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5740000000000003e-06 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495262+0000", 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033749023000000003 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495369+0000", 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010689200000000001 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000150987 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8050 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 314368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746703496999999, 2024-04-23T23:38:06.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034238880999999999, 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8050 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461534+0000", 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3929999999999998e-06 2024-04-23T23:38:06.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9460000000000001e-06 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461548+0000", 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9229999999999996e-06 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495572+0000", 2024-04-23T23:38:06.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024167000000001 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495663+0000", 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1079e-05 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495770+0000", 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010681800000000001 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8051 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 325632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746659113, 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034417270999999999, 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8051 2024-04-23T23:38:06.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461576+0000", 2024-04-23T23:38:06.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461578+0000", 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.407e-06 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461586+0000", 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0010000000000001e-06 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461592+0000", 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495803+0000", 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034211245000000001 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495880+0000", 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7002999999999994e-05 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495993+0000", 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112111 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8052 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 337920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746634594, 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034632123000000001, 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.220 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8052 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461602+0000", 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461608+0000", 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2269999999999998e-06 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461629+0000", 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0832999999999999e-05 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496041+0000", 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034411774999999999 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496129+0000", 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8263999999999994e-05 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496232+0000", 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102701 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8053 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 350208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746594014999999, 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034759724999999998, 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8053 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.225 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461641+0000", 2024-04-23T23:38:06.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461643+0000", 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5119999999999998e-06 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461663+0000", 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9483999999999998e-05 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461675+0000", 2024-04-23T23:38:06.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1989e-05 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496280+0000", 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034604677 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496329+0000", 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9072e-05 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496400+0000", 2024-04-23T23:38:06.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1486e-05 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8054 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 362496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746550042999999, 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034935358, 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8054 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461685+0000", 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461706+0000", 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1420000000000002e-05 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461717+0000", 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0563e-05 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461723+0000", 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9050000000000002e-06 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496438+0000", 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034714753000000001 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496521+0000", 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.365e-05 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496620+0000", 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8559000000000003e-05 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8055 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 373760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746490967, 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035088333999999999, 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8055 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461744+0000", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461747+0000", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5000000000000002e-06 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461771+0000", 2024-04-23T23:38:06.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4871999999999998e-05 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461783+0000", 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1762e-05 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496665+0000", 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034881844000000002 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496749+0000", 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4398000000000001e-05 2024-04-23T23:38:06.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496832+0000", 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2367999999999995e-05 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746443744, 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.237 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:06.241 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746430954000001, 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.242 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:38:06.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.243 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:38:06.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746420801999999, 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.247 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.251 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746405044999999, 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:06.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:38:06.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:38:06.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746386448999999, 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:38:06.259 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746366717000001, 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.260 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:06.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746346785, 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.264 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:06.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746314858000002, 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:38:06.268 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:38:06.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.272 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746286558000001, 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:38:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:38:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746260527, 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:38:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746239889999998, 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.281 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:38:06.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:38:06.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.285 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:06.287 INFO:teuthology.orchestra.run.smithi077.stdout:1921 trunc from 0x4814304 to 0x55aba36 2024-04-23T23:38:06.287 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xedd6b4d 2024-04-23T23:38:06.287 INFO:teuthology.orchestra.run.smithi077.stdout:1922 trunc from 0x55aba36 to 0xedd6b4d 2024-04-23T23:38:06.287 INFO:teuthology.orchestra.run.smithi077.stdout:1923 clone 10 order 24 su 2097152 sc 2 2024-04-23T23:38:06.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:06.288 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:06.299+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:06.388 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:06.400+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:06.430 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:06.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:06.430 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:06.430 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:06.439 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:06.523 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:06.535+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:06.581 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:06.581 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:06.581 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:06.581 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:06.581 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:06.590 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:06.590 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:06.601+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:06.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:06.690 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:06.702+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "MOSDPGPush(3.17 36/35 [PushOp(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head, version: 33'43, data_included: [18706554~429958,19399680~10240,19410944~10240,19422208~10240,19433472~10240,19444736~10240,19456000~10240,19467264~10240,19478528~10240,19489792~10240,19501056~10240,19512320~10240,19523584~10240,19534848~10240,19546112~10240,19557376~10240,19568640~10240,19579904~10240,19591168~10240,19602432~10240,19613696~10240,19624960~10240,19636224~10240,19647488~10240,19658752~4096,19663872~10240,19675136~10240,19686400~10240,19697664~10240,19708928~10240,19720192~10240,19731456~10240,19742720~10240,19753984~10240,19765248~10240,19776512~10240,19787776~10240,19799040~10240,19810304~10240,19821568~10240,19832832~10240,19844096~10240,19855360~10240,19866624~10240,19877888~10240,19889152~10240,19900416~10240,19911680~10240,19922944~4096,19928064~10240,19939328~10240,19950592~10240,19961856~10240,19973120~10240,19984384~10240,19995648~10240,20006912~10240,20018176~10240,20029440~10240,20040704~10240,20051968~10240,20063232~10240,20074496~6266], data_size: 1048576, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head@33'43, size: 26922905, copy_subset: [(0, 26922905)], clone_subset: {}, snapset: 0=[]:{}, object_exist: false), after_progress: ObjectRecoveryProgress(!first, data_recovered_to: 20080762, data_complete: false, omap_recovered_to: , omap_complete: true, error: false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to: 18706554, data_complete: false, omap_recovered_to: , omap_complete: true, error: false))])", 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:38:06.733 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.712841176, 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0085980770000000008, 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.031516+0000", 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032508+0000", 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0009915010000000001 2024-04-23T23:38:06.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032531+0000", 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2903000000000001e-05 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032555+0000", 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4304999999999999e-05 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032668+0000", 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113476 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.032684+0000", 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5481e-05 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:55.040114+0000", 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0074298810000000002 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:14945 3.5 3:a4c79518:::rbd_data.11943f90bac1.0000000000000008:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:57.606570+0000", 2024-04-23T23:38:06.737 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.1377870940000001, 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026714130999999999, 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 14945 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606570+0000", 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606570+0000", 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606571+0000", 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9299999999999996e-07 2024-04-23T23:38:06.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606576+0000", 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3580000000000002e-06 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606587+0000", 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0852999999999999e-05 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606592+0000", 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606638+0000", 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5732999999999997e-05 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.606692+0000", 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4187999999999997e-05 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:06.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.610996+0000", 2024-04-23T23:38:06.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0043035640000000002 2024-04-23T23:38:06.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633196+0000", 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022200606000000001 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633210+0000", 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3562e-05 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633245+0000", 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5528999999999998e-05 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633284+0000", 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8418999999999999e-05 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_repop_reply(client.4500.0:14945 3.5 e36/35 ondisk, result = 0)", 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:57.626044+0000", 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.118312822, 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0071584309999999998, 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.626044+0000", 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.626044+0000", 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.626045+0000", 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.203e-06 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.626051+0000", 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.429e-06 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.626068+0000", 2024-04-23T23:38:06.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7204e-05 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.626096+0000", 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7650000000000001e-05 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633183+0000", 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0070875740000000001 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633192+0000", 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6600000000000001e-06 2024-04-23T23:38:06.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:57.633202+0000", 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0711e-05 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:22387 3.1d 3:bf567db1:::rbd_data.119499604177.0000000000000086:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.332592+0000", 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.4117644709999997, 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0066135059999999999, 2024-04-23T23:38:06.748 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 22387 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332592+0000", 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332592+0000", 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332593+0000", 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9100000000000004e-07 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332596+0000", 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4829999999999999e-06 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332621+0000", 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4902e-05 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332630+0000", 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9830000000000002e-06 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332686+0000", 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5637999999999998e-05 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332757+0000", 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1421999999999995e-05 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 4", 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.333712+0000", 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095480300000000005 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339106+0000", 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.005393508 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339118+0000", 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.189e-05 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339164+0000", 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6356000000000001e-05 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339206+0000", 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.193e-05 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:22389 3.5 3:a4d7c0d2:::rbd_data.119499604177.0000000000000088:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.332663+0000", 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.4116941890000003, 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010480255000000001, 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.754 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 22389 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332663+0000", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332663+0000", 2024-04-23T23:38:06.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332664+0000", 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5099999999999998e-07 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332668+0000", 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9180000000000002e-06 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332677+0000", 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0509999999999997e-06 2024-04-23T23:38:06.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332682+0000", 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5280000000000003e-06 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332733+0000", 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0827e-05 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332805+0000", 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1798999999999995e-05 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.333908+0000", 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011037880000000001 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343064+0000", 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0091555439999999998 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343088+0000", 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3594000000000001e-05 2024-04-23T23:38:06.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343116+0000", 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8081000000000001e-05 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343143+0000", 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7274e-05 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:22390 3.5 3:a0f9cbc7:::rbd_data.119499604177.0000000000000089:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.759 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.332694+0000", 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.4116630780000001, 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010531352000000001, 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 22390 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332694+0000", 2024-04-23T23:38:06.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332694+0000", 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332694+0000", 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2500000000000001e-07 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332697+0000", 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9739999999999998e-06 2024-04-23T23:38:06.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332703+0000", 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7819999999999999e-06 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.332708+0000", 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2290000000000002e-06 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339104+0000", 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0063956120000000002 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339163+0000", 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9181999999999997e-05 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.339722+0000", 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00055898600000000003 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343171+0000", 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0034486759999999999 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343177+0000", 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5400000000000001e-06 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343203+0000", 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5795e-05 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.343225+0000", 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2150999999999998e-05 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:22433 3.5 3:a4d7c0d2:::rbd_data.119499604177.0000000000000088:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.379841+0000", 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3645157430000001, 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0070551399999999997, 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.765 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 22433 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379841+0000", 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379841+0000", 2024-04-23T23:38:06.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379842+0000", 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9899999999999999e-07 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379845+0000", 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.518e-06 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379855+0000", 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3500000000000003e-06 2024-04-23T23:38:06.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379862+0000", 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8000000000000001e-06 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.379910+0000", 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8878999999999997e-05 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380014+0000", 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000103887 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380107+0000", 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2479999999999995e-05 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380961+0000", 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00085405400000000003 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.386814+0000", 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0058528499999999997 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.386851+0000", 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7292999999999997e-05 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.386896+0000", 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5229999999999999e-05 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:22434 3.5 3:a0f9cbc7:::rbd_data.119499604177.0000000000000089:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.770 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.380112+0000", 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3642445939999996, 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0069192089999999999, 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 22434 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380112+0000", 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380112+0000", 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380113+0000", 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380117+0000", 2024-04-23T23:38:06.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1139999999999999e-06 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380128+0000", 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0451e-05 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380134+0000", 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8249999999999999e-06 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380459+0000", 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00032482300000000002 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380525+0000", 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6045999999999998e-05 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:06.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.380624+0000", 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8276999999999994e-05 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.381143+0000", 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00051905799999999998 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.386946+0000", 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0058037410000000003 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.386995+0000", 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8254000000000003e-05 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.387031+0000", 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6854000000000003e-05 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23072 3.16 3:6aefc62f:::rbd_data.11942420a0c9.0000000000000005:8 [read 1196032~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.727553+0000", 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.0168037920000002, 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0063001009999999998, 2024-04-23T23:38:06.776 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23072 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727553+0000", 2024-04-23T23:38:06.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727553+0000", 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727553+0000", 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727555+0000", 2024-04-23T23:38:06.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6360000000000001e-06 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727561+0000", 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5639999999999996e-06 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727565+0000", 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4730000000000002e-06 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.733406+0000", 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0058404529999999998 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.733497+0000", 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0915000000000006e-05 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.733853+0000", 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035664399999999998 2024-04-23T23:38:06.780 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23073 3.16 3:6aefc62f:::rbd_data.11942420a0c9.0000000000000005:8 [read 1245184~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.727570+0000", 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.0167865860000003, 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0065441570000000001, 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23073 2024-04-23T23:38:06.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727570+0000", 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727570+0000", 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727571+0000", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727572+0000", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7430000000000001e-06 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727578+0000", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.592e-06 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727582+0000", 2024-04-23T23:38:06.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.733892+0000", 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0063099649999999998 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.733978+0000", 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5218999999999998e-05 2024-04-23T23:38:06.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.734114+0000", 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00013691899999999999 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23074 3.16 3:6aefc62f:::rbd_data.11942420a0c9.0000000000000005:8 [read 1294336~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.727588+0000", 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.016768635, 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0067776190000000004, 2024-04-23T23:38:06.785 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23074 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727588+0000", 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727588+0000", 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727589+0000", 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727591+0000", 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9479999999999998e-06 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727597+0000", 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.55e-06 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727609+0000", 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2046e-05 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.734153+0000", 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0065440589999999996 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.734246+0000", 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2386999999999995e-05 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.734366+0000", 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000120269 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23101 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 1130496~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.727947+0000", 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.0164096410000001, 2024-04-23T23:38:06.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0074184280000000003, 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23101 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727947+0000", 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727947+0000", 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727948+0000", 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727949+0000", 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.911e-06 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727956+0000", 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6059999999999999e-06 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727961+0000", 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9649999999999999e-06 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.734093+0000", 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0061314489999999998 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.734231+0000", 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000138613 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.735366+0000", 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001134524 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23102 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 1179648~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.727968+0000", 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.0163890650000003, 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0099689440000000004, 2024-04-23T23:38:06.793 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23102 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727968+0000", 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727968+0000", 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727968+0000", 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727970+0000", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8819999999999999e-06 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727977+0000", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6379999999999998e-06 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727982+0000", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9370000000000003e-06 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.737753+0000", 2024-04-23T23:38:06.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0097712779999999996 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.737837+0000", 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4492000000000004e-05 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.737937+0000", 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9338000000000003e-05 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.797 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23103 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 1228800~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.727988+0000", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.0163687550000002, 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010152649, 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23103 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727988+0000", 2024-04-23T23:38:06.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727988+0000", 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727989+0000", 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.727995+0000", 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.46e-06 2024-04-23T23:38:06.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728002+0000", 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6309999999999997e-06 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728007+0000", 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7870000000000001e-06 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.737977+0000", 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0099704860000000006 2024-04-23T23:38:06.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.738049+0000", 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2177999999999999e-05 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.738141+0000", 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1572999999999999e-05 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23104 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 1277952~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.728855+0000", 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.01550195, 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0094915820000000001, 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23104 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728855+0000", 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728855+0000", 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728856+0000", 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1999999999999999e-07 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728859+0000", 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8480000000000003e-06 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728870+0000", 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0961999999999999e-05 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.728878+0000", 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7749999999999993e-06 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.738183+0000", 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0093044749999999996 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.738257+0000", 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4101000000000001e-05 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.738347+0000", 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9701000000000001e-05 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23226 3.c 3:33592b81:::rbd_data.119499604177.000000000000000c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576,write 409600~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.740642+0000", 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.0037151140000002, 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0079828439999999994, 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.806 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23226 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.740642+0000", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.740642+0000", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.740643+0000", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4339999999999999e-06 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.741644+0000", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001000906 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.741657+0000", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.313e-05 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.741664+0000", 2024-04-23T23:38:06.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3589999999999996e-06 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.741717+0000", 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3241000000000001e-05 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.741823+0000", 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010642299999999999 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:06.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.742008+0000", 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018485600000000001 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.744252+0000", 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022437389999999998 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.748547+0000", 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0042947799999999998 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.748589+0000", 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2565000000000003e-05 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.748625+0000", 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5410999999999997e-05 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.811 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23659 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 598016~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.793559+0000", 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.9507973849999996, 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0062062339999999997, 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23659 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793559+0000", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793559+0000", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793560+0000", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793562+0000", 2024-04-23T23:38:06.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.857e-06 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793567+0000", 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793572+0000", 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7299999999999996e-06 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.799612+0000", 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0060399199999999998 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.799681+0000", 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8769999999999994e-05 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.799766+0000", 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5086999999999994e-05 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23660 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 647168~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.793578+0000", 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.950778744, 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.006366806, 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23660 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793578+0000", 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793578+0000", 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793578+0000", 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793580+0000", 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793586+0000", 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-06 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.793590+0000", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3290000000000004e-06 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.799796+0000", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0062053560000000004 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.799863+0000", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7287999999999997e-05 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.799945+0000", 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2137000000000003e-05 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23861 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 712704~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.798136+0000", 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.9462212340000002, 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0062473370000000004, 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.820 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23861 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798136+0000", 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798136+0000", 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798136+0000", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8999999999999996e-07 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798140+0000", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7869999999999999e-06 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798149+0000", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8079999999999994e-06 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798155+0000", 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2090000000000002e-06 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.804237+0000", 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0060817420000000002 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.804288+0000", 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0803000000000001e-05 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.804383+0000", 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5297999999999995e-05 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:23862 3.c 3:3030ab61:::rbd_data.11942420a0c9.0000000000000009:8 [read 761856~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e39)", 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:01.798251+0000", 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.9461055370000002, 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0064034390000000004, 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:06.824 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 23862 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798251+0000", 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798251+0000", 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798252+0000", 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8199999999999999e-07 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798259+0000", 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1670000000000002e-06 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798285+0000", 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6296e-05 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:06.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.798292+0000", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9920000000000001e-06 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.804460+0000", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0061679830000000001 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.804547+0000", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6206999999999996e-05 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:01.804655+0000", 2024-04-23T23:38:06.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000108112 2024-04-23T23:38:06.829 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.829 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.829 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.829 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:06.829 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:06.829 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:06.830 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:06.831 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:06.831 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:06.831 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:06.842+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:06.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:06.834 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:06.834 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:06.850 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:06.850 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:06.868 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:06.885 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:06.903 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:06.922 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:06.922 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:06.922 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:38:06.930 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:06.943+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:06.942 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:06.943 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:06.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:06.995 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone9 2024-04-23T23:38:07.032 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:07.045+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:07.105 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.105 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:07.132 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:07.145+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:07.181 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-04-23T23:38:07.192 INFO:teuthology.orchestra.run.smithi077.stdout:1924 trunc from 0xedd6b4d to 0x88aa410 2024-04-23T23:38:07.213 INFO:teuthology.orchestra.run.smithi077.stdout:1925 trunc from 0x88aa410 to 0xf0b7e0 2024-04-23T23:38:07.232 INFO:teuthology.orchestra.run.smithi077.stdout:1927 trunc from 0xf0b7e0 to 0xc78135 2024-04-23T23:38:07.233 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:07.245+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:07.242 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.243 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.244 INFO:teuthology.orchestra.run.smithi077.stdout:1928 writesame 0x1fafcef thru 0x1fb9425 data_size 0x1(0x9737 bytes) 2024-04-23T23:38:07.245 INFO:teuthology.orchestra.run.smithi077.stdout:1931 punch from 0x1bb7f52 to 0x1bc7036, (0xf0e4 bytes) 2024-04-23T23:38:07.245 INFO:teuthology.orchestra.run.smithi077.stdout:1932 punch from 0x19813e1 to 0x198976f, (0x838e bytes) 2024-04-23T23:38:07.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:07.263 INFO:teuthology.orchestra.run.smithi077.stdout:1933 write 0xc7c78c3 thru 0xc7d19a8 (0xa0e6 bytes) 2024-04-23T23:38:07.266 INFO:teuthology.orchestra.run.smithi077.stdout:1934 write 0x89cfd02 thru 0x89d813f (0x843e bytes) 2024-04-23T23:38:07.270 INFO:teuthology.orchestra.run.smithi077.stdout:1935 punch from 0x42e0016 to 0x42e0636, (0x620 bytes) 2024-04-23T23:38:07.270 INFO:teuthology.orchestra.run.smithi077.stdout:1936 trunc from 0xc7d19a9 to 0xc184538 2024-04-23T23:38:07.279 INFO:teuthology.orchestra.run.smithi077.stdout:1939 writesame 0xbbee6f3 thru 0xbbf329b data_size 0x1(0x4ba9 bytes) 2024-04-23T23:38:07.290 INFO:teuthology.orchestra.run.smithi077.stdout:1941 writesame 0x7d248f8 thru 0x7d334b5 data_size 0x55(0xebbe bytes) 2024-04-23T23:38:07.294 INFO:teuthology.orchestra.run.smithi077.stdout:1942 read 0x7af290f thru 0x7af2c04 (0x2f6 bytes) 2024-04-23T23:38:07.294 INFO:teuthology.orchestra.run.smithi077.stdout:1943 write 0x5674a82 thru 0x568250a (0xda89 bytes) 2024-04-23T23:38:07.296 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:07.296 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:07.296 INFO:teuthology.orchestra.run.smithi077.stdout:1947 write 0x48085a4 thru 0x480c2e2 (0x3d3f bytes) 2024-04-23T23:38:07.299 INFO:teuthology.orchestra.run.smithi077.stdout:1948 write 0x6d008c4 thru 0x6d10587 (0xfcc4 bytes) 2024-04-23T23:38:07.300 INFO:teuthology.orchestra.run.smithi077.stdout:1950 read 0xc10a800 thru 0xc115376 (0xab77 bytes) 2024-04-23T23:38:07.301 INFO:teuthology.orchestra.run.smithi077.stdout:1951 read 0xa0a3a92 thru 0xa0b120d (0xd77c bytes) 2024-04-23T23:38:07.301 INFO:teuthology.orchestra.run.smithi077.stdout:1952 write 0x3e01f94 thru 0x3e0cbe2 (0xac4f bytes) 2024-04-23T23:38:07.303 INFO:teuthology.orchestra.run.smithi077.stdout:1953 write 0x9e94493 thru 0x9e9b28c (0x6dfa bytes) 2024-04-23T23:38:07.306 INFO:teuthology.orchestra.run.smithi077.stdout:1955 read 0x649065f thru 0x6497878 (0x721a bytes) 2024-04-23T23:38:07.306 INFO:teuthology.orchestra.run.smithi077.stdout:1957 read 0x6d8558b thru 0x6d942ed (0xed63 bytes) 2024-04-23T23:38:07.307 INFO:teuthology.orchestra.run.smithi077.stdout:1960 read 0xaf4d79f thru 0xaf5a5d6 (0xce38 bytes) 2024-04-23T23:38:07.307 INFO:teuthology.orchestra.run.smithi077.stdout:1961 read 0xab22b50 thru 0xab24367 (0x1818 bytes) 2024-04-23T23:38:07.312 INFO:teuthology.orchestra.run.smithi077.stdout:1962 write 0xc7503ea thru 0xc759352 (0x8f69 bytes) 2024-04-23T23:38:07.315 INFO:teuthology.orchestra.run.smithi077.stdout:1963 write 0x1471e36 thru 0x1476d0f (0x4eda bytes) 2024-04-23T23:38:07.317 INFO:teuthology.orchestra.run.smithi077.stdout:1964 writesame 0x1264a91 thru 0x1267a8a data_size 0x6(0x2ffa bytes) 2024-04-23T23:38:07.319 INFO:teuthology.orchestra.run.smithi077.stdout:1965 punch from 0x9f74b5d to 0x9f7f982, (0xae25 bytes) 2024-04-23T23:38:07.319 INFO:teuthology.orchestra.run.smithi077.stdout:1967 trunc from 0xc759353 to 0xcfe75df 2024-04-23T23:38:07.324 INFO:teuthology.orchestra.run.smithi077.stdout:1968 write 0xabf3cc4 thru 0xabf7306 (0x3643 bytes) 2024-04-23T23:38:07.325 INFO:teuthology.orchestra.run.smithi077.stdout:1970 writesame 0x8bd81ca thru 0x8be6617 data_size 0x12(0xe44e bytes) 2024-04-23T23:38:07.328 INFO:teuthology.orchestra.run.smithi077.stdout:1971 write 0x3f06989 thru 0x3f08e1a (0x2492 bytes) 2024-04-23T23:38:07.329 INFO:teuthology.orchestra.run.smithi077.stdout:1972 punch from 0x5fb004e to 0x5fbce12, (0xcdc4 bytes) 2024-04-23T23:38:07.329 INFO:teuthology.orchestra.run.smithi077.stdout:1973 writesame 0x45979c1 thru 0x4598901 data_size 0xb(0xf41 bytes) 2024-04-23T23:38:07.331 INFO:teuthology.orchestra.run.smithi077.stdout:1974 punch from 0x66ce6e9 to 0x66d87c2, (0xa0d9 bytes) 2024-04-23T23:38:07.331 INFO:teuthology.orchestra.run.smithi077.stdout:1976 punch from 0x228215d to 0x228dcb0, (0xbb53 bytes) 2024-04-23T23:38:07.331 INFO:teuthology.orchestra.run.smithi077.stdout:1977 write 0x93b9722 thru 0x93c3a64 (0xa343 bytes) 2024-04-23T23:38:07.332 INFO:teuthology.orchestra.run.smithi077.stdout:1978 write 0x731db7 thru 0x74083c (0xea86 bytes) 2024-04-23T23:38:07.333 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:07.346+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:07.347 INFO:teuthology.orchestra.run.smithi077.stdout:1979 trunc from 0xcfe75df to 0x1e5ce44 2024-04-23T23:38:07.358 INFO:teuthology.orchestra.run.smithi077.stdout:1981 read 0x1e3ac1c thru 0x1e40aa1 (0x5e86 bytes) 2024-04-23T23:38:07.358 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:07.371 INFO:teuthology.orchestra.run.smithi077.stdout:1986 write 0x7bd619d thru 0x7be3701 (0xd565 bytes) 2024-04-23T23:38:07.374 INFO:teuthology.orchestra.run.smithi077.stdout:1987 writesame 0x5812988 thru 0x5812b99 data_size 0x5(0x212 bytes) 2024-04-23T23:38:07.376 INFO:teuthology.orchestra.run.smithi077.stdout:1989 punch from 0x7492d6b to 0x74996e4, (0x6979 bytes) 2024-04-23T23:38:07.377 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.377 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:07.390 INFO:teuthology.orchestra.run.smithi077.stdout:1990 write 0xd608875 thru 0xd60aaad (0x2239 bytes) 2024-04-23T23:38:07.392 INFO:teuthology.orchestra.run.smithi077.stdout:1992 read 0x92e526b thru 0x92e9168 (0x3efe bytes) 2024-04-23T23:38:07.392 INFO:teuthology.orchestra.run.smithi077.stdout:1994 read 0x3693ad3 thru 0x3698f67 (0x5495 bytes) 2024-04-23T23:38:07.392 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:07.398 INFO:teuthology.orchestra.run.smithi077.stdout:1996 write 0xe3ca589 thru 0xe3ce700 (0x4178 bytes) 2024-04-23T23:38:07.401 INFO:teuthology.orchestra.run.smithi077.stdout:1997 writesame 0x6b7a3b5 thru 0x6b8634d data_size 0xd(0xbf99 bytes) 2024-04-23T23:38:07.403 INFO:teuthology.orchestra.run.smithi077.stdout:1998 clone 11 order 21 su 32768 sc 6 2024-04-23T23:38:07.435 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:07.447+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:07.493 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.493 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:07.543 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:07.555+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:07.636 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:07.648+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:07.737 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:07.749+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:07.794 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.794 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:07.846 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:07.858+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:07.903 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:07.903 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:07.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:07.938 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:07.950+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:07.987 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone10 from 0xe3ce701 (overlap 0xc78135) to 0x77b3ec 2024-04-23T23:38:08.039 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:08.051+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:08.041 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-04-23T23:38:08.062 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.063 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:08.163 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:08.171+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:08.224 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.224 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:08.275 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:08.287+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:08.300 INFO:teuthology.orchestra.run.smithi077.stdout:1999 read 0x30183c7 thru 0x3023b57 (0xb791 bytes) 2024-04-23T23:38:08.301 INFO:teuthology.orchestra.run.smithi077.stdout:2000 write 0xa940ddf thru 0xa948ced (0x7f0f bytes) 2024-04-23T23:38:08.309 INFO:teuthology.orchestra.run.smithi077.stdout:2001 write 0xa197a5d thru 0xa19e947 (0x6eeb bytes) 2024-04-23T23:38:08.314 INFO:teuthology.orchestra.run.smithi077.stdout:2002 write 0xc0c2674 thru 0xc0cbcde (0x966b bytes) 2024-04-23T23:38:08.342 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:08.354+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:08.342 INFO:teuthology.orchestra.run.smithi077.stdout:2003 trunc from 0xe3ce701 to 0x217fa26 2024-04-23T23:38:08.382 INFO:teuthology.orchestra.run.smithi077.stdout:2004 read 0x1062e4d thru 0x106d890 (0xaa44 bytes) 2024-04-23T23:38:08.389 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.389 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.397 INFO:teuthology.orchestra.run.smithi077.stdout:2005 write 0x9eb911d thru 0x9ec0e17 (0x7cfb bytes) 2024-04-23T23:38:08.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:08.403 INFO:teuthology.orchestra.run.smithi077.stdout:2006 write 0x7e5c17b thru 0x7e5c57a (0x400 bytes) 2024-04-23T23:38:08.406 INFO:teuthology.orchestra.run.smithi077.stdout:2007 read 0x8c4af6a thru 0x8c50aff (0x5b96 bytes) 2024-04-23T23:38:08.406 INFO:teuthology.orchestra.run.smithi077.stdout:2008 read 0x1634b92 thru 0x1643aff (0xef6e bytes) 2024-04-23T23:38:08.414 INFO:teuthology.orchestra.run.smithi077.stdout:2010 trunc from 0x9ec0e18 to 0x305c32e 2024-04-23T23:38:08.423 INFO:teuthology.orchestra.run.smithi077.stdout:2011 punch from 0x129c621 to 0x12a0968, (0x4347 bytes) 2024-04-23T23:38:08.441 INFO:teuthology.orchestra.run.smithi077.stdout:2012 write 0xdc7f950 thru 0xdc80f1c (0x15cd bytes) 2024-04-23T23:38:08.442 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:08.454+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:08.445 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.445 INFO:teuthology.orchestra.run.smithi077.stdout:2014 writesame 0x4fa9a24 thru 0x4faaa0c data_size 0x1(0xfe9 bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2015 read 0xb6f5bf9 thru 0xb6f7c26 (0x202e bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2017 punch from 0x4185dc8 to 0x418cd58, (0x6f90 bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2018 read 0x95537b8 thru 0x955717e (0x39c7 bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2019 punch from 0x5b1e4f5 to 0x5b2b575, (0xd080 bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2021 read 0x922ca60 thru 0x92370be (0xa65f bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2024 read 0x1aa01e6 thru 0x1aabc46 (0xba61 bytes) 2024-04-23T23:38:08.450 INFO:teuthology.orchestra.run.smithi077.stdout:2026 write 0xa0387bb thru 0xa03ab88 (0x23ce bytes) 2024-04-23T23:38:08.452 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.452 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.452 INFO:teuthology.orchestra.run.smithi077.stdout:2029 read 0xe2e73f thru 0xe3d905 (0xf1c7 bytes) 2024-04-23T23:38:08.453 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.453 INFO:teuthology.orchestra.run.smithi077.stdout:2035 read 0x17cb1f6 thru 0x17d8af7 (0xd902 bytes) 2024-04-23T23:38:08.453 INFO:teuthology.orchestra.run.smithi077.stdout:2036 write 0x1244bbd thru 0x124d748 (0x8b8c bytes) 2024-04-23T23:38:08.469 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.469 INFO:teuthology.orchestra.run.smithi077.stdout:2038 write 0x7278a7b thru 0x728716c (0xe6f2 bytes) 2024-04-23T23:38:08.472 INFO:teuthology.orchestra.run.smithi077.stdout:2039 write 0xcef1b07 thru 0xcefc8d4 (0xadce bytes) 2024-04-23T23:38:08.476 INFO:teuthology.orchestra.run.smithi077.stdout:2040 write 0x99804ad thru 0x998ba65 (0xb5b9 bytes) 2024-04-23T23:38:08.479 INFO:teuthology.orchestra.run.smithi077.stdout:2041 write 0x519e0b0 thru 0x51a3dfb (0x5d4c bytes) 2024-04-23T23:38:08.486 INFO:teuthology.orchestra.run.smithi077.stdout:2043 punch from 0x1d6ebc0 to 0x1d77f86, (0x93c6 bytes) 2024-04-23T23:38:08.486 INFO:teuthology.orchestra.run.smithi077.stdout:2044 write 0x40b2ebf thru 0x40b43d1 (0x1513 bytes) 2024-04-23T23:38:08.491 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.496 INFO:teuthology.orchestra.run.smithi077.stdout:2046 trunc from 0xdc80f1d to 0xa08586e 2024-04-23T23:38:08.515 INFO:teuthology.orchestra.run.smithi077.stdout:2047 writesame 0xc516728 thru 0xc518ee7 data_size 0x10(0x27c0 bytes) 2024-04-23T23:38:08.515 INFO:teuthology.orchestra.run.smithi077.stdout:2049 write 0x669af3a thru 0x66a49aa (0x9a71 bytes) 2024-04-23T23:38:08.518 INFO:teuthology.orchestra.run.smithi077.stdout:2051 write 0x3e094cb thru 0x3e148df (0xb415 bytes) 2024-04-23T23:38:08.521 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.521 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.524 INFO:teuthology.orchestra.run.smithi077.stdout:2055 write 0x8d85242 thru 0x8d8d2d0 (0x808f bytes) 2024-04-23T23:38:08.528 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.528 INFO:teuthology.orchestra.run.smithi077.stdout:2057 writesame 0x989107f thru 0x989b8d7 data_size 0x1(0xa859 bytes) 2024-04-23T23:38:08.531 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:08.545 INFO:teuthology.orchestra.run.smithi077.stdout:2058 writesame 0xb81935c thru 0xb81a093 data_size 0x2f(0xd38 bytes) 2024-04-23T23:38:08.549 INFO:teuthology.orchestra.run.smithi077.stdout:2060 read 0xb906137 thru 0xb9075ef (0x14b9 bytes) 2024-04-23T23:38:08.549 INFO:teuthology.orchestra.run.smithi077.stdout:2062 write 0x579a6cb thru 0x579b5c8 (0xefe bytes) 2024-04-23T23:38:08.551 INFO:teuthology.orchestra.run.smithi077.stdout:2064 punch from 0x2356f00 to 0x23611fd, (0xa2fd bytes) 2024-04-23T23:38:08.551 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:08.551 INFO:teuthology.orchestra.run.smithi077.stdout:2066 punch from 0x5b84cff to 0x5b8adcd, (0x60ce bytes) 2024-04-23T23:38:08.552 INFO:teuthology.orchestra.run.smithi077.stdout:2069 write 0x8d4e1ff thru 0x8d5e13d (0xff3f bytes) 2024-04-23T23:38:08.554 INFO:teuthology.orchestra.run.smithi077.stdout:2070 read 0x366f12c thru 0x367f0a0 (0xff75 bytes) 2024-04-23T23:38:08.555 INFO:teuthology.orchestra.run.smithi077.stdout:2072 read 0x55c2d0a thru 0x55cbd73 (0x906a bytes) 2024-04-23T23:38:08.555 INFO:teuthology.orchestra.run.smithi077.stdout:2073 write 0xbab44b8 thru 0xbabfd06 (0xb84f bytes) 2024-04-23T23:38:08.557 INFO:teuthology.orchestra.run.smithi077.stdout:2074 clone 12 order 22 su 65536 sc 7 2024-04-23T23:38:08.575 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:08.587+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:08.636 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.636 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.643 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:08.655+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:08.645 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:08.744 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:08.756+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:08.787 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.787 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:08.879 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:08.891+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:08.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:08.940 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:08.940 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:08.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:38:08.946 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:08.957+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:08.950 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:09.002 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone11 intact 2024-04-23T23:38:09.046 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:09.058+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:09.066 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:09.066 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:09.085 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:09.085 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:09.092 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:09.093 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:09.102 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:09.109 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:09.127 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:09.148 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:09.148 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:09.159 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-04-23T23:38:09.168 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:09.168 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:09.179 INFO:teuthology.orchestra.run.smithi077.stdout:2077 writesame 0xccd95cc thru 0xcce6a5d data_size 0x7(0xd492 bytes) 2024-04-23T23:38:09.183 INFO:teuthology.orchestra.run.smithi077.stdout:2079 punch from 0x4a95e66 to 0x4a96356, (0x4f0 bytes) 2024-04-23T23:38:09.183 INFO:teuthology.orchestra.run.smithi077.stdout:2081 writesame 0x77b692d thru 0x77b7c48 data_size 0x2(0x131c bytes) 2024-04-23T23:38:09.186 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:09.198+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:09.190 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:09.191 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:09.191 INFO:teuthology.orchestra.run.smithi077.stdout:2083 writesame 0xb849092 thru 0xb856851 data_size 0x20(0xd7c0 bytes) 2024-04-23T23:38:09.198 INFO:teuthology.orchestra.run.smithi077.stdout:2084 read 0x97bc16 thru 0x97e248 (0x2633 bytes) 2024-04-23T23:38:09.198 INFO:teuthology.orchestra.run.smithi077.stdout:2085 read 0x756487f thru 0x7566210 (0x1992 bytes) 2024-04-23T23:38:09.200 INFO:teuthology.orchestra.run.smithi077.stdout:2086 trunc from 0xcce6a5e to 0xdf61a31 2024-04-23T23:38:09.205 INFO:teuthology.orchestra.run.smithi077.stdout:2087 punch from 0xc81c66b to 0xc823011, (0x69a6 bytes) 2024-04-23T23:38:09.205 INFO:teuthology.orchestra.run.smithi077.stdout:2088 read 0xcd2655a thru 0xcd35852 (0xf2f9 bytes) 2024-04-23T23:38:09.209 INFO:teuthology.orchestra.run.smithi077.stdout:2090 trunc from 0xdf61a31 to 0xa963f98 2024-04-23T23:38:09.210 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:09.210 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:09.231 INFO:teuthology.orchestra.run.smithi077.stdout:2091 read 0x3df8b33 thru 0x3e06008 (0xd4d6 bytes) 2024-04-23T23:38:09.232 INFO:teuthology.orchestra.run.smithi077.stdout:2092 trunc from 0xa963f98 to 0xba385a7 2024-04-23T23:38:09.238 INFO:teuthology.orchestra.run.smithi077.stdout:2093 read 0xb1b58e1 thru 0xb1b5af8 (0x218 bytes) 2024-04-23T23:38:09.246 INFO:teuthology.orchestra.run.smithi077.stdout:2094 write 0xe28d4ca thru 0xe29225f (0x4d96 bytes) 2024-04-23T23:38:09.248 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:09.260+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:09.250 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.250 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.250 INFO:teuthology.orchestra.run.smithi077.stdout:2097 writesame 0xe1b5588 thru 0xe1bc4fb data_size 0xe(0x6f74 bytes) 2024-04-23T23:38:09.252 INFO:teuthology.orchestra.run.smithi077.stdout:2099 punch from 0x8a3517b to 0x8a3ca14, (0x7899 bytes) 2024-04-23T23:38:09.252 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.252 INFO:teuthology.orchestra.run.smithi077.stdout:2101 write 0x5c88879 thru 0x5c8ede7 (0x656f bytes) 2024-04-23T23:38:09.260 INFO:teuthology.orchestra.run.smithi077.stdout:2102 write 0x2e3d20f thru 0x2e41f16 (0x4d08 bytes) 2024-04-23T23:38:09.261 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:09.261 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:09.261 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:09.261 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:09.261 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:09.268 INFO:teuthology.orchestra.run.smithi077.stdout:2103 write 0x4597c52 thru 0x45a73c9 (0xf778 bytes) 2024-04-23T23:38:09.273 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:09.279 INFO:teuthology.orchestra.run.smithi077.stdout:2104 punch from 0x8bc399f to 0x8bcec71, (0xb2d2 bytes) 2024-04-23T23:38:09.291 INFO:teuthology.orchestra.run.smithi077.stdout:2107 trunc from 0xe292260 to 0x4777b48 2024-04-23T23:38:09.321 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.332 INFO:teuthology.orchestra.run.smithi077.stdout:2111 write 0x6fcd254 thru 0x6fdad25 (0xdad2 bytes) 2024-04-23T23:38:09.336 INFO:teuthology.orchestra.run.smithi077.stdout:2112 write 0x21aa838 thru 0x21b0df5 (0x65be bytes) 2024-04-23T23:38:09.345 INFO:teuthology.orchestra.run.smithi077.stdout:2113 punch from 0x56c9536 to 0x56d81ed, (0xecb7 bytes) 2024-04-23T23:38:09.347 INFO:teuthology.orchestra.run.smithi077.stdout:2114 trunc from 0x6fdad26 to 0x91eb62e 2024-04-23T23:38:09.349 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:09.362+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:09.353 INFO:teuthology.orchestra.run.smithi077.stdout:2115 read 0x7e17e50 thru 0x7e18639 (0x7ea bytes) 2024-04-23T23:38:09.353 INFO:teuthology.orchestra.run.smithi077.stdout:2117 read 0x4aee270 thru 0x4aef0b0 (0xe41 bytes) 2024-04-23T23:38:09.353 INFO:teuthology.orchestra.run.smithi077.stdout:2120 read 0x8075d4e thru 0x807ad65 (0x5018 bytes) 2024-04-23T23:38:09.353 INFO:teuthology.orchestra.run.smithi077.stdout:2121 read 0x2d95e4f thru 0x2d98479 (0x262b bytes) 2024-04-23T23:38:09.353 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.355 INFO:teuthology.orchestra.run.smithi077.stdout:2123 trunc from 0x91eb62e to 0x6e4e68d 2024-04-23T23:38:09.373 INFO:teuthology.orchestra.run.smithi077.stdout:2125 write 0x92678f0 thru 0x92686c8 (0xdd9 bytes) 2024-04-23T23:38:09.380 INFO:teuthology.orchestra.run.smithi077.stdout:2127 trunc from 0x92686c9 to 0x6784636 2024-04-23T23:38:09.390 INFO:teuthology.orchestra.run.smithi077.stdout:2128 punch from 0x2ce4f1e to 0x2cf1b59, (0xcc3b bytes) 2024-04-23T23:38:09.400 INFO:teuthology.orchestra.run.smithi077.stdout:2129 write 0xa8102fc thru 0xa8104b5 (0x1ba bytes) 2024-04-23T23:38:09.404 INFO:teuthology.orchestra.run.smithi077.stdout:2130 trunc from 0xa8104b6 to 0x993e664 2024-04-23T23:38:09.412 INFO:teuthology.orchestra.run.smithi077.stdout:2132 write 0x8d9dbc thru 0x8e49e6 (0xac2b bytes) 2024-04-23T23:38:09.432 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13704 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 432128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.533707456999998, 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030259801999999999, 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.433 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13704 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909423+0000", 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909426+0000", 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8320000000000002e-06 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909432+0000", 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1090000000000003e-06 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909443+0000", 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1014e-05 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939489+0000", 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030046209000000001 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939570+0000", 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1037000000000004e-05 2024-04-23T23:38:09.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939682+0000", 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011209000000000001 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.532738957999999, 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.437 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.441 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.532704757000001, 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.445 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.532671167, 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:09.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.532633632, 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.450 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:09.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:09.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:09.454 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.532610095999999, 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:09.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:09.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.458 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.531220879999999, 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.459 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.531192492999999, 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.463 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:09.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.531170184, 2024-04-23T23:38:09.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:09.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:09.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.531001961000001, 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:09.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:09.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530953234999998, 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:09.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:09.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:09.480 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530858039999998, 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:09.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.484 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530826090000001, 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:09.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:09.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.53080379, 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.489 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.493 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530773593999999, 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.497 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530613829, 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.498 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:09.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530578210000002, 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:09.502 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:09.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:09.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530478929000001, 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:09.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530449362999999, 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:09.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:09.515 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 16.530426939000002, 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:09.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.519 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.520 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.520 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.520 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.520 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:09.522 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2133 write 0xa530139 thru 0xa53d7b3 (0xd67b bytes) 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2134 read 0x11a9a23 thru 0x11accac (0x328a bytes) 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2136 punch from 0x198c825 to 0x199c03d, (0xf818 bytes) 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2138 write 0x4e0888c thru 0x4e1534c (0xcac1 bytes) 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2140 punch from 0x770375 to 0x778ea1, (0x8b2c bytes) 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2142 trunc from 0xa53d7b4 to 0xe99f4fc 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2143 read 0x9d001ba thru 0x9d04dcc (0x4c13 bytes) 2024-04-23T23:38:09.523 INFO:teuthology.orchestra.run.smithi077.stdout:2144 write 0x14ac4a9 thru 0x14b5222 (0x8d7a bytes) 2024-04-23T23:38:09.524 INFO:teuthology.orchestra.run.smithi077.stdout:2147 read 0xd238156 thru 0xd2470bc (0xef67 bytes) 2024-04-23T23:38:09.524 INFO:teuthology.orchestra.run.smithi077.stdout:2149 trunc from 0xe99f4fc to 0x4f5466f 2024-04-23T23:38:09.524 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:09.524 INFO:teuthology.orchestra.run.smithi077.stdout:2151 clone 13 order 24 su 8388608 sc 15 2024-04-23T23:38:09.524 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:09.533+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:09.623 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:09.634+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:09.626 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:09.626 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:09.626 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:09.627 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:09.635 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:09.724 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:09.736+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:09.737 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:09.737 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:09.745 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:09.825 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:09.837+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:09.848 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:09.848 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 52.131724548999998, 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:09.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:38:09.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:38:09.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:7994 3.13 3:cbf42c78:::rbd_data.1194137ed5d1.0000000000000013:5 [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.398494388, 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034041705999999998, 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 7994 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461189+0000", 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5600000000000002e-07 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461190+0000", 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461193+0000", 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0860000000000002e-06 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461195+0000", 2024-04-23T23:38:09.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3800000000000001e-06 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495064+0000", 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033868478 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495146+0000", 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1927000000000004e-05 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495230+0000", 2024-04-23T23:38:09.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4598999999999994e-05 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8049 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 302080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.398187144000001, 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024337000000002, 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8049 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2200000000000004e-07 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461500+0000", 2024-04-23T23:38:09.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6739999999999999e-06 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461508+0000", 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6650000000000003e-06 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461513+0000", 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5740000000000003e-06 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495262+0000", 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033749023000000003 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495369+0000", 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010689200000000001 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000150987 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.864 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8050 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 314368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.398151903999999, 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034238880999999999, 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8050 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.865 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461534+0000", 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3929999999999998e-06 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9460000000000001e-06 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461548+0000", 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9229999999999996e-06 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495572+0000", 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024167000000001 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495663+0000", 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1079e-05 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495770+0000", 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010681800000000001 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8051 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 325632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.39810752, 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034417270999999999, 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.869 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8051 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461576+0000", 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461578+0000", 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.407e-06 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461586+0000", 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0010000000000001e-06 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461592+0000", 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495803+0000", 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034211245000000001 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495880+0000", 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7002999999999994e-05 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495993+0000", 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112111 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8052 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 337920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:09.873 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.398083001, 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034632123000000001, 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8052 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461602+0000", 2024-04-23T23:38:09.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461608+0000", 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2269999999999998e-06 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461629+0000", 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0832999999999999e-05 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496041+0000", 2024-04-23T23:38:09.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034411774999999999 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496129+0000", 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8263999999999994e-05 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496232+0000", 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102701 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.877 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8053 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 350208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.398042422, 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034759724999999998, 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.878 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8053 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461641+0000", 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461643+0000", 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5119999999999998e-06 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461663+0000", 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9483999999999998e-05 2024-04-23T23:38:09.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461675+0000", 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1989e-05 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496280+0000", 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034604677 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496329+0000", 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9072e-05 2024-04-23T23:38:09.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496400+0000", 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1486e-05 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8054 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 362496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397998449999999, 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034935358, 2024-04-23T23:38:09.882 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8054 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461685+0000", 2024-04-23T23:38:09.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461706+0000", 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1420000000000002e-05 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461717+0000", 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0563e-05 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461723+0000", 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9050000000000002e-06 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496438+0000", 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034714753000000001 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496521+0000", 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.365e-05 2024-04-23T23:38:09.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496620+0000", 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8559000000000003e-05 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8055 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 373760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397939374, 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035088333999999999, 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.887 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8055 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461744+0000", 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461747+0000", 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5000000000000002e-06 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461771+0000", 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4871999999999998e-05 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461783+0000", 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1762e-05 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496665+0000", 2024-04-23T23:38:09.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034881844000000002 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496749+0000", 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4398000000000001e-05 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496832+0000", 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2367999999999995e-05 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397892151000001, 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:38:09.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:38:09.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397879361000001, 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.896 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397869209, 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:38:09.900 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:38:09.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:38:09.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:38:09.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:38:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:38:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:38:09.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:38:09.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.908 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397853452, 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:09.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:38:09.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.914 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397834855999999, 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:09.918 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397815124000001, 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:38:09.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:38:09.922 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397795192, 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.923 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:38:09.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397763264999998, 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.927 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397734965000001, 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.931 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:38:09.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.935 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397708934000001, 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:38:09.939 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.397688296999998, 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:38:09.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:09.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:09.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:09.944 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:09.944 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:09.944 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:09.945 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-04-23T23:38:09.945 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-23T23:38:09.945 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-23T23:38:09.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-04-23T23:38:09.946 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:38:09.947 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:09.947 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:09.957+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:10.006 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone12 2024-04-23T23:38:10.046 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:10.058+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:10.071 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-23T23:38:10.071 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:10.118 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:10.119 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:10.119 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:10.119 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:10.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:10.146 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:10.158+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:10.178 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-04-23T23:38:10.247 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:10.259+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:10.290 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:10.290 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:10.290 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:10.290 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:10.290 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:10.299 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:10.348 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:10.360+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:10.402 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:10.402 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:10.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16796509900000001, 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.403 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.406 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16794266599999999, 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.407 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:10.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:10.411 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.167921562, 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:10.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16790127899999999, 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.416 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:10.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.420 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16787971099999999, 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:10.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16786211300000001, 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.425 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:10.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:10.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:10.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16784153900000001, 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:10.429 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:10.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.1678124, 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.434 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.167791725, 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:10.442 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16776892500000001, 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:10.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:10.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166752504, 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:10.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:10.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.450 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16673284899999999, 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:10.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:10.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:10.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:10.454 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166693754, 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:10.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:10.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:10.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16667396300000001, 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.459 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:10.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166655364, 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:10.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166619036, 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:10.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16443707399999999, 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16442698, 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.476 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:10.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:10.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.164411208, 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.480 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:10.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.484 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16440106400000001, 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:10.485 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:10.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:10.489 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:10.490 INFO:teuthology.orchestra.run.smithi077.stdout:2152 write 0xc3d31e5 thru 0xc3da25c (0x7078 bytes) 2024-04-23T23:38:10.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:10.491 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:10.502+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:10.492 INFO:teuthology.orchestra.run.smithi077.stdout:2154 trunc from 0xc3da25d to 0x330141f 2024-04-23T23:38:10.544 INFO:teuthology.orchestra.run.smithi077.stdout:2156 read 0x2bdd88 thru 0x2c8a83 (0xacfc bytes) 2024-04-23T23:38:10.544 INFO:teuthology.orchestra.run.smithi077.stdout:2157 writesame 0x1977257 thru 0x1986c8d data_size 0x17(0xfa37 bytes) 2024-04-23T23:38:10.546 INFO:teuthology.orchestra.run.smithi077.stdout:2159 read 0x3143090 thru 0x31493d6 (0x6347 bytes) 2024-04-23T23:38:10.546 INFO:teuthology.orchestra.run.smithi077.stdout:2160 punch from 0x2d7fc55 to 0x2d8f1aa, (0xf555 bytes) 2024-04-23T23:38:10.546 INFO:teuthology.orchestra.run.smithi077.stdout:2161 read 0x23e2b60 thru 0x23e669d (0x3b3e bytes) 2024-04-23T23:38:10.547 INFO:teuthology.orchestra.run.smithi077.stdout:2162 read 0x878cc8 thru 0x8881df (0xf518 bytes) 2024-04-23T23:38:10.553 INFO:teuthology.orchestra.run.smithi077.stdout:2163 trunc from 0x330141f to 0x8495a2b 2024-04-23T23:38:10.559 INFO:teuthology.orchestra.run.smithi077.stdout:2164 writesame 0x12eeb72 thru 0x12fe314 data_size 0x1f(0xf7a3 bytes) 2024-04-23T23:38:10.566 INFO:teuthology.orchestra.run.smithi077.stdout:2165 trunc from 0x8495a2b to 0x446edf0 2024-04-23T23:38:10.584 INFO:teuthology.orchestra.run.smithi077.stdout:2166 write 0x8b7c25e thru 0x8b88b3e (0xc8e1 bytes) 2024-04-23T23:38:10.588 INFO:teuthology.orchestra.run.smithi077.stdout:2167 write 0x38fda29 thru 0x3904734 (0x6d0c bytes) 2024-04-23T23:38:10.591 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:10.603+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:10.595 INFO:teuthology.orchestra.run.smithi077.stdout:2168 read 0x4180d61 thru 0x4188a40 (0x7ce0 bytes) 2024-04-23T23:38:10.596 INFO:teuthology.orchestra.run.smithi077.stdout:2169 write 0x24fb260 thru 0x24fb543 (0x2e4 bytes) 2024-04-23T23:38:10.597 INFO:teuthology.orchestra.run.smithi077.stdout:2170 clone 14 order 23 su 524288 sc 10 2024-04-23T23:38:10.610 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:10.610 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:10.610 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:10.610 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:10.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:10.692 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:10.704+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:10.722 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:10.723 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:10.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:10.793 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:10.805+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.835 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737260847000002, 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:10.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:10.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.839 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737247201999999, 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.840 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:10.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:10.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:10.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737234151999999, 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737223133000001, 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:10.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737214057999999, 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.852 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:10.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737202113999999, 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:10.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:10.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:10.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:10.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.737193003000002, 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:10.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:10.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.735547630999999, 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:10.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.735535381999998, 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:10.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:10.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731356788999999, 2024-04-23T23:38:10.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731345007000002, 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.876 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:10.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:10.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731334938, 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.883 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731323279000001, 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.884 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.887 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731313959000001, 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:10.891 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731303446999998, 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:10.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731294006999999, 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:10.895 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:10.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731098914, 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.899 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:10.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731077881000001, 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:10.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:10.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 29.731063990999999, 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:10.910 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.127907486000002, 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:10.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:10.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:10.915 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:10.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:10.917 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:10.929+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:11.001 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone13 from 0x8b88b3f (overlap 0x330141f) to 0x519b9c 2024-04-23T23:38:11.017 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:11.029+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:11.062 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-04-23T23:38:11.067 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:11.067 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:11.067 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:11.068 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:11.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:11.119 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:11.130+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:11.170 INFO:teuthology.orchestra.run.smithi077.stdout:2171 trunc from 0x8b88b3f to 0x4c43695 2024-04-23T23:38:11.218 INFO:teuthology.orchestra.run.smithi077.stdout:2172 write 0xab5278f thru 0xab5a0bf (0x7931 bytes) 2024-04-23T23:38:11.219 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:11.231+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:11.221 INFO:teuthology.orchestra.run.smithi077.stdout:2173 write 0x31189f2 thru 0x312390d (0xaf1c bytes) 2024-04-23T23:38:11.223 INFO:teuthology.orchestra.run.smithi077.stdout:2174 read 0x6aff1f4 thru 0x6b06571 (0x737e bytes) 2024-04-23T23:38:11.224 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.224 INFO:teuthology.orchestra.run.smithi077.stdout:2176 punch from 0x6ce9a56 to 0x6ceaf9f, (0x1549 bytes) 2024-04-23T23:38:11.224 INFO:teuthology.orchestra.run.smithi077.stdout:2177 trunc from 0xab5a0c0 to 0xab6fb52 2024-04-23T23:38:11.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:11.230 INFO:teuthology.orchestra.run.smithi077.stdout:2178 trunc from 0xab6fb52 to 0x9787e60 2024-04-23T23:38:11.239 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:11.240 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:11.240 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:11.240 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:11.240 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:11.240 INFO:teuthology.orchestra.run.smithi077.stdout:2179 writesame 0x7ca45cf thru 0x7ca4801 data_size 0x1(0x233 bytes) 2024-04-23T23:38:11.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:11.255 INFO:teuthology.orchestra.run.smithi077.stdout:2180 writesame 0xdfe59ef thru 0xdfed576 data_size 0x3b(0x7b88 bytes) 2024-04-23T23:38:11.257 INFO:teuthology.orchestra.run.smithi077.stdout:2181 trunc from 0xdfed577 to 0xec96abc 2024-04-23T23:38:11.260 INFO:teuthology.orchestra.run.smithi077.stdout:2183 read 0x2e5add5 thru 0x2e5f663 (0x488f bytes) 2024-04-23T23:38:11.277 INFO:teuthology.orchestra.run.smithi077.stdout:2186 trunc from 0xec96abc to 0x1cd53a2 2024-04-23T23:38:11.320 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:11.331+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:11.323 INFO:teuthology.orchestra.run.smithi077.stdout:2187 write 0xa3e68a4 thru 0xa3eb648 (0x4da5 bytes) 2024-04-23T23:38:11.326 INFO:teuthology.orchestra.run.smithi077.stdout:2189 read 0x5ae3f57 thru 0x5ae674c (0x27f6 bytes) 2024-04-23T23:38:11.334 INFO:teuthology.orchestra.run.smithi077.stdout:2190 writesame 0xbb97e6c thru 0xbba658e data_size 0x7(0xe723 bytes) 2024-04-23T23:38:11.334 INFO:teuthology.orchestra.run.smithi077.stdout:2192 writesame 0x1288b9b thru 0x1294114 data_size 0x59(0xb57a bytes) 2024-04-23T23:38:11.336 INFO:teuthology.orchestra.run.smithi077.stdout:2194 punch from 0x583bcb4 to 0x5846b30, (0xae7c bytes) 2024-04-23T23:38:11.336 INFO:teuthology.orchestra.run.smithi077.stdout:2195 write 0xa892fe4 thru 0xa8a1474 (0xe491 bytes) 2024-04-23T23:38:11.340 INFO:teuthology.orchestra.run.smithi077.stdout:2196 trunc from 0xbba658f to 0xe419515 2024-04-23T23:38:11.346 INFO:teuthology.orchestra.run.smithi077.stdout:2197 read 0x432250f thru 0x4330c74 (0xe766 bytes) 2024-04-23T23:38:11.346 INFO:teuthology.orchestra.run.smithi077.stdout:2198 write 0xad7ee36 thru 0xad7fe4f (0x101a bytes) 2024-04-23T23:38:11.352 INFO:teuthology.orchestra.run.smithi077.stdout:2204 trunc from 0xe419515 to 0xc3fa803 2024-04-23T23:38:11.359 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.359 INFO:teuthology.orchestra.run.smithi077.stdout:2207 read 0x89b11a1 thru 0x89be980 (0xd7e0 bytes) 2024-04-23T23:38:11.359 INFO:teuthology.orchestra.run.smithi077.stdout:2208 read 0x13ae2bc thru 0x13b171d (0x3462 bytes) 2024-04-23T23:38:11.359 INFO:teuthology.orchestra.run.smithi077.stdout:2209 read 0x621f788 thru 0x62201e6 (0xa5f bytes) 2024-04-23T23:38:11.359 INFO:teuthology.orchestra.run.smithi077.stdout:2210 write 0x9246720 thru 0x924ab25 (0x4406 bytes) 2024-04-23T23:38:11.362 INFO:teuthology.orchestra.run.smithi077.stdout:2211 writesame 0x2955c0f thru 0x295a9e8 data_size 0x5(0x4dda bytes) 2024-04-23T23:38:11.365 INFO:teuthology.orchestra.run.smithi077.stdout:2212 read 0x8eec7d4 thru 0x8ef6711 (0x9f3e bytes) 2024-04-23T23:38:11.365 INFO:teuthology.orchestra.run.smithi077.stdout:2213 punch from 0x6921bc2 to 0x69258a2, (0x3ce0 bytes) 2024-04-23T23:38:11.365 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:11.366 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:11.376 INFO:teuthology.orchestra.run.smithi077.stdout:2215 trunc from 0xc3fa803 to 0x41d0968 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193687598, 2024-04-23T23:38:11.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:38:11.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.382 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193658063000001, 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.383 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:38:11.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:38:11.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:38:11.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193638289999999, 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.387 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:11.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:38:11.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193620744, 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.391 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.395 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193603234000001, 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:11.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.399 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193562696000001, 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:38:11.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:38:11.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193549131000001, 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.404 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:11.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193539532999999, 2024-04-23T23:38:11.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:38:11.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193528970999999, 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.413 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:38:11.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:38:11.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:38:11.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193519653999999, 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.417 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:38:11.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193510465999999, 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.421 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.193495894000002, 2024-04-23T23:38:11.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:38:11.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:38:11.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.995308806000001, 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:11.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:11.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12738 3.19 3:981e3435:::rbd_data.11943f90bac1.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 20048663~49601] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.574334480000001, 2024-04-23T23:38:11.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014968690999999999, 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12738 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814819+0000", 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5719999999999999e-06 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815601+0000", 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00078195599999999999 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815617+0000", 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6178e-05 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815627+0000", 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6220000000000004e-06 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815716+0000", 2024-04-23T23:38:11.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9190999999999994e-05 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815816+0000", 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010035999999999999 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.816033+0000", 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000216329 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.827645+0000", 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011612618999999999 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829716+0000", 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020706159999999999 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829753+0000", 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6786000000000003e-05 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829786+0000", 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3461999999999999e-05 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.996658178000001, 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.441 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:11.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:11.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:11.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14891 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.85207037, 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014134285999999999, 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14891 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537083+0000", 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.17e-06 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537087+0000", 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3660000000000002e-06 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537099+0000", 2024-04-23T23:38:11.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1412e-05 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537104+0000", 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537155+0000", 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0970999999999997e-05 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537209+0000", 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3625999999999998e-05 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537282+0000", 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3201000000000006e-05 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551035+0000", 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013752861 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551108+0000", 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2977000000000003e-05 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551165+0000", 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7639000000000002e-05 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551216+0000", 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0634999999999999e-05 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14892 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.852018777, 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014338742999999999, 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.456 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14892 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537134+0000", 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537137+0000", 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2160000000000002e-06 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537144+0000", 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.951e-06 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537149+0000", 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1830000000000002e-06 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543614+0000", 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0064648400000000003 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543717+0000", 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010273200000000001 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543873+0000", 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000155883 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551092+0000", 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072189960000000001 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551384+0000", 2024-04-23T23:38:11.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00029250700000000001 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551432+0000", 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8287e-05 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551472+0000", 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9613999999999997e-05 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32774 3.8 e48/21 3:15ce7338:::rbd_data.1194db69ebd1.0000000000000003:head v 48'72, mlcod=47'70)", 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.3366540229999999, 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013654134, 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:11.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052500+0000", 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4789999999999999e-06 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054454+0000", 2024-04-23T23:38:11.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019545610000000001 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054477+0000", 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2866000000000001e-05 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054487+0000", 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.004e-05 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054560+0000", 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2541999999999998e-05 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054587+0000", 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7203e-05 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.066100+0000", 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011512777 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.066152+0000", 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2666e-05 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32786 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.304206507, 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018228132000000001, 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32786 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084948+0000", 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9920000000000002e-06 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086902+0000", 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019542050000000001 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086923+0000", 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1571999999999999e-05 2024-04-23T23:38:11.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086933+0000", 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.73e-06 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087015+0000", 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2066999999999999e-05 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087175+0000", 2024-04-23T23:38:11.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016020699999999999 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087648+0000", 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00047274399999999999 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.101505+0000", 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013856736 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103090+0000", 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015848979999999999 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103128+0000", 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8120000000000001e-05 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103174+0000", 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5861e-05 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32787 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [write 0~0] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.302191434, 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016488184999999999, 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32787 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:11.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086962+0000", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0750000000000001e-06 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086964+0000", 2024-04-23T23:38:11.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5179999999999999e-06 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086981+0000", 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7017999999999999e-05 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086985+0000", 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6679999999999999e-06 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:11.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093014+0000", 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0060293619999999999 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093120+0000", 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106131 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093311+0000", 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00019033400000000001 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:11.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103193+0000", 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098824499999999992 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103389+0000", 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000195367 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103423+0000", 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4618e-05 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:11.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103449+0000", 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5644e-05 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:11.477 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:11.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:11.479 INFO:teuthology.orchestra.run.smithi077.stdout:2216 read 0x3295adc thru 0x32a2ff8 (0xd51d bytes) 2024-04-23T23:38:11.479 INFO:teuthology.orchestra.run.smithi077.stdout:2220 read 0xd7cb61 thru 0xd8381a (0x6cba bytes) 2024-04-23T23:38:11.480 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:11.480 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:2221 punch from 0x10dfc4 to 0x10e8ea, (0x926 bytes) 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:2222 write 0x3c2c03e thru 0x3c2e055 (0x2018 bytes) 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:2223 read 0x361a2d4 thru 0x36220bb (0x7de8 bytes) 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:2225 read 0x8592e2 thru 0x85d039 (0x3d58 bytes) 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:2228 read 0x1b9df32 thru 0x1ba5a56 (0x7b25 bytes) 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:2229 trunc from 0x41d0968 to 0x689bdf7 2024-04-23T23:38:11.481 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:11.482 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:11.482 INFO:teuthology.orchestra.run.smithi077.stdout:2230 write 0x8e2f7f3 thru 0x8e3dc2a (0xe438 bytes) 2024-04-23T23:38:11.482 INFO:teuthology.orchestra.run.smithi077.stdout:2231 writesame 0xed3278a thru 0xed3be06 data_size 0x17(0x967d bytes) 2024-04-23T23:38:11.482 INFO:teuthology.orchestra.run.smithi077.stdout:2232 punch from 0x22d1c8c to 0x22df620, (0xd994 bytes) 2024-04-23T23:38:11.483 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:11.483 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:11.483 INFO:teuthology.orchestra.run.smithi077.stdout:2233 trunc from 0xed3be07 to 0x17f9a94 2024-04-23T23:38:11.483 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:11.484 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:11.484 INFO:teuthology.orchestra.run.smithi077.stdout:2234 read 0x7a8c62 thru 0x7ab441 (0x27e0 bytes) 2024-04-23T23:38:11.484 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:11.484 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:11.485 INFO:teuthology.orchestra.run.smithi077.stdout:2235 write 0x94739f9 thru 0x94839b6 (0xffbe bytes) 2024-04-23T23:38:11.485 INFO:teuthology.orchestra.run.smithi077.stdout:2236 writesame 0x670973e thru 0x6710280 data_size 0x51(0x6b43 bytes) 2024-04-23T23:38:11.485 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:11.490+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:11.485 INFO:teuthology.orchestra.run.smithi077.stdout:2238 read 0x3d2c5e2 thru 0x3d2e141 (0x1b60 bytes) 2024-04-23T23:38:11.485 INFO:teuthology.orchestra.run.smithi077.stdout:2239 write 0x4170676 thru 0x417f608 (0xef93 bytes) 2024-04-23T23:38:11.486 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:11.486 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:11.492 INFO:teuthology.orchestra.run.smithi077.stdout:2240 writesame 0xe833a45 thru 0xe833b4b data_size 0x1(0x107 bytes) 2024-04-23T23:38:11.493 INFO:teuthology.orchestra.run.smithi077.stdout:2242 read 0xdec704f thru 0xded15be (0xa570 bytes) 2024-04-23T23:38:11.493 INFO:teuthology.orchestra.run.smithi077.stdout:2243 read 0x1ee70a6 thru 0x1ef59d6 (0xe931 bytes) 2024-04-23T23:38:11.493 INFO:teuthology.orchestra.run.smithi077.stdout:2244 write 0xbe5a78e thru 0xbe679b2 (0xd225 bytes) 2024-04-23T23:38:11.496 INFO:teuthology.orchestra.run.smithi077.stdout:2246 write 0x7ba07b0 thru 0x7ba4093 (0x38e4 bytes) 2024-04-23T23:38:11.498 INFO:teuthology.orchestra.run.smithi077.stdout:2247 read 0x56f94c thru 0x57d888 (0xdf3d bytes) 2024-04-23T23:38:11.504 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:11.504 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:11.511 INFO:teuthology.orchestra.run.smithi077.stdout:2248 trunc from 0xe833b4c to 0x3ed403e 2024-04-23T23:38:11.539 INFO:teuthology.orchestra.run.smithi077.stdout:2249 writesame 0xa29d859 thru 0xa2a30e0 data_size 0x4(0x5888 bytes) 2024-04-23T23:38:11.539 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.547 INFO:teuthology.orchestra.run.smithi077.stdout:2251 write 0xcb78cfe thru 0xcb79161 (0x464 bytes) 2024-04-23T23:38:11.550 INFO:teuthology.orchestra.run.smithi077.stdout:2252 read 0x1ea442 thru 0x1f48f0 (0xa4af bytes) 2024-04-23T23:38:11.553 INFO:teuthology.orchestra.run.smithi077.stdout:2253 trunc from 0xcb79162 to 0xec9df80 2024-04-23T23:38:11.558 INFO:teuthology.orchestra.run.smithi077.stdout:2254 write 0xad9741a thru 0xad9941b (0x2002 bytes) 2024-04-23T23:38:11.561 INFO:teuthology.orchestra.run.smithi077.stdout:2255 read 0x5e0a7a7 thru 0x5e1a151 (0xf9ab bytes) 2024-04-23T23:38:11.561 INFO:teuthology.orchestra.run.smithi077.stdout:2256 write 0xa37ce0f thru 0xa38ba69 (0xec5b bytes) 2024-04-23T23:38:11.563 INFO:teuthology.orchestra.run.smithi077.stdout:2257 writesame 0x3ba2b97 thru 0x3ba4798 data_size 0xf(0x1c02 bytes) 2024-04-23T23:38:11.564 INFO:teuthology.orchestra.run.smithi077.stdout:2258 write 0x8bb0207 thru 0x8bb3683 (0x347d bytes) 2024-04-23T23:38:11.567 INFO:teuthology.orchestra.run.smithi077.stdout:2259 writesame 0xaff6047 thru 0xb002140 data_size 0x11(0xc0fa bytes) 2024-04-23T23:38:11.571 INFO:teuthology.orchestra.run.smithi077.stdout:2261 writesame 0xa6ca4b4 thru 0xa6d8084 data_size 0x1(0xdbd1 bytes) 2024-04-23T23:38:11.578 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:11.591+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:11.600 INFO:teuthology.orchestra.run.smithi077.stdout:2262 read 0x7ee00ea thru 0x7ee3b84 (0x3a9b bytes) 2024-04-23T23:38:11.600 INFO:teuthology.orchestra.run.smithi077.stdout:2265 punch from 0xb4980f4 to 0xb4a6bdb, (0xeae7 bytes) 2024-04-23T23:38:11.600 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:11.600 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:11.606 INFO:teuthology.orchestra.run.smithi077.stdout:2266 trunc from 0xec9df80 to 0xa06f422 2024-04-23T23:38:11.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:11.629 INFO:teuthology.orchestra.run.smithi077.stdout:2268 write 0x8820493 thru 0x8827213 (0x6d81 bytes) 2024-04-23T23:38:11.632 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.636 INFO:teuthology.orchestra.run.smithi077.stdout:2272 trunc from 0xa06f422 to 0xdb706b9 2024-04-23T23:38:11.642 INFO:teuthology.orchestra.run.smithi077.stdout:2273 writesame 0x50c8daa thru 0x50d62ae data_size 0x1(0xd505 bytes) 2024-04-23T23:38:11.671 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.671 INFO:teuthology.orchestra.run.smithi077.stdout:2275 write 0x80dc7d5 thru 0x80eb7fc (0xf028 bytes) 2024-04-23T23:38:11.674 INFO:teuthology.orchestra.run.smithi077.stdout:2276 write 0xc10ee69 thru 0xc11c977 (0xdb0f bytes) 2024-04-23T23:38:11.677 INFO:teuthology.orchestra.run.smithi077.stdout:2277 writesame 0x1a33b4a thru 0x1a361bf data_size 0x9(0x2676 bytes) 2024-04-23T23:38:11.679 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:11.691+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:11.685 INFO:teuthology.orchestra.run.smithi077.stdout:2279 trunc from 0xdb706b9 to 0x856911b 2024-04-23T23:38:11.702 INFO:teuthology.orchestra.run.smithi077.stdout:2280 write 0x9052743 thru 0x9053179 (0xa37 bytes) 2024-04-23T23:38:11.705 INFO:teuthology.orchestra.run.smithi077.stdout:2281 writesame 0x84887e3 thru 0x848b693 data_size 0x1(0x2eb1 bytes) 2024-04-23T23:38:11.713 INFO:teuthology.orchestra.run.smithi077.stdout:2282 read 0x82e96bd thru 0x82f512e (0xba72 bytes) 2024-04-23T23:38:11.713 INFO:teuthology.orchestra.run.smithi077.stdout:2283 read 0x18035c9 thru 0x180bc65 (0x869d bytes) 2024-04-23T23:38:11.713 INFO:teuthology.orchestra.run.smithi077.stdout:2284 write 0x4fc798e thru 0x4fd7622 (0xfc95 bytes) 2024-04-23T23:38:11.720 INFO:teuthology.orchestra.run.smithi077.stdout:2285 trunc from 0x905317a to 0xcc1144a 2024-04-23T23:38:11.725 INFO:teuthology.orchestra.run.smithi077.stdout:2286 write 0xb109307 thru 0xb119097 (0xfd91 bytes) 2024-04-23T23:38:11.733 INFO:teuthology.orchestra.run.smithi077.stdout:2287 write 0xd1b2230 thru 0xd1b5147 (0x2f18 bytes) 2024-04-23T23:38:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:2289 read 0xa0ef8cf thru 0xa0f433e (0x4a70 bytes) 2024-04-23T23:38:11.736 INFO:teuthology.orchestra.run.smithi077.stdout:2290 write 0x9db03fb thru 0x9db94f8 (0x90fe bytes) 2024-04-23T23:38:11.738 INFO:teuthology.orchestra.run.smithi077.stdout:2291 trunc from 0xd1b5148 to 0xdad3eea 2024-04-23T23:38:11.741 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:11.741 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:11.743 INFO:teuthology.orchestra.run.smithi077.stdout:2295 write 0x2fbb223 thru 0x2fc2ef8 (0x7cd6 bytes) 2024-04-23T23:38:11.744 INFO:teuthology.orchestra.run.smithi077.stdout:2297 write 0x2bc0e56 thru 0x2bca78b (0x9936 bytes) 2024-04-23T23:38:11.746 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.746 INFO:teuthology.orchestra.run.smithi077.stdout:2301 write 0x32c9f90 thru 0x32cad9a (0xe0b bytes) 2024-04-23T23:38:11.748 INFO:teuthology.orchestra.run.smithi077.stdout:2303 read 0x27c65b5 thru 0x27c7e9c (0x18e8 bytes) 2024-04-23T23:38:11.748 INFO:teuthology.orchestra.run.smithi077.stdout:2304 read 0x971e5fe thru 0x972c9df (0xe3e2 bytes) 2024-04-23T23:38:11.748 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.748 INFO:teuthology.orchestra.run.smithi077.stdout:2307 punch from 0x40117df to 0x401f83b, (0xe05c bytes) 2024-04-23T23:38:11.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:11.764 INFO:teuthology.orchestra.run.smithi077.stdout:2308 trunc from 0xdad3eea to 0x38d648 2024-04-23T23:38:11.804 INFO:teuthology.orchestra.run.smithi077.stdout:2310 write 0xbdecfdd thru 0xbdf41cd (0x71f1 bytes) 2024-04-23T23:38:11.804 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:11.816+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:11.809 INFO:teuthology.orchestra.run.smithi077.stdout:2311 read 0x4424ea6 thru 0x442ee81 (0x9fdc bytes) 2024-04-23T23:38:11.815 INFO:teuthology.orchestra.run.smithi077.stdout:2312 trunc from 0xbdf41ce to 0x71b317f 2024-04-23T23:38:11.826 INFO:teuthology.orchestra.run.smithi077.stdout:2313 write 0x23efe66 thru 0x23f9600 (0x979b bytes) 2024-04-23T23:38:11.835 INFO:teuthology.orchestra.run.smithi077.stdout:2314 write 0x9827cc1 thru 0x983469f (0xc9df bytes) 2024-04-23T23:38:11.838 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:11.847 INFO:teuthology.orchestra.run.smithi077.stdout:2316 writesame 0xc12e79f thru 0xc12ff07 data_size 0x1(0x1769 bytes) 2024-04-23T23:38:11.847 INFO:teuthology.orchestra.run.smithi077.stdout:2317 clone 15 order 18 su 131072 sc 11 2024-04-23T23:38:11.877 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:11.878 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:11.881 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:11.893+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:11.886 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:11.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:38:12.013 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:12.025+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:12.013 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone14 from 0xc12ff08 (overlap 0x38d648) to 0x5af07 2024-04-23T23:38:12.042 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.042 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:12.087 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-04-23T23:38:12.087 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:12.099+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:12.102 INFO:teuthology.orchestra.run.smithi077.stdout:2319 read 0x1a0c1a9 thru 0x1a1bf01 (0xfd59 bytes) 2024-04-23T23:38:12.103 INFO:teuthology.orchestra.run.smithi077.stdout:2320 write 0xb4a5978 thru 0xb4b26bc (0xcd45 bytes) 2024-04-23T23:38:12.109 INFO:teuthology.orchestra.run.smithi077.stdout:2321 write 0x160b43 thru 0x164f2f (0x43ed bytes) 2024-04-23T23:38:12.114 INFO:teuthology.orchestra.run.smithi077.stdout:2322 punch from 0x3137f1f to 0x3143580, (0xb661 bytes) 2024-04-23T23:38:12.120 INFO:teuthology.orchestra.run.smithi077.stdout:2323 trunc from 0xc12ff08 to 0x70f3ee3 2024-04-23T23:38:12.152 INFO:teuthology.orchestra.run.smithi077.stdout:2325 write 0xdf1c4bc thru 0xdf22b15 (0x665a bytes) 2024-04-23T23:38:12.157 INFO:teuthology.orchestra.run.smithi077.stdout:2326 clone 16 order 24 su 2097152 sc 12 2024-04-23T23:38:12.183 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:12.195+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:12.199 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.199 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:12.284 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:12.296+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.352 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:12.385 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:12.397+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:12.462 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.463 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.471 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:12.514 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:12.526+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:12.573 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.573 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:12.623 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:12.635+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:12.688 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:12.700+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:12.726 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.726 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.734 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:12.818 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:12.830+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:12.877 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:12.877 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:12.885 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:12.926 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:12.938+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:38:12.991 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:13.002+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:13.036 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:13.036 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:13.042 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone15 from 0xdf22b16 (overlap 0x70f3ee3) to 0xb4b97d 2024-04-23T23:38:13.046 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:13.130 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:13.142+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:13.192 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:13.204+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:13.227 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:13.227 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:13.239 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:13.322 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:13.334+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:13.394 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:13.406+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:13.400 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:13.401 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:13.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:13.425 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-04-23T23:38:13.428 INFO:teuthology.orchestra.run.smithi077.stdout:2327 read 0x9f5c6da thru 0x9f5ef75 (0x289c bytes) 2024-04-23T23:38:13.429 INFO:teuthology.orchestra.run.smithi077.stdout:2328 write 0x4f4d2cc thru 0x4f52846 (0x557b bytes) 2024-04-23T23:38:13.439 INFO:teuthology.orchestra.run.smithi077.stdout:2329 read 0x102a8f8 thru 0x10357a7 (0xaeb0 bytes) 2024-04-23T23:38:13.440 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:13.440 INFO:teuthology.orchestra.run.smithi077.stdout:2331 write 0xfeb052 thru 0xffa961 (0xf910 bytes) 2024-04-23T23:38:13.446 INFO:teuthology.orchestra.run.smithi077.stdout:2332 punch from 0xe0b3d6 to 0xe129c6, (0x75f0 bytes) 2024-04-23T23:38:13.460 INFO:teuthology.orchestra.run.smithi077.stdout:2333 trunc from 0xdf22b16 to 0x1ee159a 2024-04-23T23:38:13.495 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:13.506+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:13.500 INFO:teuthology.orchestra.run.smithi077.stdout:2334 read 0x98758d thru 0x9903bb (0x8e2f bytes) 2024-04-23T23:38:13.501 INFO:teuthology.orchestra.run.smithi077.stdout:2335 read 0x5555a3 thru 0x55da7f (0x84dd bytes) 2024-04-23T23:38:13.512 INFO:teuthology.orchestra.run.smithi077.stdout:2336 write 0x5bfe289 thru 0x5c0c5f5 (0xe36d bytes) 2024-04-23T23:38:13.514 INFO:teuthology.orchestra.run.smithi077.stdout:2337 read 0x20c5812 thru 0x20c7590 (0x1d7f bytes) 2024-04-23T23:38:13.514 INFO:teuthology.orchestra.run.smithi077.stdout:2338 clone 17 order 19 su 4096 sc 5 2024-04-23T23:38:13.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:13.563 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:13.564 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:13.572 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:13.614 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:13.625+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:13.641 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:13.641 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:13.658 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:13.658 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:13.674 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:13.675 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:13.691 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:13.691 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:13.696 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:13.708+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:13.708 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:13.708 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:13.715 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:13.715 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:13.723 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:13.725 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:13.725 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:13.742 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:13.742 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:13.759 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:13.760 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:13.797 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:13.809+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:13.866 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:13.867 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:13.867 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:13.867 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:13.875 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:13.918 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:13.930+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:13.980 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:13.980 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:13.980 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:13.980 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:13.980 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:13.990 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:14.031 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:14.043+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:14.038 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone16 intact 2024-04-23T23:38:14.099 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:14.111+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9063772139999999, 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9063547810000001, 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9063336770000001, 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9063133940000001, 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9062918259999999, 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.906274228, 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9062536539999999, 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9062245149999999, 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9062038399999999, 2024-04-23T23:38:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9061810399999999, 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9051646189999998, 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9051449639999998, 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9051058689999998, 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9050860780000001, 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.905067479, 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9050311510000002, 2024-04-23T23:38:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:14.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.210 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9028491889999999, 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.214 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.902839095, 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.215 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9028233229999998, 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.219 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:14.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:14.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.9028131789999998, 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:14.223 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:14.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:14.227 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:14.229 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-04-23T23:38:14.229 INFO:teuthology.orchestra.run.smithi077.stdout:2340 write 0x71b4ab thru 0x724c77 (0x97cd bytes) 2024-04-23T23:38:14.229 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:14.241+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:14.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:14.263 INFO:teuthology.orchestra.run.smithi077.stdout:2341 write 0x5d1e463 thru 0x5d1f675 (0x1213 bytes) 2024-04-23T23:38:14.276 INFO:teuthology.orchestra.run.smithi077.stdout:2342 write 0x9d42635 thru 0x9d46830 (0x41fc bytes) 2024-04-23T23:38:14.292 INFO:teuthology.orchestra.run.smithi077.stdout:2343 write 0xe027284 thru 0xe028ae5 (0x1862 bytes) 2024-04-23T23:38:14.298 INFO:teuthology.orchestra.run.smithi077.stdout:2344 read 0x1dcfe31 thru 0x1dda5e7 (0xa7b7 bytes) 2024-04-23T23:38:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:2346 punch from 0x98359f0 to 0x9841823, (0xbe33 bytes) 2024-04-23T23:38:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:2347 read 0xd8e9cd8 thru 0xd8ed925 (0x3c4e bytes) 2024-04-23T23:38:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:2350 read 0xd0fc442 thru 0xd109ccc (0xd88b bytes) 2024-04-23T23:38:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:2351 read 0x9f0bacc thru 0x9f0c51b (0xa50 bytes) 2024-04-23T23:38:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:2352 write 0xb9139b7 thru 0xb91dc9d (0xa2e7 bytes) 2024-04-23T23:38:14.308 INFO:teuthology.orchestra.run.smithi077.stdout:2353 write 0x785f4b8 thru 0x7861bc8 (0x2711 bytes) 2024-04-23T23:38:14.313 INFO:teuthology.orchestra.run.smithi077.stdout:2354 write 0x64b1708 thru 0x64bbc6e (0xa567 bytes) 2024-04-23T23:38:14.319 INFO:teuthology.orchestra.run.smithi077.stdout:2355 writesame 0xdaef06f thru 0xdaf7a64 data_size 0x1(0x89f6 bytes) 2024-04-23T23:38:14.329 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:14.341+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:14.334 INFO:teuthology.orchestra.run.smithi077.stdout:2356 write 0xedd8f48 thru 0xede1f93 (0x904c bytes) 2024-04-23T23:38:14.340 INFO:teuthology.orchestra.run.smithi077.stdout:2357 read 0x862e840 thru 0x86340fa (0x58bb bytes) 2024-04-23T23:38:14.340 INFO:teuthology.orchestra.run.smithi077.stdout:2358 writesame 0x5a45072 thru 0x5a4e011 data_size 0x30(0x8fa0 bytes) 2024-04-23T23:38:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:14.353 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:14.353 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:14.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:14.415 INFO:teuthology.orchestra.run.smithi077.stdout:2359 read 0xb81500c thru 0xb81d7b2 (0x87a7 bytes) 2024-04-23T23:38:14.415 INFO:teuthology.orchestra.run.smithi077.stdout:2361 write 0x704192e thru 0x704f4ce (0xdba1 bytes) 2024-04-23T23:38:14.425 INFO:teuthology.orchestra.run.smithi077.stdout:2362 write 0x41218ad thru 0x412db9e (0xc2f2 bytes) 2024-04-23T23:38:14.430 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:14.442+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:14.490 INFO:teuthology.orchestra.run.smithi077.stdout:2366 write 0xbbc3fa2 thru 0xbbc531c (0x137b bytes) 2024-04-23T23:38:14.496 INFO:teuthology.orchestra.run.smithi077.stdout:2367 read 0x656c0da thru 0x65724e6 (0x640d bytes) 2024-04-23T23:38:14.497 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:14.497 INFO:teuthology.orchestra.run.smithi077.stdout:2369 write 0xc826c1e thru 0xc835c7f (0xf062 bytes) 2024-04-23T23:38:14.503 INFO:teuthology.orchestra.run.smithi077.stdout:2370 write 0x54b386e thru 0x54c0116 (0xc8a9 bytes) 2024-04-23T23:38:14.526 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:14.527 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:14.527 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:14.527 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:14.527 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:14.531 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:14.543+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:14.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:14.564 INFO:teuthology.orchestra.run.smithi077.stdout:2371 read 0xd038403 thru 0xd044056 (0xbc54 bytes) 2024-04-23T23:38:14.564 INFO:teuthology.orchestra.run.smithi077.stdout:2372 write 0x1ba633c thru 0x1bb3575 (0xd23a bytes) 2024-04-23T23:38:14.632 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:14.644+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:14.659 INFO:teuthology.orchestra.run.smithi077.stdout:2373 read 0x2712d61 thru 0x27135e5 (0x885 bytes) 2024-04-23T23:38:14.659 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:14.659 INFO:teuthology.orchestra.run.smithi077.stdout:2375 writesame 0xc2ab094 thru 0xc2b650d data_size 0xd(0xb47a bytes) 2024-04-23T23:38:14.671 INFO:teuthology.orchestra.run.smithi077.stdout:2376 punch from 0xe5b8c8f to 0xe5c0f6d, (0x82de bytes) 2024-04-23T23:38:14.671 INFO:teuthology.orchestra.run.smithi077.stdout:2377 read 0x6369dae thru 0x6377287 (0xd4da bytes) 2024-04-23T23:38:14.681 INFO:teuthology.orchestra.run.smithi077.stdout:2378 trunc from 0xede1f94 to 0x5cc572f 2024-04-23T23:38:14.695 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597197737999998, 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597184093000003, 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597171043000003, 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597160023999997, 2024-04-23T23:38:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597150949000003, 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597139005000002, 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.597129893999998, 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.595484522, 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.595472272999999, 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.59129368, 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591281897999998, 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591271829, 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:14.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591260169999998, 2024-04-23T23:38:14.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:14.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:14.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591250850000002, 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.748 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591240337999999, 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:14.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:14.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591230897999999, 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.756 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:14.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:14.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591035804999997, 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:14.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:14.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591014772000001, 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.763 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:14.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:14.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 33.591000882000003, 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:14.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:14.770 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.987844377000002, 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:14.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:14.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:14.775 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:14.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:14.777 INFO:teuthology.orchestra.run.smithi077.stdout:2379 read 0x54e37e3 thru 0x54ef548 (0xbd66 bytes) 2024-04-23T23:38:14.777 INFO:teuthology.orchestra.run.smithi077.stdout:2380 trunc from 0x5cc572f to 0x63e40fb 2024-04-23T23:38:14.777 INFO:teuthology.orchestra.run.smithi077.stdout:2381 punch from 0x19f28f5 to 0x19f6d46, (0x4451 bytes) 2024-04-23T23:38:14.778 INFO:teuthology.orchestra.run.smithi077.stdout:2382 punch from 0x3d5ee5a to 0x3d68994, (0x9b3a bytes) 2024-04-23T23:38:14.778 INFO:teuthology.orchestra.run.smithi077.stdout:2383 writesame 0xa3a3b79 thru 0xa3a9491 data_size 0x1(0x5919 bytes) 2024-04-23T23:38:14.778 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:14.778 INFO:teuthology.orchestra.run.smithi077.stdout:2385 trunc from 0xa3a9492 to 0x265e1df 2024-04-23T23:38:14.778 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:14.788+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:14.818 INFO:teuthology.orchestra.run.smithi077.stdout:2387 punch from 0x1b1c98d to 0x1b2c820, (0xfe93 bytes) 2024-04-23T23:38:14.818 INFO:teuthology.orchestra.run.smithi077.stdout:2388 read 0x82bae0 thru 0x8347e0 (0x8d01 bytes) 2024-04-23T23:38:14.821 INFO:teuthology.orchestra.run.smithi077.stdout:2389 punch from 0xf56a97 to 0xf5f067, (0x85d0 bytes) 2024-04-23T23:38:14.821 INFO:teuthology.orchestra.run.smithi077.stdout:2390 punch from 0x1a7e157 to 0x1a897c0, (0xb669 bytes) 2024-04-23T23:38:14.841 INFO:teuthology.orchestra.run.smithi077.stdout:2391 write 0xe6a6ec8 thru 0xe6b360d (0xc746 bytes) 2024-04-23T23:38:14.849 INFO:teuthology.orchestra.run.smithi077.stdout:2392 punch from 0x3e9292a to 0x3e99df7, (0x74cd bytes) 2024-04-23T23:38:14.849 INFO:teuthology.orchestra.run.smithi077.stdout:2394 read 0x4fb959d thru 0x4fbe545 (0x4fa9 bytes) 2024-04-23T23:38:14.849 INFO:teuthology.orchestra.run.smithi077.stdout:2395 writesame 0x6a6ae thru 0x73e0d data_size 0x20(0x9760 bytes) 2024-04-23T23:38:14.876 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:14.888+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:14.928 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:14.928 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:14.928 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:14.928 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:14.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:14.954 INFO:teuthology.orchestra.run.smithi077.stdout:2397 read 0x10ec91d thru 0x10f1607 (0x4ceb bytes) 2024-04-23T23:38:14.956 INFO:teuthology.orchestra.run.smithi077.stdout:2398 read 0x9b970de thru 0x9ba2d43 (0xbc66 bytes) 2024-04-23T23:38:14.956 INFO:teuthology.orchestra.run.smithi077.stdout:2399 write 0x40c6ed7 thru 0x40d069d (0x97c7 bytes) 2024-04-23T23:38:14.967 INFO:teuthology.orchestra.run.smithi077.stdout:2405 punch from 0x1e3ec01 to 0x1e3ed3b, (0x13a bytes) 2024-04-23T23:38:14.967 INFO:teuthology.orchestra.run.smithi077.stdout:2406 punch from 0x77d0e40 to 0x77dbc20, (0xade0 bytes) 2024-04-23T23:38:14.967 INFO:teuthology.orchestra.run.smithi077.stdout:2407 flatten 2024-04-23T23:38:14.969 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:38:15.013 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:15.025+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:15.077 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:15.089+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:15.086 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:15.086 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:15.086 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-23T23:38:15.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2024-04-23T23:38:15.103 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:15.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:15.103 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:15.103 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:15.104 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:15.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:15.178 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:15.189+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:15.278 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:15.290+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:15.343 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:15.343 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156813323999998, 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:38:15.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156783789000002, 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:38:15.348 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:38:15.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.352 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156764015999997, 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:38:15.356 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156746470000002, 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.357 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:38:15.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156728960000002, 2024-04-23T23:38:15.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:38:15.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156688422000002, 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.366 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:38:15.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:15.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:38:15.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156674856999999, 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:38:15.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:38:15.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156665259, 2024-04-23T23:38:15.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:38:15.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:38:15.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156654697, 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:38:15.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156645380000001, 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.383 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:38:15.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:38:15.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156636192000001, 2024-04-23T23:38:15.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:38:15.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:38:15.391 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.156621620000003, 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:38:15.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.958434531999998, 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.396 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12738 3.19 3:981e3435:::rbd_data.11943f90bac1.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 20048663~49601] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.537460205999999, 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014968690999999999, 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12738 2024-04-23T23:38:15.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814819+0000", 2024-04-23T23:38:15.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5719999999999999e-06 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815601+0000", 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00078195599999999999 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815617+0000", 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6178e-05 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815627+0000", 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6220000000000004e-06 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815716+0000", 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9190999999999994e-05 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815816+0000", 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010035999999999999 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:15.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.816033+0000", 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000216329 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.827645+0000", 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011612618999999999 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829716+0000", 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020706159999999999 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829753+0000", 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6786000000000003e-05 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829786+0000", 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3461999999999999e-05 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:15.407 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.959783903999998, 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:15.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14891 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.815196096000001, 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014134285999999999, 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.413 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14891 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:15.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537083+0000", 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.17e-06 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537087+0000", 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3660000000000002e-06 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537099+0000", 2024-04-23T23:38:15.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1412e-05 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537104+0000", 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537155+0000", 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0970999999999997e-05 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537209+0000", 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3625999999999998e-05 2024-04-23T23:38:15.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537282+0000", 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3201000000000006e-05 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551035+0000", 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013752861 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551108+0000", 2024-04-23T23:38:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2977000000000003e-05 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551165+0000", 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7639000000000002e-05 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551216+0000", 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0634999999999999e-05 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14892 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.815144502999999, 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014338742999999999, 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14892 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537134+0000", 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537137+0000", 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2160000000000002e-06 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537144+0000", 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.951e-06 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537149+0000", 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1830000000000002e-06 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543614+0000", 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0064648400000000003 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543717+0000", 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010273200000000001 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543873+0000", 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000155883 2024-04-23T23:38:15.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551092+0000", 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072189960000000001 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551384+0000", 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00029250700000000001 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551432+0000", 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8287e-05 2024-04-23T23:38:15.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551472+0000", 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9613999999999997e-05 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32774 3.8 e48/21 3:15ce7338:::rbd_data.1194db69ebd1.0000000000000003:head v 48'72, mlcod=47'70)", 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.2997797489999998, 2024-04-23T23:38:15.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013654134, 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052500+0000", 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4789999999999999e-06 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054454+0000", 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019545610000000001 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054477+0000", 2024-04-23T23:38:15.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2866000000000001e-05 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054487+0000", 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.004e-05 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054560+0000", 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2541999999999998e-05 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054587+0000", 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7203e-05 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.066100+0000", 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011512777 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.066152+0000", 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2666e-05 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32786 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.2673322330000003, 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018228132000000001, 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32786 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084948+0000", 2024-04-23T23:38:15.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9920000000000002e-06 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086902+0000", 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019542050000000001 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086923+0000", 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1571999999999999e-05 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086933+0000", 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.73e-06 2024-04-23T23:38:15.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087015+0000", 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2066999999999999e-05 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087175+0000", 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016020699999999999 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087648+0000", 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00047274399999999999 2024-04-23T23:38:15.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.101505+0000", 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013856736 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103090+0000", 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015848979999999999 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103128+0000", 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8120000000000001e-05 2024-04-23T23:38:15.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103174+0000", 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5861e-05 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32787 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [write 0~0] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.2653171600000004, 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016488184999999999, 2024-04-23T23:38:15.434 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32787 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086962+0000", 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0750000000000001e-06 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086964+0000", 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5179999999999999e-06 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086981+0000", 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7017999999999999e-05 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086985+0000", 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6679999999999999e-06 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093014+0000", 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0060293619999999999 2024-04-23T23:38:15.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093120+0000", 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106131 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093311+0000", 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00019033400000000001 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103193+0000", 2024-04-23T23:38:15.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098824499999999992 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103389+0000", 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000195367 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103423+0000", 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4618e-05 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103449+0000", 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5644e-05 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.440 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:15.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:15.442 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:15.453+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:15.453 INFO:teuthology.orchestra.run.smithi077.stdout:2408 write 0x762be3e thru 0x762e0c5 (0x2288 bytes) 2024-04-23T23:38:15.459 INFO:teuthology.orchestra.run.smithi077.stdout:2412 write 0x55b324c thru 0x55b6751 (0x3506 bytes) 2024-04-23T23:38:15.466 INFO:teuthology.orchestra.run.smithi077.stdout:2416 punch from 0xcfbd413 to 0xcfc3692, (0x627f bytes) 2024-04-23T23:38:15.466 INFO:teuthology.orchestra.run.smithi077.stdout:2417 writesame 0x84ab944 thru 0x84adf97 data_size 0x16(0x2654 bytes) 2024-04-23T23:38:15.478 INFO:teuthology.orchestra.run.smithi077.stdout:2418 trunc from 0xe6b360e to 0xbfa1ae2 2024-04-23T23:38:15.502 INFO:teuthology.orchestra.run.smithi077.stdout:2419 trunc from 0xbfa1ae2 to 0x5ca04a 2024-04-23T23:38:15.521 INFO:teuthology.orchestra.run.smithi077.stdout:2420 read 0x55359a thru 0x55990b (0x6372 bytes) 2024-04-23T23:38:15.521 INFO:teuthology.orchestra.run.smithi077.stdout:2421 read 0x13b831 thru 0x14298f (0x715f bytes) 2024-04-23T23:38:15.522 INFO:teuthology.orchestra.run.smithi077.stdout:2424 punch from 0x55b936 to 0x568cbd, (0xd387 bytes) 2024-04-23T23:38:15.522 INFO:teuthology.orchestra.run.smithi077.stdout:2426 read 0x103e01 thru 0x10f25a (0xb45a bytes) 2024-04-23T23:38:15.522 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.535 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:38:15.547+0000 7f7374a68640 -1 mon.a@0(leader).osd e52 definitely_dead 0 2024-04-23T23:38:15.538 INFO:teuthology.orchestra.run.smithi077.stdout:2428 writesame 0x7a9db30 thru 0x7a9fd48 data_size 0x7(0x2219 bytes) 2024-04-23T23:38:15.538 INFO:teuthology.orchestra.run.smithi077.stdout:2430 read 0x74d1dd thru 0x751fd6 (0x4dfa bytes) 2024-04-23T23:38:15.538 INFO:teuthology.orchestra.run.smithi077.stdout:2433 trunc from 0x7a9fd49 to 0x73c0af5 2024-04-23T23:38:15.541 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:15.554+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:15.543 INFO:teuthology.orchestra.run.smithi077.stdout:2434 punch from 0xa0dbb6 to 0xa15b60, (0x7faa bytes) 2024-04-23T23:38:15.543 INFO:teuthology.orchestra.run.smithi077.stdout:2435 read 0x47e770f thru 0x47e92c5 (0x1bb7 bytes) 2024-04-23T23:38:15.557 INFO:teuthology.orchestra.run.smithi077.stdout:2436 writesame 0xe55c529 thru 0xe56b2de data_size 0x1(0xedb6 bytes) 2024-04-23T23:38:15.562 INFO:teuthology.orchestra.run.smithi077.stdout:2437 trunc from 0xe56b2df to 0xa2a9169 2024-04-23T23:38:15.567 INFO:teuthology.orchestra.run.smithi077.stdout:2438 punch from 0x7bd3cad to 0x7bd8616, (0x4969 bytes) 2024-04-23T23:38:15.567 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.574 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:15.574 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:15.574 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:15.574 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:15.577 INFO:teuthology.orchestra.run.smithi077.stdout:2442 trunc from 0xa2a9169 to 0x18644e9 2024-04-23T23:38:15.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:15.602 INFO:teuthology.orchestra.run.smithi077.stdout:2444 write 0xdb0ff9d thru 0xdb176ec (0x7750 bytes) 2024-04-23T23:38:15.607 INFO:teuthology.orchestra.run.smithi077.stdout:2445 write 0x3d226a5 thru 0x3d26b5a (0x44b6 bytes) 2024-04-23T23:38:15.613 INFO:teuthology.orchestra.run.smithi077.stdout:2448 read 0x5f4acc1 thru 0x5f5a675 (0xf9b5 bytes) 2024-04-23T23:38:15.619 INFO:teuthology.orchestra.run.smithi077.stdout:2449 trunc from 0xdb176ed to 0x8ad63fc 2024-04-23T23:38:15.629 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.629 INFO:teuthology.orchestra.run.smithi077.stdout:2451 writesame 0x7cc9fec thru 0x7cd31ba data_size 0x1(0x91cf bytes) 2024-04-23T23:38:15.642 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:15.654+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:15.646 INFO:teuthology.orchestra.run.smithi077.stdout:2452 write 0x9fe9905 thru 0x9ff86c5 (0xedc1 bytes) 2024-04-23T23:38:15.653 INFO:teuthology.orchestra.run.smithi077.stdout:2454 read 0x4a45914 thru 0x4a53a3c (0xe129 bytes) 2024-04-23T23:38:15.653 INFO:teuthology.orchestra.run.smithi077.stdout:2455 read 0x4945a29 thru 0x49526bc (0xcc94 bytes) 2024-04-23T23:38:15.653 INFO:teuthology.orchestra.run.smithi077.stdout:2456 write 0x86d811e thru 0x86dc20c (0x40ef bytes) 2024-04-23T23:38:15.659 INFO:teuthology.orchestra.run.smithi077.stdout:2457 read 0x2f86484 thru 0x2f87b44 (0x16c1 bytes) 2024-04-23T23:38:15.660 INFO:teuthology.orchestra.run.smithi077.stdout:2458 trunc from 0x9ff86c6 to 0xab5f4d5 2024-04-23T23:38:15.671 INFO:teuthology.orchestra.run.smithi077.stdout:2459 trunc from 0xab5f4d5 to 0x557e5b2 2024-04-23T23:38:15.693 INFO:teuthology.orchestra.run.smithi077.stdout:2460 trunc from 0x557e5b2 to 0xcf6c792 2024-04-23T23:38:15.698 INFO:teuthology.orchestra.run.smithi077.stdout:2461 read 0xcef0812 thru 0xcefae70 (0xa65f bytes) 2024-04-23T23:38:15.698 INFO:teuthology.orchestra.run.smithi077.stdout:2462 write 0xb18fe4f thru 0xb193d1a (0x3ecc bytes) 2024-04-23T23:38:15.706 INFO:teuthology.orchestra.run.smithi077.stdout:2463 write 0x9bfc62 thru 0x9ca072 (0xa411 bytes) 2024-04-23T23:38:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:2464 writesame 0x6291d76 thru 0x62a045a data_size 0x3d(0xe6e5 bytes) 2024-04-23T23:38:15.721 INFO:teuthology.orchestra.run.smithi077.stdout:2465 read 0x9a481b8 thru 0x9a4d75a (0x55a3 bytes) 2024-04-23T23:38:15.721 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.721 INFO:teuthology.orchestra.run.smithi077.stdout:2467 punch from 0x39b0618 to 0x39ba4a6, (0x9e8e bytes) 2024-04-23T23:38:15.722 INFO:teuthology.orchestra.run.smithi077.stdout:2470 read 0x81926b1 thru 0x8194f0b (0x285b bytes) 2024-04-23T23:38:15.722 INFO:teuthology.orchestra.run.smithi077.stdout:2472 read 0x6bd17ea thru 0x6bd8243 (0x6a5a bytes) 2024-04-23T23:38:15.722 INFO:teuthology.orchestra.run.smithi077.stdout:2474 read 0x3c7990 thru 0x3cc769 (0x4dda bytes) 2024-04-23T23:38:15.722 INFO:teuthology.orchestra.run.smithi077.stdout:2475 punch from 0xaffd76a to 0xb002556, (0x4dec bytes) 2024-04-23T23:38:15.722 INFO:teuthology.orchestra.run.smithi077.stdout:2476 writesame 0x30dc329 thru 0x30e5f99 data_size 0x1(0x9c71 bytes) 2024-04-23T23:38:15.724 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:15.724 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:15.724 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:15.724 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:15.724 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:15.734 INFO:teuthology.orchestra.run.smithi077.stdout:2477 write 0x61855ce thru 0x6193c72 (0xe6a5 bytes) 2024-04-23T23:38:15.735 INFO:teuthology.orchestra.run.smithi077.stdout:2478 punch from 0xc2c0a06 to 0xc2d08a8, (0xfea2 bytes) 2024-04-23T23:38:15.736 INFO:teuthology.orchestra.run.smithi077.stdout:2479 read 0x8de0cb4 thru 0x8dee63d (0xd98a bytes) 2024-04-23T23:38:15.736 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:15.737 INFO:teuthology.orchestra.run.smithi077.stdout:2480 read 0x639132c thru 0x639ddff (0xcad4 bytes) 2024-04-23T23:38:15.737 INFO:teuthology.orchestra.run.smithi077.stdout:2481 write 0x5a464bd thru 0x5a4a532 (0x4076 bytes) 2024-04-23T23:38:15.744 INFO:teuthology.orchestra.run.smithi077.stdout:2482 write 0x8e784f6 thru 0x8e87e49 (0xf954 bytes) 2024-04-23T23:38:15.745 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:15.756+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:15.758 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.758 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.758 INFO:teuthology.orchestra.run.smithi077.stdout:2486 write 0x1c6ab0 thru 0x1ce0de (0x762f bytes) 2024-04-23T23:38:15.760 INFO:teuthology.orchestra.run.smithi077.stdout:2487 write 0xa85af2c thru 0xa86549b (0xa570 bytes) 2024-04-23T23:38:15.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:15.775 INFO:teuthology.orchestra.run.smithi077.stdout:2488 trunc from 0xcf6c792 to 0x8d54d9a 2024-04-23T23:38:15.788 INFO:teuthology.orchestra.run.smithi077.stdout:2489 read 0x38987f7 thru 0x389fe31 (0x763b bytes) 2024-04-23T23:38:15.788 INFO:teuthology.orchestra.run.smithi077.stdout:2490 write 0x281a041 thru 0x281b4af (0x146f bytes) 2024-04-23T23:38:15.792 INFO:teuthology.orchestra.run.smithi077.stdout:2491 read 0x6d8d2f7 thru 0x6d9b191 (0xde9b bytes) 2024-04-23T23:38:15.798 INFO:teuthology.orchestra.run.smithi077.stdout:2492 write 0x95cd5d4 thru 0x95d6ec9 (0x98f6 bytes) 2024-04-23T23:38:15.805 INFO:teuthology.orchestra.run.smithi077.stdout:2493 read 0x4861b0f thru 0x4865785 (0x3c77 bytes) 2024-04-23T23:38:15.805 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.814 INFO:teuthology.orchestra.run.smithi077.stdout:2495 writesame 0xc3e0fa9 thru 0xc3e4597 data_size 0x1(0x35ef bytes) 2024-04-23T23:38:15.814 INFO:teuthology.orchestra.run.smithi077.stdout:2496 read 0x6a0f325 thru 0x6a177d6 (0x84b2 bytes) 2024-04-23T23:38:15.823 INFO:teuthology.orchestra.run.smithi077.stdout:2497 writesame 0xed6263b thru 0xed675f4 data_size 0x41(0x4fba bytes) 2024-04-23T23:38:15.823 INFO:teuthology.orchestra.run.smithi077.stdout:2498 writesame 0x17a6a15 thru 0x17aaeb9 data_size 0x1(0x44a5 bytes) 2024-04-23T23:38:15.832 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.832 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.832 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:15.833 INFO:teuthology.orchestra.run.smithi077.stdout:2502 writesame 0x7b057a5 thru 0x7b076b4 data_size 0x2(0x1f10 bytes) 2024-04-23T23:38:15.837 INFO:teuthology.orchestra.run.smithi077.stdout:2503 punch from 0xd00a0b2 to 0xd018382, (0xe2d0 bytes) 2024-04-23T23:38:15.837 INFO:teuthology.orchestra.run.smithi077.stdout:2505 read 0x5432bbb thru 0x5436063 (0x34a9 bytes) 2024-04-23T23:38:15.837 INFO:teuthology.orchestra.run.smithi077.stdout:2507 write 0x2e37957 thru 0x2e42f32 (0xb5dc bytes) 2024-04-23T23:38:15.843 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:15.855+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:15.846 INFO:teuthology.orchestra.run.smithi077.stdout:2508 trunc from 0xed675f5 to 0xce23394 2024-04-23T23:38:15.852 INFO:teuthology.orchestra.run.smithi077.stdout:2509 writesame 0x48907e4 thru 0x489cec3 data_size 0x10(0xc6e0 bytes) 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2807 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'5, mlcod=28'3)", 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.490048014000003, 2024-04-23T23:38:15.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044721090000000002, 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391484+0000", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5199999999999996e-07 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391489+0000", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391499+0000", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9450000000000005e-06 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391505+0000", 2024-04-23T23:38:15.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.331e-06 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391560+0000", 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5250000000000001e-05 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391579+0000", 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9049e-05 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395910+0000", 2024-04-23T23:38:15.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043312419999999999 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395955+0000", 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4907000000000002e-05 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3493 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'16, mlcod=28'13)", 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:15.874 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.211434091999998, 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047633190000000002, 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670098+0000", 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670103+0000", 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670115+0000", 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.221e-05 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670126+0000", 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0216e-05 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670172+0000", 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699000000000001e-05 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670190+0000", 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8074999999999999e-05 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674821+0000", 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046309300000000001 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674860+0000", 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9104999999999999e-05 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3496 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'11, mlcod=24'9)", 2024-04-23T23:38:15.878 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.211043443999998, 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043762560000000002, 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3399999999999998e-07 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670495+0000", 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2349999999999996e-06 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670507+0000", 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2183e-05 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670515+0000", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0369999999999995e-06 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670573+0000", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8009e-05 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670594+0000", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0545000000000001e-05 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674832+0000", 2024-04-23T23:38:15.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004238192 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674864+0000", 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2320999999999998e-05 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:4024 3.4 e28/21 3:2546d4ff:::rbd_data.1194137ed5d1.0000000000000135:head v 28'16, mlcod=28'14)", 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 34.873182522999997, 2024-04-23T23:38:15.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042382929999999997, 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008350+0000", 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0720000000000001e-06 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008364+0000", 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4236000000000001e-05 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008381+0000", 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7070000000000001e-05 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008391+0000", 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7499999999999998e-06 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008452+0000", 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1057999999999997e-05 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008474+0000", 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2521999999999999e-05 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012559+0000", 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040842609999999996 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012587+0000", 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8323999999999999e-05 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5287 3.4 e28/21 3:200b80cf:::rbd_data.1194137ed5d1.0000000000000152:head v 28'26, mlcod=28'24)", 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:15.886 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 34.478998058000002, 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042967179999999997, 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402546+0000", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3029e-05 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402557+0000", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0599e-05 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402575+0000", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7765999999999999e-05 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402583+0000", 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.208e-06 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402989+0000", 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000405993 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.403011+0000", 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2036e-05 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406781+0000", 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037698950000000001 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406830+0000", 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9191999999999999e-05 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5627 3.0 e28/21 3:05b00203:::rbd_data.1194137ed5d1.000000000000002b:head v 28'23, mlcod=28'21)", 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 34.161873903999997, 2024-04-23T23:38:15.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065095700000000001, 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719658+0000", 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719664+0000", 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.998e-06 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719676+0000", 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1494999999999999e-05 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719683+0000", 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0049999999999998e-06 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719730+0000", 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7747999999999998e-05 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719750+0000", 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9842000000000001e-05 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726120+0000", 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063699480000000003 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726167+0000", 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6802999999999999e-05 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7147 3.9 e29/21 3:94c47ac8:::rbd_data.1194ccf776f2.00000000000000d5:head v 29'31, mlcod=29'29)", 2024-04-23T23:38:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.506641031000001, 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047294210000000001, 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374891+0000", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.063e-06 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374901+0000", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0112000000000001e-05 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374916+0000", 2024-04-23T23:38:15.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4347e-05 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374925+0000", 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3079999999999997e-06 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374991+0000", 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6264000000000001e-05 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375012+0000", 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0356e-05 2024-04-23T23:38:15.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379556+0000", 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045444079999999998 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379620+0000", 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3563000000000001e-05 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7179 3.4 e29/21 3:266338eb:::rbd_data.1194ccf776f2.000000000000012a:head v 29'42, mlcod=29'39)", 2024-04-23T23:38:15.898 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.471819830000001, 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076296389999999997, 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409712+0000", 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6199999999999996e-07 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409718+0000", 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8089999999999998e-06 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409731+0000", 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3016e-05 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409739+0000", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.503e-06 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409784+0000", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5209e-05 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409806+0000", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1820000000000001e-05 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417291+0000", 2024-04-23T23:38:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074857949999999999 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417341+0000", 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9625e-05 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8160 3.4 e29/21 3:2138fb15:::rbd_data.1194ccf776f2.00000000000001f3:head v 29'44, mlcod=29'42)", 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.344586659999997, 2024-04-23T23:38:15.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039317429999999997, 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536946+0000", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.314e-06 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536958+0000", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1821000000000001e-05 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536984+0000", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5986000000000002e-05 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536992+0000", 2024-04-23T23:38:15.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6719999999999993e-06 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537058+0000", 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5246000000000005e-05 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537083+0000", 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5282e-05 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540835+0000", 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037519129999999999 2024-04-23T23:38:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540876+0000", 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.472495643999999, 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.906 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:15.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:15.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:15.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.47279979, 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.910 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14891 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'41, mlcod=36'39)", 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.344178616000001, 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011022845, 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537361+0000", 2024-04-23T23:38:15.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8099999999999998e-06 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537375+0000", 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3451e-05 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537383+0000", 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9920000000000007e-06 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537452+0000", 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9506999999999997e-05 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537473+0000", 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1178e-05 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548321+0000", 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010847203 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548375+0000", 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4880000000000003e-05 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.917 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14892 3.0 e36/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 36'42, mlcod=36'39)", 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.337566867, 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0048549480000000004, 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543966+0000", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2139999999999999e-06 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543981+0000", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5197e-05 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543994+0000", 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.279e-05 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544000+0000", 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7530000000000004e-06 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544055+0000", 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4564000000000001e-05 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544078+0000", 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3016000000000001e-05 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548773+0000", 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046950689999999996 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548819+0000", 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6344999999999998e-05 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.921 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:22446 3.0 e39/21 3:05205b61:::rbd_data.119499604177.00000000000000ea:head v 39'81, mlcod=38'79)", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:01.387310+0000", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.494220983, 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0051546179999999997, 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387310+0000", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387310+0000", 2024-04-23T23:38:15.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387311+0000", 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0400000000000005e-07 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387319+0000", 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3969999999999994e-06 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387333+0000", 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3766e-05 2024-04-23T23:38:15.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387341+0000", 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7319999999999998e-06 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387399+0000", 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8341999999999998e-05 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387422+0000", 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3074e-05 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.392430+0000", 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0050078140000000002 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.392465+0000", 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4688999999999999e-05 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:15.925 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.793542693, 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:38:15.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32787 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'70, mlcod=45'66)", 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.093450+0000", 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.7880814200000001, 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098584810000000005, 2024-04-23T23:38:15.929 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093450+0000", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093450+0000", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093451+0000", 2024-04-23T23:38:15.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5510000000000001e-06 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093464+0000", 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2731000000000001e-05 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093479+0000", 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5207e-05 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093489+0000", 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0018e-05 2024-04-23T23:38:15.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.094265+0000", 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00077592500000000001 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.094292+0000", 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6559000000000001e-05 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103281+0000", 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0089890000000000005 2024-04-23T23:38:15.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103308+0000", 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7489999999999999e-05 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:34060 3.4 e49/21 3:22bb01ac:::rbd_data.1194340c7365.0000000000000004:head v 49'71, mlcod=48'68)", 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:11.199532+0000", 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6819991640000005, 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076631140000000004, 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.933 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.199532+0000", 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.199532+0000", 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.199534+0000", 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:38:15.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200666+0000", 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011314179999999999 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200685+0000", 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8862999999999999e-05 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200694+0000", 2024-04-23T23:38:15.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5240000000000006e-06 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200765+0000", 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0760999999999996e-05 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200796+0000", 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1597999999999998e-05 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.207137+0000", 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063407400000000001 2024-04-23T23:38:15.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.207195+0000", 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8017999999999999e-05 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:34172 3.9 e49/21 3:9293f19c:::rbd_data.1194340c7365.0000000000000000:head v 49'100, mlcod=47'98)", 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:11.302829+0000", 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5787021140000004, 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010206576, 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.937 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.302829+0000", 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.302829+0000", 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.302830+0000", 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:15.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304769+0000", 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001939582 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304783+0000", 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3378e-05 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304793+0000", 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0696000000000001e-05 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304852+0000", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8678999999999998e-05 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304868+0000", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5577999999999999e-05 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.312981+0000", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0081129889999999993 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.313036+0000", 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5064e-05 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:34173 3.4 e49/21 3:26f1f4e1:::rbd_data.1194340c7365.0000000000000001:head v 49'73, mlcod=49'71)", 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:11.303771+0000", 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5777601079999997, 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083667979999999999, 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.303771+0000", 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.303771+0000", 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.303772+0000", 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.251e-06 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304664+0000", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00089163399999999998 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304686+0000", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2311999999999999e-05 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304698+0000", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2037e-05 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304771+0000", 2024-04-23T23:38:15.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2440000000000004e-05 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304793+0000", 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1764999999999999e-05 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.312083+0000", 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072904579999999997 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.312138+0000", 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4901000000000002e-05 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:40695 3.9 e52/21 3:94277d78:::rbd_data.1194b986b650.000000000000017a:head v 52'166, mlcod=52'164)", 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.703497+0000", 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.1780341759999999, 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040262539999999999, 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703497+0000", 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703497+0000", 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703498+0000", 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1699999999999998e-07 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703502+0000", 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.121e-06 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703510+0000", 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6819999999999992e-06 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703515+0000", 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5179999999999998e-06 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703551+0000", 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6009e-05 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703563+0000", 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2078e-05 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.707488+0000", 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039247179999999998 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:15.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.707523+0000", 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5611000000000002e-05 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:15.949 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:15.950 INFO:teuthology.orchestra.run.smithi077.stdout:2510 trunc from 0xce23394 to 0x17dddde 2024-04-23T23:38:15.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:15.951 INFO:teuthology.orchestra.run.smithi077.stdout:2511 read 0x15b0bbb thru 0x15b2815 (0x1c5b bytes) 2024-04-23T23:38:15.951 INFO:teuthology.orchestra.run.smithi077.stdout:2512 write 0x21f9a3c thru 0x2202c10 (0x91d5 bytes) 2024-04-23T23:38:15.951 INFO:teuthology.orchestra.run.smithi077.stdout:2513 write 0x4daf860 thru 0x4db0195 (0x936 bytes) 2024-04-23T23:38:15.952 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:15.952 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:15.953 INFO:teuthology.orchestra.run.smithi077.stdout:2514 trunc from 0x4db0196 to 0x38f4e16 2024-04-23T23:38:15.953 INFO:teuthology.orchestra.run.smithi077.stdout:2515 trunc from 0x38f4e16 to 0x1a033b7 2024-04-23T23:38:15.953 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:15.953 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:15.953 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:15.962+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:15.960 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:15.961 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:15.961 INFO:teuthology.orchestra.run.smithi077.stdout:2516 write 0x8b16c67 thru 0x8b17900 (0xc9a bytes) 2024-04-23T23:38:15.963 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:38:15.965 INFO:teuthology.orchestra.run.smithi077.stderr:marked out osd.3. 2024-04-23T23:38:15.986 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:15.987 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:15.998 INFO:teuthology.orchestra.run.smithi077.stdout:2518 write 0xdc1140d thru 0xdc18ee4 (0x7ad8 bytes) 2024-04-23T23:38:16.007 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:16.007 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:16.025 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:16.025 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:16.043 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:16.043 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:16.051 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:16.063+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:16.060 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:16.061 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:16.077 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.077 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:16.171 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:16.183+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:16.230 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.230 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:16.253 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:16.264+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:16.353 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:16.366+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:16.381 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.381 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:16.455 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:16.467+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:16.493 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.493 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.502 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:16.556 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:16.569+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:16.604 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.604 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.613 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:16.657 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:16.670+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:16.715 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.715 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.723 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:16.768 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:16.780+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:16.825 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.825 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.833 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:16.859 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:16.871+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:16.960 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:16.972+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:16.976 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:16.976 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:16.988 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:17.061 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:17.074+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:17.130 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.130 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.139 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:17.162 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:17.175+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:17.241 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.241 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.250 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:17.293 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:17.305+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:17.351 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.351 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.359 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:17.401 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:17.412+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:17.468 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:17.480+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:17.502 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.502 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.510 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:17.571 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:17.583+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:17.612 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.612 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.621 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:17.671 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:17.684+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:17.722 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.722 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.730 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:17.774 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:17.786+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.832 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:17.885 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:17.897+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:17.954 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:17.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:17.976 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:17.987+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:17.986 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:38:17.996 INFO:teuthology.orchestra.run.smithi077.stdout:2519 write 0x1ebde49 thru 0x1ebe6c3 (0x87b bytes) 2024-04-23T23:38:18.004 INFO:teuthology.orchestra.run.smithi077.stdout:2520 write 0x44d41fa thru 0x44de0ad (0x9eb4 bytes) 2024-04-23T23:38:18.013 INFO:teuthology.orchestra.run.smithi077.stdout:2523 write 0x36ff174 thru 0x3701e10 (0x2c9d bytes) 2024-04-23T23:38:18.018 INFO:teuthology.orchestra.run.smithi077.stdout:2524 write 0x2745b87 thru 0x275283d (0xccb7 bytes) 2024-04-23T23:38:18.029 INFO:teuthology.orchestra.run.smithi077.stdout:2525 write 0x2a8635d thru 0x2a94479 (0xe11d bytes) 2024-04-23T23:38:18.037 INFO:teuthology.orchestra.run.smithi077.stdout:2526 writesame 0xc31ffa3 thru 0xc328cd3 data_size 0x1(0x8d31 bytes) 2024-04-23T23:38:18.055 INFO:teuthology.orchestra.run.smithi077.stdout:2527 read 0x24b55e0 thru 0x24c532f (0xfd50 bytes) 2024-04-23T23:38:18.056 INFO:teuthology.orchestra.run.smithi077.stdout:2528 punch from 0x5798fe4 to 0x579a228, (0x1244 bytes) 2024-04-23T23:38:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:2529 trunc from 0xdc18ee5 to 0x4d3f56b 2024-04-23T23:38:18.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:2530 punch from 0x372caaa to 0x372db24, (0x107a bytes) 2024-04-23T23:38:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:2531 write 0x4961f5 thru 0x4a280d (0xc619 bytes) 2024-04-23T23:38:18.089 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:18.101+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:18.105 INFO:teuthology.orchestra.run.smithi077.stdout:2532 write 0x41e44e thru 0x4223e2 (0x3f95 bytes) 2024-04-23T23:38:18.112 INFO:teuthology.orchestra.run.smithi077.stdout:2534 trunc from 0x4d3f56b to 0x599eb5e 2024-04-23T23:38:18.143 INFO:teuthology.orchestra.run.smithi077.stdout:2535 write 0xedd777f thru 0xede5c18 (0xe49a bytes) 2024-04-23T23:38:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:18.144 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:2536 punch from 0x76c9b63 to 0x76d3c29, (0xa0c6 bytes) 2024-04-23T23:38:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:2538 read 0xded2490 thru 0xded8cd9 (0x684a bytes) 2024-04-23T23:38:18.157 INFO:teuthology.orchestra.run.smithi077.stdout:2539 write 0xce42104 thru 0xce488d4 (0x67d1 bytes) 2024-04-23T23:38:18.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:18.170 INFO:teuthology.orchestra.run.smithi077.stdout:2542 writesame 0x9a5f664 thru 0x9a68780 data_size 0x7(0x911d bytes) 2024-04-23T23:38:18.202 INFO:teuthology.orchestra.run.smithi077.stdout:2547 trunc from 0xede5c19 to 0x45049ba 2024-04-23T23:38:18.202 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:18.214+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:18.226 INFO:teuthology.orchestra.run.smithi077.stdout:2548 read 0xc6b692 thru 0xc7a0c8 (0xea37 bytes) 2024-04-23T23:38:18.227 INFO:teuthology.orchestra.run.smithi077.stdout:2550 clone 18 order 18 su 131072 sc 7 2024-04-23T23:38:18.263 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:18.263 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:18.278 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:18.291+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:18.298 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:18.299 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214127484999999, 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:18.312 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:18.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:18.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214113840000003, 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:18.320 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214100790000003, 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.321 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214089770999998, 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214080696000003, 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.329 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214068752000003, 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:18.333 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.214059640999999, 2024-04-23T23:38:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:18.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.341 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.212414269, 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:18.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.212402019999999, 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:18.346 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:18.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:18.350 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208223427, 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:18.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208211644999999, 2024-04-23T23:38:18.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:18.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208201576, 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:18.358 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208189916999999, 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:18.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208180597000002, 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.366 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:18.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208170084999999, 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:18.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:18.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.208160645, 2024-04-23T23:38:18.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.207965551999997, 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.378 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:18.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:18.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:18.381 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.207944519000002, 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.382 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:18.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:18.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.385 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.207930629000003, 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:18.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:18.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 25.604774123999999, 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.389 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:18.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:18.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:18.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.394 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.394 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.394 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.394 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.394 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:18.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:18.396 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:18.397 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:18.407+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:18.406 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:18.406 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:18.442 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:18.442 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:18.462 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:18.463 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:18.480 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:18.481 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:18.496 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:18.508+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:18.510 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:18.510 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:18.510 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:18.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:18.596 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:18.608+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:18.661 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:18.661 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:18.662 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:18.662 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:18.662 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:18.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:18.698 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:18.710+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:18.773 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:18.773 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1990 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18432000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589501302999999, 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011978506, 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1990 2024-04-23T23:38:18.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195464+0000", 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195465+0000", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195471+0000", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1199999999999999e-06 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195482+0000", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1499e-05 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195487+0000", 2024-04-23T23:38:18.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.87e-06 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207284+0000", 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011796706000000001 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207366+0000", 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1489999999999994e-05 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207443+0000", 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7472000000000006e-05 2024-04-23T23:38:18.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1991 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18661376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589471768000003, 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012090075, 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1991 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195494+0000", 2024-04-23T23:38:18.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195497+0000", 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195503+0000", 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195507+0000", 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4220000000000002e-06 2024-04-23T23:38:18.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207474+0000", 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011966881 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207525+0000", 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0810999999999999e-05 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207584+0000", 2024-04-23T23:38:18.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8998e-05 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1992 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 18890752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589451994999997, 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012283782, 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1992 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195514+0000", 2024-04-23T23:38:18.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195516+0000", 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195522+0000", 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5809999999999996e-06 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195526+0000", 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3699999999999997e-06 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207621+0000", 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012094858999999999 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207703+0000", 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2050000000000002e-05 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207798+0000", 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4744e-05 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1993 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19120128~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589434449000002, 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012410948999999999, 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1993 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195531+0000", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195532+0000", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195533+0000", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195539+0000", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4580000000000001e-06 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195543+0000", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207831+0000", 2024-04-23T23:38:18.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012288388000000001 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207882+0000", 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0877000000000001e-05 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207942+0000", 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9975000000000001e-05 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1994 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19349504~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.789 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589416939000003, 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012600744000000001, 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1994 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195549+0000", 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195554+0000", 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3149999999999999e-06 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195565+0000", 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0285999999999999e-05 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195575+0000", 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8460000000000003e-06 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.207975+0000", 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012400348 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208056+0000", 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1014999999999996e-05 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208150+0000", 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3610000000000007e-05 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1995 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19578880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589376401000003, 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012739451000000001, 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1995 2024-04-23T23:38:18.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195589+0000", 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195590+0000", 2024-04-23T23:38:18.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0699999999999998e-07 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195591+0000", 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.753e-06 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195596+0000", 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195599+0000", 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208192+0000", 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012593155 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208261+0000", 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8668000000000001e-05 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208329+0000", 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8326999999999998e-05 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1996 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 19808256~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589362835999999, 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012938955, 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1996 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195603+0000", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195604+0000", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.051e-06 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195607+0000", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.988e-06 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195610+0000", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3609999999999999e-06 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208363+0000", 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012753291 2024-04-23T23:38:18.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208443+0000", 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0168999999999998e-05 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208542+0000", 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8819000000000004e-05 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1997 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20037632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.801 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589353238000001, 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013150287, 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1997 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195613+0000", 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195614+0000", 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2219999999999999e-06 2024-04-23T23:38:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195617+0000", 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5159999999999999e-06 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195620+0000", 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6259999999999999e-06 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208582+0000", 2024-04-23T23:38:18.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012962351 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208666+0000", 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3326999999999997e-05 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208763+0000", 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7035999999999997e-05 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.805 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1998 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20267008~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589342676000001, 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013266573, 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1998 2024-04-23T23:38:18.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195623+0000", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0599999999999999e-07 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195624+0000", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4799999999999997e-07 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195627+0000", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0249999999999998e-06 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195630+0000", 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3020000000000002e-06 2024-04-23T23:38:18.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208781+0000", 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013151085 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208830+0000", 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9529e-05 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208890+0000", 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9478000000000002e-05 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:1999 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20496384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589333359000001, 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013476195999999999, 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 1999 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195632+0000", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195633+0000", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195634+0000", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8100000000000001e-07 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195636+0000", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9280000000000002e-06 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195639+0000", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.208922+0000", 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013283349999999999 2024-04-23T23:38:18.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209012+0000", 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9835999999999998e-05 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209109+0000", 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6669000000000006e-05 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2000 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20725760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:18.813 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589324171000001, 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013639184, 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2000 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195642+0000", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195647+0000", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195651+0000", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2540000000000001e-06 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195653+0000", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4889999999999998e-06 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209157+0000", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013503701 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209221+0000", 2024-04-23T23:38:18.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4249000000000001e-05 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209281+0000", 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9769999999999999e-05 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:2001 3.19 3:9f4fec81:::rbd_data.1194833257ef.0000000000000006:4 [read 20955136~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.589309599000003, 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013758737, 2024-04-23T23:38:18.817 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 2001 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195656+0000", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195660+0000", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6569999999999999e-06 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195663+0000", 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3009999999999998e-06 2024-04-23T23:38:18.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.195666+0000", 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3690000000000001e-06 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209308+0000", 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013642434 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209355+0000", 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6946000000000001e-05 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.209415+0000", 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9799999999999997e-05 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.391122510999999, 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:18.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12738 3.19 3:981e3435:::rbd_data.11943f90bac1.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 20048663~49601] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 25.970148184999999, 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014968690999999999, 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12738 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814818+0000", 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.814819+0000", 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5719999999999999e-06 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815601+0000", 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00078195599999999999 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815617+0000", 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6178e-05 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815627+0000", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6220000000000004e-06 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815716+0000", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9190999999999994e-05 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.815816+0000", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010035999999999999 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 3", 2024-04-23T23:38:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.816033+0000", 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000216329 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.827645+0000", 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011612618999999999 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829716+0000", 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020706159999999999 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829753+0000", 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6786000000000003e-05 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.829786+0000", 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3461999999999999e-05 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.392471882999999, 2024-04-23T23:38:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:18.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.836 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14891 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.247884075000002, 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014134285999999999, 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14891 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537082+0000", 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537083+0000", 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.17e-06 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537087+0000", 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3660000000000002e-06 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537099+0000", 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1412e-05 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537104+0000", 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537155+0000", 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0970999999999997e-05 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537209+0000", 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3625999999999998e-05 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537282+0000", 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3201000000000006e-05 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551035+0000", 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013752861 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551108+0000", 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2977000000000003e-05 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551165+0000", 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7639000000000002e-05 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551216+0000", 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0634999999999999e-05 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14892 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [stat,truncate 9437184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.247832482, 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014338742999999999, 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14892 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537133+0000", 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537134+0000", 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537137+0000", 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2160000000000002e-06 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537144+0000", 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.951e-06 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537149+0000", 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1830000000000002e-06 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543614+0000", 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0064648400000000003 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543717+0000", 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010273200000000001 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543873+0000", 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000155883 2024-04-23T23:38:18.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551092+0000", 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072189960000000001 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551384+0000", 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00029250700000000001 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551432+0000", 2024-04-23T23:38:18.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8287e-05 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.551472+0000", 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9613999999999997e-05 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32774 3.8 e48/21 3:15ce7338:::rbd_data.1194db69ebd1.0000000000000003:head v 48'72, mlcod=47'70)", 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.7324677279999996, 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013654134, 2024-04-23T23:38:18.847 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052498+0000", 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.052500+0000", 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4789999999999999e-06 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054454+0000", 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019545610000000001 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054477+0000", 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2866000000000001e-05 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054487+0000", 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.004e-05 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054560+0000", 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2541999999999998e-05 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.054587+0000", 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7203e-05 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.066100+0000", 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011512777 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.066152+0000", 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2666e-05 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32786 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:18.852 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.7000202120000001, 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018228132000000001, 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32786 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084948+0000", 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9920000000000002e-06 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086902+0000", 2024-04-23T23:38:18.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019542050000000001 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086923+0000", 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1571999999999999e-05 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086933+0000", 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.73e-06 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087015+0000", 2024-04-23T23:38:18.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2066999999999999e-05 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087175+0000", 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016020699999999999 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087648+0000", 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00047274399999999999 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.101505+0000", 2024-04-23T23:38:18.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013856736 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103090+0000", 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015848979999999999 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103128+0000", 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8120000000000001e-05 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103174+0000", 2024-04-23T23:38:18.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5861e-05 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32787 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [write 0~0] snapc f=[f] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.6980051389999993, 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016488184999999999, 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:18.858 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32787 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086961+0000", 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086962+0000", 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0750000000000001e-06 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086964+0000", 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5179999999999999e-06 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086981+0000", 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7017999999999999e-05 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086985+0000", 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6679999999999999e-06 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093014+0000", 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0060293619999999999 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093120+0000", 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106131 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093311+0000", 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00019033400000000001 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103193+0000", 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098824499999999992 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103389+0000", 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000195367 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103423+0000", 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4618e-05 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103449+0000", 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5644e-05 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:18.863 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:18.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:18.866 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:38:18.866 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:18.877+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:18.966 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:18.978+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:19.009 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:19.009 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:19.010 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:19.010 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:19.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:19.067 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:19.079+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:19.162 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:19.162 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:19.162 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:19.163 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:19.163 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:19.168 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:19.179+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:19.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:19.269 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:19.281+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:19.274 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:19.275 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:19.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:19.275 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:19.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.275 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:2807 3.4 e28/21 3:20511661:::rbd_data.1194137ed5d1.0000000000000187:head v 28'5, mlcod=28'3)", 2024-04-23T23:38:19.275 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.894672726000003, 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044721090000000002, 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391483+0000", 2024-04-23T23:38:19.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391484+0000", 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5199999999999996e-07 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391489+0000", 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391499+0000", 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9450000000000005e-06 2024-04-23T23:38:19.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391505+0000", 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.331e-06 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391560+0000", 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5250000000000001e-05 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.391579+0000", 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9049e-05 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395910+0000", 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043312419999999999 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.395955+0000", 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4907000000000002e-05 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3493 3.0 e28/21 3:0714afe2:::rbd_data.1194137ed5d1.00000000000001ba:head v 28'16, mlcod=28'13)", 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.616058803999998, 2024-04-23T23:38:19.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047633190000000002, 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670097+0000", 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670098+0000", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670103+0000", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670115+0000", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.221e-05 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670126+0000", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0216e-05 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670172+0000", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699000000000001e-05 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670190+0000", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8074999999999999e-05 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674821+0000", 2024-04-23T23:38:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046309300000000001 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674860+0000", 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9104999999999999e-05 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:3496 3.9 e28/21 3:95b08701:::rbd_data.1194137ed5d1.00000000000001c9:head v 28'11, mlcod=24'9)", 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.615668155999998, 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043762560000000002, 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.283 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670488+0000", 2024-04-23T23:38:19.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3399999999999998e-07 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670495+0000", 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2349999999999996e-06 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670507+0000", 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2183e-05 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670515+0000", 2024-04-23T23:38:19.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0369999999999995e-06 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670573+0000", 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8009e-05 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.670594+0000", 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0545000000000001e-05 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674832+0000", 2024-04-23T23:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004238192 2024-04-23T23:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:40.674864+0000", 2024-04-23T23:38:19.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2320999999999998e-05 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:4024 3.4 e28/21 3:2546d4ff:::rbd_data.1194137ed5d1.0000000000000135:head v 28'16, mlcod=28'14)", 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.277807234999997, 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042382929999999997, 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.288 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008349+0000", 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008350+0000", 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0720000000000001e-06 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008364+0000", 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4236000000000001e-05 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008381+0000", 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7070000000000001e-05 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008391+0000", 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7499999999999998e-06 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008452+0000", 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1057999999999997e-05 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.008474+0000", 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2521999999999999e-05 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012559+0000", 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040842609999999996 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.012587+0000", 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8323999999999999e-05 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5287 3.4 e28/21 3:200b80cf:::rbd_data.1194137ed5d1.0000000000000152:head v 28'26, mlcod=28'24)", 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.883622770000002, 2024-04-23T23:38:19.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042967179999999997, 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402533+0000", 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402546+0000", 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3029e-05 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402557+0000", 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0599e-05 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402575+0000", 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7765999999999999e-05 2024-04-23T23:38:19.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402583+0000", 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.208e-06 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.402989+0000", 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000405993 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.403011+0000", 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2036e-05 2024-04-23T23:38:19.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406781+0000", 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037698950000000001 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.406830+0000", 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9191999999999999e-05 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:5627 3.0 e28/21 3:05b00203:::rbd_data.1194137ed5d1.000000000000002b:head v 28'23, mlcod=28'21)", 2024-04-23T23:38:19.296 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.566498615999997, 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065095700000000001, 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719657+0000", 2024-04-23T23:38:19.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719658+0000", 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719664+0000", 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.998e-06 2024-04-23T23:38:19.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719676+0000", 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1494999999999999e-05 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719683+0000", 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0049999999999998e-06 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719730+0000", 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7747999999999998e-05 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.719750+0000", 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9842000000000001e-05 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726120+0000", 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063699480000000003 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.726167+0000", 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6802999999999999e-05 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7147 3.9 e29/21 3:94c47ac8:::rbd_data.1194ccf776f2.00000000000000d5:head v 29'31, mlcod=29'29)", 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.911265743000001, 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047294210000000001, 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374890+0000", 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374891+0000", 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.063e-06 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374901+0000", 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0112000000000001e-05 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374916+0000", 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4347e-05 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374925+0000", 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3079999999999997e-06 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.374991+0000", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6264000000000001e-05 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.375012+0000", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0356e-05 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379556+0000", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045444079999999998 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.379620+0000", 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3563000000000001e-05 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:7179 3.4 e29/21 3:266338eb:::rbd_data.1194ccf776f2.000000000000012a:head v 29'42, mlcod=29'39)", 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.876444542000002, 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076296389999999997, 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409711+0000", 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409712+0000", 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6199999999999996e-07 2024-04-23T23:38:19.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409718+0000", 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8089999999999998e-06 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409731+0000", 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3016e-05 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409739+0000", 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.503e-06 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409784+0000", 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5209e-05 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.409806+0000", 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1820000000000001e-05 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417291+0000", 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074857949999999999 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.417341+0000", 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9625e-05 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:8160 3.4 e29/21 3:2138fb15:::rbd_data.1194ccf776f2.00000000000001f3:head v 29'44, mlcod=29'42)", 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.749211371999998, 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039317429999999997, 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536945+0000", 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536946+0000", 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.314e-06 2024-04-23T23:38:19.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536958+0000", 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1821000000000001e-05 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536984+0000", 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5986000000000002e-05 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.536992+0000", 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6719999999999993e-06 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537058+0000", 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5246000000000005e-05 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.537083+0000", 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5282e-05 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540835+0000", 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037519129999999999 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:43.540876+0000", 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.877120355999999, 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.313 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:19.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:19.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.877424502, 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:19.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.321 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14891 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'41, mlcod=36'39)", 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.748803328000001, 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011022845, 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:19.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537353+0000", 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537361+0000", 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8099999999999998e-06 2024-04-23T23:38:19.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537375+0000", 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3451e-05 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537383+0000", 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9920000000000007e-06 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537452+0000", 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9506999999999997e-05 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.537473+0000", 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1178e-05 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548321+0000", 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010847203 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548375+0000", 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4880000000000003e-05 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14892 3.0 e36/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 36'42, mlcod=36'39)", 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 21.742191579, 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0048549480000000004, 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543964+0000", 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543966+0000", 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2139999999999999e-06 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543981+0000", 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5197e-05 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.543994+0000", 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.279e-05 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544000+0000", 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7530000000000004e-06 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544055+0000", 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4564000000000001e-05 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.544078+0000", 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3016000000000001e-05 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548773+0000", 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046950689999999996 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.548819+0000", 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6344999999999998e-05 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.329 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:22446 3.0 e39/21 3:05205b61:::rbd_data.119499604177.00000000000000ea:head v 39'81, mlcod=38'79)", 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:01.387310+0000", 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.898845694999999, 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0051546179999999997, 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387310+0000", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387310+0000", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387311+0000", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0400000000000005e-07 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387319+0000", 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3969999999999994e-06 2024-04-23T23:38:19.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387333+0000", 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3766e-05 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387341+0000", 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7319999999999998e-06 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387399+0000", 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8341999999999998e-05 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.387422+0000", 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3074e-05 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.392430+0000", 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0050078140000000002 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:01.392465+0000", 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4688999999999999e-05 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.1981674049999995, 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.337 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32787 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'70, mlcod=45'66)", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.093450+0000", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.1927061319999996, 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098584810000000005, 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093450+0000", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093450+0000", 2024-04-23T23:38:19.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093451+0000", 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5510000000000001e-06 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093464+0000", 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2731000000000001e-05 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093479+0000", 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5207e-05 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.093489+0000", 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0018e-05 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.094265+0000", 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00077592500000000001 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.094292+0000", 2024-04-23T23:38:19.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6559000000000001e-05 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103281+0000", 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0089890000000000005 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103308+0000", 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7489999999999999e-05 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:34060 3.4 e49/21 3:22bb01ac:::rbd_data.1194340c7365.0000000000000004:head v 49'71, mlcod=48'68)", 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:11.199532+0000", 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0866238760000009, 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076631140000000004, 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.199532+0000", 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.199532+0000", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.199534+0000", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200666+0000", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011314179999999999 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200685+0000", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8862999999999999e-05 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200694+0000", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5240000000000006e-06 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200765+0000", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0760999999999996e-05 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.200796+0000", 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1597999999999998e-05 2024-04-23T23:38:19.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.207137+0000", 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063407400000000001 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.207195+0000", 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8017999999999999e-05 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:34172 3.9 e49/21 3:9293f19c:::rbd_data.1194340c7365.0000000000000000:head v 49'100, mlcod=47'98)", 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:11.302829+0000", 2024-04-23T23:38:19.345 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.9833268259999999, 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010206576, 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.302829+0000", 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.302829+0000", 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.302830+0000", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304769+0000", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001939582 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304783+0000", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3378e-05 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304793+0000", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0696000000000001e-05 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304852+0000", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8678999999999998e-05 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304868+0000", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5577999999999999e-05 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.312981+0000", 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0081129889999999993 2024-04-23T23:38:19.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.313036+0000", 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5064e-05 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:34173 3.4 e49/21 3:26f1f4e1:::rbd_data.1194340c7365.0000000000000001:head v 49'73, mlcod=49'71)", 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:11.303771+0000", 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 7.98238482, 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083667979999999999, 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.303771+0000", 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.303771+0000", 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.303772+0000", 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.251e-06 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304664+0000", 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00089163399999999998 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304686+0000", 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2311999999999999e-05 2024-04-23T23:38:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304698+0000", 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2037e-05 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304771+0000", 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2440000000000004e-05 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.304793+0000", 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1764999999999999e-05 2024-04-23T23:38:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.312083+0000", 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072904579999999997 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:11.312138+0000", 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4901000000000002e-05 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:40695 3.9 e52/21 3:94277d78:::rbd_data.1194b986b650.000000000000017a:head v 52'166, mlcod=52'164)", 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.703497+0000", 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5826588880000001, 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040262539999999999, 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703497+0000", 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703497+0000", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703498+0000", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1699999999999998e-07 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703502+0000", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.121e-06 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703510+0000", 2024-04-23T23:38:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6819999999999992e-06 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703515+0000", 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5179999999999998e-06 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703551+0000", 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6009e-05 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.703563+0000", 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2078e-05 2024-04-23T23:38:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.707488+0000", 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039247179999999998 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.707523+0000", 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5611000000000002e-05 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.357 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:19.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:19.370 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:19.382+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:19.471 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:19.483+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:19.502 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:19.502 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:19.502 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:19.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:19.572 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:19.584+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:19.623 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:19.623 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:19.623 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:19.623 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:19.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:19.672 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:19.684+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:19.767 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:19.767 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:19.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:19.767 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37869 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5715953410000001, 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045333998, 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37869 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207482+0000", 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8299999999999995e-07 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207485+0000", 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9620000000000002e-06 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207488+0000", 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6800000000000002e-06 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252696+0000", 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045208527999999998 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252756+0000", 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9828999999999999e-05 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252815+0000", 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8900999999999997e-05 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37870 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1155072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.57158379, 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045543751, 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37870 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207493+0000", 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8799999999999998e-07 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207501+0000", 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0269999999999995e-06 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207507+0000", 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207512+0000", 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6909999999999996e-06 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252853+0000", 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045341765999999999 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252932+0000", 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8846999999999999e-05 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253036+0000", 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103788 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37871 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.571556084, 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045672261999999998, 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37871 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207521+0000", 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.44e-07 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207523+0000", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207529+0000", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2999999999999998e-06 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207533+0000", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5029999999999999e-06 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253082+0000", 2024-04-23T23:38:19.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045548271000000001 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253139+0000", 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7237000000000001e-05 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253192+0000", 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3470000000000001e-05 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37872 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1196032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5715367330000003, 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806959000000001, 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37872 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207540+0000", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207542+0000", 2024-04-23T23:38:19.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7749999999999999e-06 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207546+0000", 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8239999999999999e-06 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207553+0000", 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253231+0000", 2024-04-23T23:38:19.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045677698000000003 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253276+0000", 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5238000000000003e-05 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253346+0000", 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0234000000000006e-05 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37873 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.783 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5715189440000001, 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046012472999999998, 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37873 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207558+0000", 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207559+0000", 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4610000000000001e-06 2024-04-23T23:38:19.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207565+0000", 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0700000000000003e-06 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207569+0000", 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.189e-06 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253392+0000", 2024-04-23T23:38:19.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045822300000000003 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253471+0000", 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9354e-05 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253570+0000", 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8748999999999999e-05 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37874 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1236992~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5715001910000002, 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046114845000000002, 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37874 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.46e-07 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207578+0000", 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:19.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207584+0000", 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2249999999999997e-06 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207589+0000", 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253602+0000", 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046013314 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253641+0000", 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8980000000000003e-05 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253691+0000", 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9503999999999999e-05 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37875 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.791 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5714810979999996, 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046215125000000003, 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37875 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207597+0000", 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.632e-06 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207603+0000", 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207614+0000", 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1326e-05 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253723+0000", 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046108359000000002 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253761+0000", 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8124999999999998e-05 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253810+0000", 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9431000000000002e-05 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37876 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1277952~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5714556159999997, 2024-04-23T23:38:19.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046358498999999997, 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37876 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207826+0000", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00020521100000000001 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207829+0000", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4259999999999999e-06 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207839+0000", 2024-04-23T23:38:19.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0229e-05 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207847+0000", 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253839+0000", 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991727000000003 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253887+0000", 2024-04-23T23:38:19.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8353999999999998e-05 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253979+0000", 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.187e-05 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37877 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5712187069999999, 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046312513999999999, 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.799 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37877 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208979+0000", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011215649999999999 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208984+0000", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208994+0000", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0223e-05 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209001+0000", 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0570000000000004e-06 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254010+0000", 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045008632999999999 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254075+0000", 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5227000000000004e-05 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254170+0000", 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5038999999999996e-05 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37878 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1318912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5700631930000002, 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045355536000000002, 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37878 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:19.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209016+0000", 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209023+0000", 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8000000000000001e-06 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209028+0000", 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.575e-06 2024-04-23T23:38:19.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254215+0000", 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045186357000000003 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254284+0000", 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9089000000000002e-05 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254368+0000", 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4845000000000005e-05 2024-04-23T23:38:19.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37879 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5700405399999999, 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045494123999999997, 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.807 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37879 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:38:19.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209038+0000", 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8449999999999999e-06 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209045+0000", 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8009999999999998e-06 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209050+0000", 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254409+0000", 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045358974000000003 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254462+0000", 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2913e-05 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254530+0000", 2024-04-23T23:38:19.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7968999999999999e-05 2024-04-23T23:38:19.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.813 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37880 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5700195939999997, 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045602333000000002, 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37880 2024-04-23T23:38:19.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209059+0000", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.792e-06 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209068+0000", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5559999999999996e-06 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209074+0000", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5060000000000003e-06 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254562+0000", 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045488622999999999 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254606+0000", 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3798999999999999e-05 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254659+0000", 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2626000000000001e-05 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37881 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5699955379999997, 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045722411999999997, 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37881 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209091+0000", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4700000000000008e-06 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209099+0000", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209104+0000", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.541e-06 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254679+0000", 2024-04-23T23:38:19.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045574605999999997 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254732+0000", 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3081000000000002e-05 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254803+0000", 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0926999999999994e-05 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.821 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37882 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1400832~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5699473309999998, 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045814737000000001, 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37882 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:19.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209136+0000", 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1380000000000004e-06 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209145+0000", 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0119999999999994e-06 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209150+0000", 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5759999999999996e-06 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254835+0000", 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045685022999999998 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254884+0000", 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8758999999999999e-05 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254944+0000", 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9620000000000002e-05 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37883 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5699171759999997, 2024-04-23T23:38:19.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991057000000002, 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37883 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2399999999999998e-07 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209168+0000", 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5469999999999997e-06 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209175+0000", 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1910000000000003e-06 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209180+0000", 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9699999999999998e-06 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254987+0000", 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806988 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255056+0000", 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8942000000000005e-05 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255150+0000", 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3894999999999995e-05 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37884 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1441792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:19.829 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.569884922, 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.04609659, 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37884 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:19.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210975+0000", 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017842330000000001 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210980+0000", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1010000000000002e-06 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210991+0000", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1173e-05 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211005+0000", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4579999999999999e-05 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255182+0000", 2024-04-23T23:38:19.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.044176766999999999 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255231+0000", 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8928999999999999e-05 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255288+0000", 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6807e-05 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37944 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 53248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5678697330000002, 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045325582000000003, 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37944 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211207+0000", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211209+0000", 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211216+0000", 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211227+0000", 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1769e-05 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256438+0000", 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045210798000000003 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256480+0000", 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1458000000000002e-05 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256532+0000", 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2441999999999997e-05 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.837 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37945 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5678420290000004, 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045467075000000003, 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37945 2024-04-23T23:38:19.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212977+0000", 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017429780000000001 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212984+0000", 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0999999999999998e-06 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212993+0000", 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212999+0000", 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.784e-06 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256567+0000", 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043567620000000001 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256618+0000", 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1518999999999999e-05 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256701+0000", 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2922000000000003e-05 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37956 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 299008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5658391780000001, 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045237267999999997, 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37956 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214975+0000", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001738131 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214980+0000", 2024-04-23T23:38:19.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4580000000000003e-06 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214988+0000", 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4470000000000006e-06 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214993+0000", 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258367+0000", 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043374366999999997 2024-04-23T23:38:19.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258414+0000", 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6390000000000001e-05 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258474+0000", 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0609000000000002e-05 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37967 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 524288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:19.845 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5639339000000003, 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045227928000000001, 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37967 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216974+0000", 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018321850000000001 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216978+0000", 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.208e-06 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216985+0000", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2529999999999998e-06 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216990+0000", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260276+0000", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043285591999999998 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:19.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260319+0000", 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2654000000000002e-05 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260370+0000", 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1486999999999997e-05 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:19.849 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:19.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:19.851 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:19.862+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:19.925 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-04-23T23:38:19.951 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:19.963+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:19.967 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:19.967 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:19.976 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:20.031 INFO:teuthology.orchestra.run.smithi077.stdout:2551 read 0x371157 thru 0x37d7f0 (0xc69a bytes) 2024-04-23T23:38:20.033 INFO:teuthology.orchestra.run.smithi077.stdout:2552 write 0x45788b thru 0x45c37c (0x4af2 bytes) 2024-04-23T23:38:20.047 INFO:teuthology.orchestra.run.smithi077.stdout:2553 trunc from 0x45049ba to 0x93fcda9 2024-04-23T23:38:20.052 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:20.064+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:20.058 INFO:teuthology.orchestra.run.smithi077.stdout:2554 trunc from 0x93fcda9 to 0xdc0ebbb 2024-04-23T23:38:20.069 INFO:teuthology.orchestra.run.smithi077.stdout:2556 writesame 0xdd14aa0 thru 0xdd1dd81 data_size 0x12(0x92e2 bytes) 2024-04-23T23:38:20.080 INFO:teuthology.orchestra.run.smithi077.stdout:2557 trunc from 0xdd1dd82 to 0x40601c7 2024-04-23T23:38:20.084 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:20.084 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:20.084 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:20.084 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:20.084 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:20.094 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:20.102 INFO:teuthology.orchestra.run.smithi077.stdout:2558 write 0x8e741b9 thru 0x8e7568c (0x14d4 bytes) 2024-04-23T23:38:20.105 INFO:teuthology.orchestra.run.smithi077.stdout:2559 write 0x4d2e980 thru 0x4d38a06 (0xa087 bytes) 2024-04-23T23:38:20.108 INFO:teuthology.orchestra.run.smithi077.stdout:2560 write 0x6a57e3d thru 0x6a5ce11 (0x4fd5 bytes) 2024-04-23T23:38:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:2562 read 0x6bac1e0 thru 0x6bbb37e (0xf19f bytes) 2024-04-23T23:38:20.111 INFO:teuthology.orchestra.run.smithi077.stdout:2563 write 0x7e5a302 thru 0x7e6459f (0xa29e bytes) 2024-04-23T23:38:20.115 INFO:teuthology.orchestra.run.smithi077.stdout:2564 writesame 0x8d46051 thru 0x8d4fd8f data_size 0x53(0x9d3f bytes) 2024-04-23T23:38:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:2565 read 0x5d6e569 thru 0x5d77a23 (0x94bb bytes) 2024-04-23T23:38:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:2568 read 0x49f20a5 thru 0x49f316c (0x10c8 bytes) 2024-04-23T23:38:20.118 INFO:teuthology.orchestra.run.smithi077.stdout:2569 write 0x4d5c4f3 thru 0x4d6a6ba (0xe1c8 bytes) 2024-04-23T23:38:20.121 INFO:teuthology.orchestra.run.smithi077.stdout:2570 write 0x32b7768 thru 0x32bba2d (0x42c6 bytes) 2024-04-23T23:38:20.125 INFO:teuthology.orchestra.run.smithi077.stdout:2572 write 0x4172e12 thru 0x4173c60 (0xe4f bytes) 2024-04-23T23:38:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:2573 punch from 0x4d16966 to 0x4d23a04, (0xd09e bytes) 2024-04-23T23:38:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:2574 read 0x41c76 thru 0x46644 (0x49cf bytes) 2024-04-23T23:38:20.128 INFO:teuthology.orchestra.run.smithi077.stdout:2575 read 0x242cebb thru 0x2437d4b (0xae91 bytes) 2024-04-23T23:38:20.134 INFO:teuthology.orchestra.run.smithi077.stdout:2576 trunc from 0x8e7568d to 0x45bb5b9 2024-04-23T23:38:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:2578 read 0x2ae8435 thru 0x2af5f4d (0xdb19 bytes) 2024-04-23T23:38:20.145 INFO:teuthology.orchestra.run.smithi077.stdout:2579 clone 19 order 23 su 4194304 sc 9 2024-04-23T23:38:20.154 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:20.166+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:20.240 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.262664115, 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:38:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:38:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:38:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:38:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33566 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12025856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005606084, 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047296019000000002, 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33566 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245971+0000", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245973+0000", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245979+0000", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245984+0000", 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293076+0000", 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047091597999999998 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293164+0000", 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7928000000000002e-05 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293266+0000", 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102247 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.00558536, 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:38:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:38:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005543028, 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:38:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005520428000001, 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:38:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005495341, 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:38:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:38:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005474004, 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:38:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:38:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005452956999999, 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:38:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.005248502000001, 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.004915103, 2024-04-23T23:38:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:38:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:38:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.004889207, 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:38:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.004492275, 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.004455949, 2024-04-23T23:38:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.004067591, 2024-04-23T23:38:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.00404219, 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.001881795999999, 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.001861192, 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.001840844, 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.001821164000001, 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9998177080000001, 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.325 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:20.326 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:20.327 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:20.339+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:20.427 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:20.440+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:20.428 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:20.429 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:20.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:20.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:20.528 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:20.540+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:20.539 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:20.539 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:20.548 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:20.610 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:20.611 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:20.629 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:20.633 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:20.645+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:20.645 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:20.645 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:20.661 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:20.661 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:20.678 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:20.679 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:20.693 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13704 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 432128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.795108861999999, 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030259801999999999, 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13704 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909423+0000", 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909426+0000", 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8320000000000002e-06 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909432+0000", 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1090000000000003e-06 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909443+0000", 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1014e-05 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939489+0000", 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030046209000000001 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939570+0000", 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1037000000000004e-05 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939682+0000", 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011209000000000001 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.794140363, 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.794106161999999, 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.794072572000001, 2024-04-23T23:38:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.794035037, 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.794011501, 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792622285, 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792593898, 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792571589000001, 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792403365999998, 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792354639999999, 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792259444999999, 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792227494999999, 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792205195000001, 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792174999, 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.792015234000001, 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.791979614999999, 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.791880333999998, 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.791850768, 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.791828343999999, 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:20.783 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:20.784 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:20.785 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:20.785 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:20.786 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:20.786 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:20.787 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:20.787 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:20.796+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:20.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:38:20.885 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:20.897+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:20.928 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:20.928 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:20.936 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:20.987 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:20.999+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:20.989 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 4, 5, 6, 7] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:20.989 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:20.989 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 4, 5, 6, 7] 2024-04-23T23:38:20.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-04-23T23:38:21.062 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone18 from 0x45bb5b9 (overlap 0x40601c7) to 0xce005b 2024-04-23T23:38:21.088 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:21.099+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:21.099 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.099 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.112 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:21.196 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:21.208+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:21.254 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-04-23T23:38:21.275 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.275 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.285 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:21.290 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:21.302+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:21.349 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:38:21.361+0000 7f7374a68640 -1 mon.a@0(leader).osd e58 definitely_dead 0 2024-04-23T23:38:21.351 INFO:teuthology.orchestra.run.smithi077.stdout:2580 write 0x77521d4 thru 0x7758985 (0x67b2 bytes) 2024-04-23T23:38:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:2582 punch from 0x670e89 to 0x67c801, (0xb978 bytes) 2024-04-23T23:38:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:2584 punch from 0x5270d37 to 0x527e08e, (0xd357 bytes) 2024-04-23T23:38:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:2585 punch from 0x740aa50 to 0x741869d, (0xdc4d bytes) 2024-04-23T23:38:21.355 INFO:teuthology.orchestra.run.smithi077.stdout:2586 write 0x6a0a029 thru 0x6a12d55 (0x8d2d bytes) 2024-04-23T23:38:21.366 INFO:teuthology.orchestra.run.smithi077.stdout:2588 trunc from 0x7758986 to 0xe734871 2024-04-23T23:38:21.380 INFO:teuthology.orchestra.run.smithi077.stdout:2589 trunc from 0xe734871 to 0x72a8dda 2024-04-23T23:38:21.388 INFO:teuthology.orchestra.run.smithi077.stdout:2592 writesame 0x66b181b thru 0x66bf4bc data_size 0x1f(0xdca2 bytes) 2024-04-23T23:38:21.391 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:21.402+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:21.398 INFO:teuthology.orchestra.run.smithi077.stdout:2593 trunc from 0x72a8dda to 0xeb8172 2024-04-23T23:38:21.441 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.441 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.455 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:21.475 INFO:teuthology.orchestra.run.smithi077.stdout:2594 write 0x145b73d thru 0x1462d10 (0x75d4 bytes) 2024-04-23T23:38:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:2595 read 0x10e1d11 thru 0x10e62b8 (0x45a8 bytes) 2024-04-23T23:38:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:2596 punch from 0x29020e to 0x29cad1, (0xc8c3 bytes) 2024-04-23T23:38:21.479 INFO:teuthology.orchestra.run.smithi077.stdout:2598 flatten 2024-04-23T23:38:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:21.485 INFO:teuthology.orchestra.run.smithi077.stdout:2605 read 0xa568cc thru 0xa5a51c (0x3c51 bytes) 2024-04-23T23:38:21.486 INFO:teuthology.orchestra.run.smithi077.stdout:2607 write 0x81ca3e thru 0x821090 (0x4653 bytes) 2024-04-23T23:38:21.492 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:21.504+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:21.494 INFO:teuthology.orchestra.run.smithi077.stdout:2609 trunc from 0x1462d11 to 0x736b1ff 2024-04-23T23:38:21.500 INFO:teuthology.orchestra.run.smithi077.stdout:2610 write 0x70e502 thru 0x711980 (0x347f bytes) 2024-04-23T23:38:21.502 INFO:teuthology.orchestra.run.smithi077.stdout:2611 clone 20 order 22 su 131072 sc 12 2024-04-23T23:38:21.592 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:21.605+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:21.598 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.598 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.607 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:21.693 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:21.706+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:21.708 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.708 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:21.794 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:21.806+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.820 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:21.913 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:21.925+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:21.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:21.998 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:38:21.999 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:22.011+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:22.004 INFO:teuthology.orchestra.run.smithi077.stderr:marked out osd.4. 2024-04-23T23:38:22.097 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:22.108+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:22.197 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:22.209+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.216 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:22.309 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:22.321+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:22.366 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.367 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:22.398 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:22.410+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:22.499 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:22.511+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:22.600 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:22.613+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.627 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:22.702 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:22.714+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.778 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:22.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:22.803 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:22.815+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:22.893 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:22.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:22.903 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:22.915+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:22.908 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:22.908 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:22.926 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:22.926 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:22.943 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:22.943 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:22.961 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:22.961 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:22.979 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:22.980 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:22.997 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:22.998 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:23.006 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:23.017+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:23.014 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:23.014 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:23.014 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:23.022 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:23.022 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:23.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:23.040 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:23.106 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:23.118+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:23.142 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:23.142 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:23.142 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:23.142 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:23.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:23.207 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:23.219+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:23.253 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37869 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0576058590000006, 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045333998, 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.254 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37869 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:23.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207482+0000", 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8299999999999995e-07 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207485+0000", 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9620000000000002e-06 2024-04-23T23:38:23.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207488+0000", 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6800000000000002e-06 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252696+0000", 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045208527999999998 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252756+0000", 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9828999999999999e-05 2024-04-23T23:38:23.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252815+0000", 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8900999999999997e-05 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37870 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1155072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0575943080000005, 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045543751, 2024-04-23T23:38:23.258 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37870 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207493+0000", 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8799999999999998e-07 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207501+0000", 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0269999999999995e-06 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207507+0000", 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207512+0000", 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6909999999999996e-06 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252853+0000", 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045341765999999999 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252932+0000", 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8846999999999999e-05 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253036+0000", 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103788 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37871 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.262 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0575666019999996, 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045672261999999998, 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37871 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:23.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207521+0000", 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.44e-07 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207523+0000", 2024-04-23T23:38:23.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207529+0000", 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2999999999999998e-06 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207533+0000", 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5029999999999999e-06 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253082+0000", 2024-04-23T23:38:23.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045548271000000001 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253139+0000", 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7237000000000001e-05 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253192+0000", 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3470000000000001e-05 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37872 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1196032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0575472510000008, 2024-04-23T23:38:23.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806959000000001, 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37872 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207540+0000", 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207542+0000", 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7749999999999999e-06 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207546+0000", 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8239999999999999e-06 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207553+0000", 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253231+0000", 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045677698000000003 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253276+0000", 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5238000000000003e-05 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253346+0000", 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0234000000000006e-05 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37873 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0575294619999998, 2024-04-23T23:38:23.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046012472999999998, 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37873 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207558+0000", 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:38:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207559+0000", 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4610000000000001e-06 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207565+0000", 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0700000000000003e-06 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207569+0000", 2024-04-23T23:38:23.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.189e-06 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253392+0000", 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045822300000000003 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253471+0000", 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9354e-05 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253570+0000", 2024-04-23T23:38:23.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8748999999999999e-05 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37874 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1236992~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0575107090000007, 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046114845000000002, 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.277 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37874 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.46e-07 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207578+0000", 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207584+0000", 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2249999999999997e-06 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207589+0000", 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253602+0000", 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046013314 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253641+0000", 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8980000000000003e-05 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253691+0000", 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9503999999999999e-05 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37875 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0574916160000001, 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046215125000000003, 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37875 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:23.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207597+0000", 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.632e-06 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207603+0000", 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207614+0000", 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1326e-05 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253723+0000", 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046108359000000002 2024-04-23T23:38:23.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253761+0000", 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8124999999999998e-05 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253810+0000", 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9431000000000002e-05 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37876 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1277952~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0574661340000002, 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046358498999999997, 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37876 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207826+0000", 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00020521100000000001 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207829+0000", 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4259999999999999e-06 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207839+0000", 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0229e-05 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207847+0000", 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253839+0000", 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991727000000003 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253887+0000", 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8353999999999998e-05 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253979+0000", 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.187e-05 2024-04-23T23:38:23.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37877 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0572292250000004, 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046312513999999999, 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.290 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37877 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:23.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208979+0000", 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011215649999999999 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208984+0000", 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208994+0000", 2024-04-23T23:38:23.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0223e-05 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209001+0000", 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0570000000000004e-06 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254010+0000", 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045008632999999999 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254075+0000", 2024-04-23T23:38:23.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5227000000000004e-05 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254170+0000", 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5038999999999996e-05 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37878 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1318912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0560737109999998, 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045355536000000002, 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37878 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.295 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209016+0000", 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209023+0000", 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8000000000000001e-06 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209028+0000", 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.575e-06 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254215+0000", 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045186357000000003 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254284+0000", 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9089000000000002e-05 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254368+0000", 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4845000000000005e-05 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37879 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.299 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0560510579999995, 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045494123999999997, 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37879 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:23.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209038+0000", 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8449999999999999e-06 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209045+0000", 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8009999999999998e-06 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209050+0000", 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254409+0000", 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045358974000000003 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254462+0000", 2024-04-23T23:38:23.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2913e-05 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254530+0000", 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7968999999999999e-05 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37880 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:23.304 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0560301120000002, 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045602333000000002, 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37880 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209059+0000", 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.792e-06 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209068+0000", 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5559999999999996e-06 2024-04-23T23:38:23.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209074+0000", 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5060000000000003e-06 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254562+0000", 2024-04-23T23:38:23.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045488622999999999 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254606+0000", 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3798999999999999e-05 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254659+0000", 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2626000000000001e-05 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37881 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0560060559999993, 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045722411999999997, 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.310 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37881 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209091+0000", 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4700000000000008e-06 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209099+0000", 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209104+0000", 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.541e-06 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254679+0000", 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045574605999999997 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254732+0000", 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3081000000000002e-05 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254803+0000", 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0926999999999994e-05 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37882 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1400832~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0559578490000003, 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045814737000000001, 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37882 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:38:23.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209136+0000", 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1380000000000004e-06 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209145+0000", 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0119999999999994e-06 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209150+0000", 2024-04-23T23:38:23.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5759999999999996e-06 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254835+0000", 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045685022999999998 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254884+0000", 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8758999999999999e-05 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254944+0000", 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9620000000000002e-05 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37883 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0559276939999993, 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991057000000002, 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.319 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37883 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2399999999999998e-07 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209168+0000", 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5469999999999997e-06 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209175+0000", 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1910000000000003e-06 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209180+0000", 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9699999999999998e-06 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254987+0000", 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806988 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255056+0000", 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8942000000000005e-05 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255150+0000", 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3894999999999995e-05 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37884 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1441792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0558954400000005, 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.04609659, 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37884 2024-04-23T23:38:23.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210975+0000", 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017842330000000001 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210980+0000", 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1010000000000002e-06 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210991+0000", 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1173e-05 2024-04-23T23:38:23.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211005+0000", 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4579999999999999e-05 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255182+0000", 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.044176766999999999 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255231+0000", 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8928999999999999e-05 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255288+0000", 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6807e-05 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.329 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37944 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 53248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0538802510000007, 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045325582000000003, 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37944 2024-04-23T23:38:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211207+0000", 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211209+0000", 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211216+0000", 2024-04-23T23:38:23.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211227+0000", 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1769e-05 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256438+0000", 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045210798000000003 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256480+0000", 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1458000000000002e-05 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256532+0000", 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2441999999999997e-05 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37945 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.053852547, 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045467075000000003, 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37945 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.335 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212977+0000", 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017429780000000001 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212984+0000", 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0999999999999998e-06 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212993+0000", 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212999+0000", 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.784e-06 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256567+0000", 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043567620000000001 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256618+0000", 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1518999999999999e-05 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256701+0000", 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2922000000000003e-05 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37956 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 299008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.339 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0518496959999997, 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045237267999999997, 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37956 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.340 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214975+0000", 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001738131 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214980+0000", 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4580000000000003e-06 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214988+0000", 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4470000000000006e-06 2024-04-23T23:38:23.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214993+0000", 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258367+0000", 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043374366999999997 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258414+0000", 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6390000000000001e-05 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258474+0000", 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0609000000000002e-05 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37967 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 524288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0499444180000008, 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045227928000000001, 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37967 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.345 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216974+0000", 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018321850000000001 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216978+0000", 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.208e-06 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216985+0000", 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2529999999999998e-06 2024-04-23T23:38:23.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216990+0000", 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260276+0000", 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043285591999999998 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260319+0000", 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2654000000000002e-05 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260370+0000", 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1486999999999997e-05 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:23.349 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:23.351 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:23.352 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:23.363+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:23.452 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:23.463+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:23.465 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:23.465 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:23.465 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:23.465 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:23.474 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:23.553 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:23.565+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:23.578 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:23.578 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:23.579 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:23.579 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:23.579 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:23.587 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:23.654 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:23.665+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.713084000999999, 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:38:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:38:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:38:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33566 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12025856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.456025970000001, 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047296019000000002, 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33566 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245971+0000", 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:38:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245973+0000", 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245979+0000", 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245984+0000", 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293076+0000", 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047091597999999998 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293164+0000", 2024-04-23T23:38:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7928000000000002e-05 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293266+0000", 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102247 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.456005246, 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:38:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455962914000001, 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:38:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455940313999999, 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:38:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455915227, 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:38:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.45589389, 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:38:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455872843, 2024-04-23T23:38:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:38:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455668387999999, 2024-04-23T23:38:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:38:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455334989000001, 2024-04-23T23:38:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:38:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.455309093, 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:38:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.454912160999999, 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:38:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.454875834999999, 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:38:23.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:38:23.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.454487477000001, 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.759 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:38:23.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.454462076, 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.764 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:38:23.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.452301682, 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:23.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:38:23.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.452281078, 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:38:23.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:38:23.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.452260730000001, 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:38:23.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.783 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.45224105, 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:38:23.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:38:23.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.450237594000001, 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:23.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:23.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:38:23.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.794 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:23.794 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:23.794 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:23.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:23.796 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:23.807+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:23.897 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:23.908+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:23.939 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:23.939 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:23.939 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:23.939 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:23.948 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:24.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:38:24.032 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:24.044+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:24.099 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:24.110+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:24.116 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:24.116 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:24.116 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:24.116 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:24.116 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:24.125 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:24.210 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:24.222+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-04-23T23:38:24.263 INFO:teuthology.orchestra.run.smithi077.stdout:2613 write 0x1dbb55c thru 0x1dc79c2 (0xc467 bytes) 2024-04-23T23:38:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:2614 punch from 0x1d3d6a5 to 0x1d4a5c0, (0xcf1b bytes) 2024-04-23T23:38:24.285 INFO:teuthology.orchestra.run.smithi077.stdout:2615 punch from 0x545dd58 to 0x5468415, (0xa6bd bytes) 2024-04-23T23:38:24.292 INFO:teuthology.orchestra.run.smithi077.stdout:2616 write 0x81b3612 thru 0x81b7f76 (0x4965 bytes) 2024-04-23T23:38:24.300 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:24.311+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:2617 writesame 0xb3a5396 thru 0xb3b2038 data_size 0x1(0xcca3 bytes) 2024-04-23T23:38:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:2618 read 0x6d37e4d thru 0x6d3e3e2 (0x6596 bytes) 2024-04-23T23:38:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:2619 write 0x77c2454 thru 0x77c3585 (0x1132 bytes) 2024-04-23T23:38:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:2620 punch from 0x18eb75f to 0x18f5d25, (0xa5c6 bytes) 2024-04-23T23:38:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.309 INFO:teuthology.orchestra.run.smithi077.stdout:2623 read 0x29b2696 thru 0x29c04b8 (0xde23 bytes) 2024-04-23T23:38:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:2625 punch from 0x52a7cda to 0x52af0e6, (0x740c bytes) 2024-04-23T23:38:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:2626 punch from 0x3947ddc to 0x3954a16, (0xcc3a bytes) 2024-04-23T23:38:24.310 INFO:teuthology.orchestra.run.smithi077.stdout:2627 punch from 0x531b81d to 0x53259ba, (0xa19d bytes) 2024-04-23T23:38:24.310 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13704 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 432128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.409586471000001, 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030259801999999999, 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13704 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909423+0000", 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909426+0000", 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8320000000000002e-06 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909432+0000", 2024-04-23T23:38:24.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1090000000000003e-06 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909443+0000", 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1014e-05 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939489+0000", 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030046209000000001 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939570+0000", 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1037000000000004e-05 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939682+0000", 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011209000000000001 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:24.315 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.408617971999998, 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:24.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:24.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.408583771, 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.320 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:24.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.408550180999999, 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.324 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:24.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:24.328 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.408512645999998, 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:24.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.408489110000001, 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:24.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:24.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:24.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.407099894000002, 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:24.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:24.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.407071507000001, 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:24.341 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.345 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.407049197999999, 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.349 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406880975, 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.350 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406832249000001, 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.354 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406737054000001, 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:24.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:24.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:24.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406705104, 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.363 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:24.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:24.367 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406682803999999, 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:24.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:24.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:24.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406652608000002, 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.376 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406492842999999, 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406457224, 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406357943, 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406328377000001, 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.406305953, 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.398 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:24.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:2628 trunc from 0xb3b2039 to 0x979287c 2024-04-23T23:38:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:2629 read 0x18ca237 thru 0x18d648c (0xc256 bytes) 2024-04-23T23:38:24.401 INFO:teuthology.orchestra.run.smithi077.stdout:2630 punch from 0x9456077 to 0x9465a0e, (0xf997 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2633 read 0x19bb5ee thru 0x19c4eac (0x98bf bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2635 punch from 0xd6e3b6 to 0xd77cdb, (0x9925 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2636 read 0x3de4d93 thru 0x3df2637 (0xd8a5 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2638 write 0x54ee9c8 thru 0x54f6980 (0x7fb9 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2639 writesame 0x704c40 thru 0x70d4e5 data_size 0x1(0x88a6 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2640 read 0x8ec8147 thru 0x8ed59b3 (0xd86d bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2642 write 0x9d90e1 thru 0x9e4fd8 (0xbef8 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2645 write 0x5c3a18c thru 0x5c49133 (0xefa8 bytes) 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.402 INFO:teuthology.orchestra.run.smithi077.stdout:2648 writesame 0xe08908b thru 0xe0947a0 data_size 0xa(0xb716 bytes) 2024-04-23T23:38:24.403 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:24.415+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:24.404 INFO:teuthology.orchestra.run.smithi077.stdout:2649 trunc from 0xe0947a1 to 0x27a1226 2024-04-23T23:38:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:2651 read 0x1939ee6 thru 0x1945627 (0xb742 bytes) 2024-04-23T23:38:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:2654 write 0xdcaace6 thru 0xdcb6418 (0xb733 bytes) 2024-04-23T23:38:24.488 INFO:teuthology.orchestra.run.smithi077.stdout:2655 write 0x753a644 thru 0x7546a3a (0xc3f7 bytes) 2024-04-23T23:38:24.493 INFO:teuthology.orchestra.run.smithi077.stdout:2656 writesame 0x7de1073 thru 0x7de75fb data_size 0x11(0x6589 bytes) 2024-04-23T23:38:24.496 INFO:teuthology.orchestra.run.smithi077.stdout:2657 write 0x3a04a5a thru 0x3a06302 (0x18a9 bytes) 2024-04-23T23:38:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:2659 punch from 0x1730fc7 to 0x173d9c3, (0xc9fc bytes) 2024-04-23T23:38:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.500 INFO:teuthology.orchestra.run.smithi077.stdout:2661 write 0x3916dd9 thru 0x3923d27 (0xcf4f bytes) 2024-04-23T23:38:24.504 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:24.516+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:2662 punch from 0x4f15f9a to 0x4f2392f, (0xd995 bytes) 2024-04-23T23:38:24.506 INFO:teuthology.orchestra.run.smithi077.stdout:2663 write 0x6af1806 thru 0x6afb707 (0x9f02 bytes) 2024-04-23T23:38:24.509 INFO:teuthology.orchestra.run.smithi077.stdout:2664 read 0x471891e thru 0x4725686 (0xcd69 bytes) 2024-04-23T23:38:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:2665 write 0xe1c475f thru 0xe1c6b7b (0x241d bytes) 2024-04-23T23:38:24.519 INFO:teuthology.orchestra.run.smithi077.stdout:2666 writesame 0x1755bfe thru 0x175fdcb data_size 0x2(0xa1ce bytes) 2024-04-23T23:38:24.530 INFO:teuthology.orchestra.run.smithi077.stdout:2667 write 0x118265e thru 0x1187f0a (0x58ad bytes) 2024-04-23T23:38:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:2669 read 0x6d716e7 thru 0x6d7edcc (0xd6e6 bytes) 2024-04-23T23:38:24.532 INFO:teuthology.orchestra.run.smithi077.stdout:2670 write 0x2ef2df5 thru 0x2efb7c7 (0x89d3 bytes) 2024-04-23T23:38:24.534 INFO:teuthology.orchestra.run.smithi077.stdout:2672 writesame 0x65c6e8d thru 0x65d2f9a data_size 0x3(0xc10e bytes) 2024-04-23T23:38:24.562 INFO:teuthology.orchestra.run.smithi077.stdout:2673 trunc from 0xe1c6b7c to 0x144c42 2024-04-23T23:38:24.582 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:24.582 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:24.582 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:24.582 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:24.593 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:2675 trunc from 0x144c42 to 0x8647b55 2024-04-23T23:38:24.605 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:24.617+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:24.610 INFO:teuthology.orchestra.run.smithi077.stdout:2676 write 0xd7c6057 thru 0xd7d1a7a (0xba24 bytes) 2024-04-23T23:38:24.613 INFO:teuthology.orchestra.run.smithi077.stdout:2677 read 0x151ade5 thru 0x1524009 (0x9225 bytes) 2024-04-23T23:38:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:2678 write 0xaac0aca thru 0xaac3453 (0x298a bytes) 2024-04-23T23:38:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:2679 read 0x3d6327f thru 0x3d70454 (0xd1d6 bytes) 2024-04-23T23:38:24.622 INFO:teuthology.orchestra.run.smithi077.stdout:2682 trunc from 0xd7d1a7b to 0x8d6bb9c 2024-04-23T23:38:24.639 INFO:teuthology.orchestra.run.smithi077.stdout:2683 trunc from 0x8d6bb9c to 0xeb2475d 2024-04-23T23:38:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:2688 write 0x9d668d0 thru 0x9d7015b (0x988c bytes) 2024-04-23T23:38:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:2689 write 0x904536a thru 0x9046df0 (0x1a87 bytes) 2024-04-23T23:38:24.651 INFO:teuthology.orchestra.run.smithi077.stdout:2690 write 0x259e597 thru 0x25a9df9 (0xb863 bytes) 2024-04-23T23:38:24.653 INFO:teuthology.orchestra.run.smithi077.stdout:2693 write 0x1c3e16b thru 0x1c4a694 (0xc52a bytes) 2024-04-23T23:38:24.654 INFO:teuthology.orchestra.run.smithi077.stdout:2694 write 0xc18d1d0 thru 0xc18f71b (0x254c bytes) 2024-04-23T23:38:24.662 INFO:teuthology.orchestra.run.smithi077.stdout:2695 write 0x5a5593 thru 0x5af141 (0x9baf bytes) 2024-04-23T23:38:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:2697 punch from 0x49398ae to 0x4940c02, (0x7354 bytes) 2024-04-23T23:38:24.664 INFO:teuthology.orchestra.run.smithi077.stdout:2699 punch from 0x7ad527 to 0x7ae089, (0xb62 bytes) 2024-04-23T23:38:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:2700 trunc from 0xeb2475d to 0xb58afc 2024-04-23T23:38:24.705 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:24.717+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:2705 writesame 0x710f3ca thru 0x7111548 data_size 0x23(0x217f bytes) 2024-04-23T23:38:24.714 INFO:teuthology.orchestra.run.smithi077.stdout:2706 punch from 0x60f6c0 to 0x613c12, (0x4552 bytes) 2024-04-23T23:38:24.724 INFO:teuthology.orchestra.run.smithi077.stdout:2707 write 0xa3ea813 thru 0xa3f7b41 (0xd32f bytes) 2024-04-23T23:38:24.730 INFO:teuthology.orchestra.run.smithi077.stdout:2708 writesame 0x1f8f1a2 thru 0x1f9d9ad data_size 0x2(0xe80c bytes) 2024-04-23T23:38:24.743 INFO:teuthology.orchestra.run.smithi077.stdout:2709 write 0x59a7f29 thru 0x59ac6e1 (0x47b9 bytes) 2024-04-23T23:38:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:2710 punch from 0xb32cee to 0xb3847a, (0x578c bytes) 2024-04-23T23:38:24.746 INFO:teuthology.orchestra.run.smithi077.stdout:2711 write 0x9c7028e thru 0x9c735b2 (0x3325 bytes) 2024-04-23T23:38:24.749 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:24.749 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:24.749 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:24.749 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:24.749 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:24.752 INFO:teuthology.orchestra.run.smithi077.stdout:2712 trunc from 0xa3f7b42 to 0xda50197 2024-04-23T23:38:24.758 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:2713 read 0x7df652 thru 0x7e369d (0x404c bytes) 2024-04-23T23:38:24.759 INFO:teuthology.orchestra.run.smithi077.stdout:2715 write 0x44c833 thru 0x44fca6 (0x3474 bytes) 2024-04-23T23:38:24.772 INFO:teuthology.orchestra.run.smithi077.stdout:2718 trunc from 0xda50197 to 0x433c9b7 2024-04-23T23:38:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:2719 punch from 0x2bb0594 to 0x2bb2553, (0x1fbf bytes) 2024-04-23T23:38:24.783 INFO:teuthology.orchestra.run.smithi077.stdout:2721 write 0x24d08cd thru 0x24d38a8 (0x2fdc bytes) 2024-04-23T23:38:24.799 INFO:teuthology.orchestra.run.smithi077.stdout:2722 write 0xb422d13 thru 0xb42c804 (0x9af2 bytes) 2024-04-23T23:38:24.802 INFO:teuthology.orchestra.run.smithi077.stdout:2725 write 0x72363a9 thru 0x7245aec (0xf744 bytes) 2024-04-23T23:38:24.806 INFO:teuthology.orchestra.run.smithi077.stdout:2729 write 0xad082ff thru 0xad15c04 (0xd906 bytes) 2024-04-23T23:38:24.806 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:24.818+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.809 INFO:teuthology.orchestra.run.smithi077.stdout:2736 write 0x4afe223 thru 0x4b0defd (0xfcdb bytes) 2024-04-23T23:38:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:2737 read 0x27e7218 thru 0x27f2560 (0xb349 bytes) 2024-04-23T23:38:24.812 INFO:teuthology.orchestra.run.smithi077.stdout:2739 trunc from 0xb42c805 to 0xb18754d 2024-04-23T23:38:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:2740 trunc from 0xb18754d to 0x69f9711 2024-04-23T23:38:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:2741 read 0x6496be4 thru 0x64a0fec (0xa409 bytes) 2024-04-23T23:38:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.835 INFO:teuthology.orchestra.run.smithi077.stdout:2744 punch from 0x4fcfff to 0x50b2b1, (0xe2b2 bytes) 2024-04-23T23:38:24.843 INFO:teuthology.orchestra.run.smithi077.stdout:2745 trunc from 0x69f9711 to 0xcd32441 2024-04-23T23:38:24.848 INFO:teuthology.orchestra.run.smithi077.stdout:2746 read 0x43e14c6 thru 0x43eb541 (0xa07c bytes) 2024-04-23T23:38:24.852 INFO:teuthology.orchestra.run.smithi077.stdout:2747 trunc from 0xcd32441 to 0x9fc3b63 2024-04-23T23:38:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:2748 writesame 0xe6a55c0 thru 0xe6a652b data_size 0x1c(0xf6c bytes) 2024-04-23T23:38:24.870 INFO:teuthology.orchestra.run.smithi077.stdout:2749 write 0x5c52e04 thru 0x5c5f9f5 (0xcbf2 bytes) 2024-04-23T23:38:24.873 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 67.157294368999999, 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:7994 3.13 3:cbf42c78:::rbd_data.1194137ed5d1.0000000000000013:5 [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.424064207999997, 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034041705999999998, 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 7994 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461189+0000", 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5600000000000002e-07 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461190+0000", 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461193+0000", 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0860000000000002e-06 2024-04-23T23:38:24.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461195+0000", 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3800000000000001e-06 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495064+0000", 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033868478 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495146+0000", 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1927000000000004e-05 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495230+0000", 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4598999999999994e-05 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8049 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 302080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423756963999999, 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024337000000002, 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8049 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2200000000000004e-07 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461500+0000", 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6739999999999999e-06 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461508+0000", 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6650000000000003e-06 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461513+0000", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5740000000000003e-06 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495262+0000", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033749023000000003 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495369+0000", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010689200000000001 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000150987 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8050 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 314368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423721724000004, 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034238880999999999, 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8050 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461534+0000", 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3929999999999998e-06 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9460000000000001e-06 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461548+0000", 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9229999999999996e-06 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495572+0000", 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024167000000001 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495663+0000", 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1079e-05 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495770+0000", 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010681800000000001 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8051 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 325632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423677339999998, 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034417270999999999, 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8051 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461576+0000", 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461578+0000", 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.407e-06 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461586+0000", 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0010000000000001e-06 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461592+0000", 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495803+0000", 2024-04-23T23:38:24.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034211245000000001 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495880+0000", 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7002999999999994e-05 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495993+0000", 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112111 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8052 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 337920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423652820999997, 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034632123000000001, 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8052 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.897 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:38:24.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461602+0000", 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461608+0000", 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2269999999999998e-06 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461629+0000", 2024-04-23T23:38:24.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0832999999999999e-05 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496041+0000", 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034411774999999999 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496129+0000", 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8263999999999994e-05 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496232+0000", 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102701 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8053 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 350208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423612241999997, 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034759724999999998, 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8053 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:24.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461641+0000", 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461643+0000", 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5119999999999998e-06 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461663+0000", 2024-04-23T23:38:24.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9483999999999998e-05 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461675+0000", 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1989e-05 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496280+0000", 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034604677 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496329+0000", 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9072e-05 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496400+0000", 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1486e-05 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8054 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 362496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423568269999997, 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034935358, 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8054 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:24.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461685+0000", 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461706+0000", 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1420000000000002e-05 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461717+0000", 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0563e-05 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461723+0000", 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9050000000000002e-06 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496438+0000", 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034714753000000001 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496521+0000", 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.365e-05 2024-04-23T23:38:24.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496620+0000", 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8559000000000003e-05 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8055 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 373760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423509193999998, 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035088333999999999, 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8055 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461744+0000", 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461747+0000", 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5000000000000002e-06 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461771+0000", 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4871999999999998e-05 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461783+0000", 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1762e-05 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496665+0000", 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034881844000000002 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496749+0000", 2024-04-23T23:38:24.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4398000000000001e-05 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496832+0000", 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2367999999999995e-05 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:24.915 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423461971000002, 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:38:24.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.919 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423449181000002, 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:38:24.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423439029000001, 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:38:24.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423423272000001, 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.928 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:24.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423404675999997, 2024-04-23T23:38:24.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:38:24.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.936 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423384943999999, 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:24.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:38:24.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:24.940 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423365011999998, 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:24.944 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423333085000003, 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:38:24.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:38:24.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.948 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423304784999999, 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.952 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423278754000002, 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:38:24.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:38:24.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:38:24.956 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.423258117000003, 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.957 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:24.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.960 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.961 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:24.961 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:24.961 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:24.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:24.963 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:24.973+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:24.964 INFO:teuthology.orchestra.run.smithi077.stdout:2750 read 0xb985e95 thru 0xb98f289 (0x93f5 bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2751 trunc from 0xe6a652c to 0xe0dddb1 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2752 punch from 0x1a3ae94 to 0x1a44595, (0x9701 bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2753 write 0x5226cda thru 0x522e7f5 (0x7b1c bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2755 writesame 0x8002f72 thru 0x8008087 data_size 0x2(0x5116 bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2757 read 0xc6495cb thru 0xc64f2c9 (0x5cff bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2758 read 0x2963390 thru 0x296cbb0 (0x9821 bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2762 trunc from 0xe0dddb1 to 0x86db474 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2763 trunc from 0x86db474 to 0x53e1f09 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2764 write 0x67156c9 thru 0x671e484 (0x8dbc bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2765 write 0xebce905 thru 0xebd7a58 (0x9154 bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:2766 read 0x8aece10 thru 0x8afc0bc (0xf2ad bytes) 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.965 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:2770 read 0x14740ea thru 0x14792d4 (0x51eb bytes) 2024-04-23T23:38:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:2771 read 0xb1c3c25 thru 0xb1ceb63 (0xaf3f bytes) 2024-04-23T23:38:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:2772 trunc from 0xebd7a59 to 0xaa68ab1 2024-04-23T23:38:24.966 INFO:teuthology.orchestra.run.smithi077.stdout:2773 write 0x3cfc312 thru 0x3d060a4 (0x9d93 bytes) 2024-04-23T23:38:24.977 INFO:teuthology.orchestra.run.smithi077.stdout:2775 write 0xe4bdf12 thru 0xe4ca314 (0xc403 bytes) 2024-04-23T23:38:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:2776 trunc from 0xe4ca315 to 0xa16acb7 2024-04-23T23:38:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:2777 read 0x6340965 thru 0x634cb83 (0xc21f bytes) 2024-04-23T23:38:24.995 INFO:teuthology.orchestra.run.smithi077.stdout:2778 read 0x1c98a5e thru 0x1ca6ea1 (0xe444 bytes) 2024-04-23T23:38:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:2779 read 0x8208b38 thru 0x820a137 (0x1600 bytes) 2024-04-23T23:38:24.996 INFO:teuthology.orchestra.run.smithi077.stdout:2780 writesame 0x6fc2758 thru 0x6fd0dff data_size 0x58(0xe6a8 bytes) 2024-04-23T23:38:24.999 INFO:teuthology.orchestra.run.smithi077.stdout:2783 read 0x962aa4c thru 0x9635d71 (0xb326 bytes) 2024-04-23T23:38:25.002 INFO:teuthology.orchestra.run.smithi077.stdout:2784 trunc from 0xa16acb7 to 0xc267ff6 2024-04-23T23:38:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:2786 trunc from 0xc267ff6 to 0x4b2bebf 2024-04-23T23:38:25.024 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:38:25.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:25.080 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:25.092+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:25.110 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:25.110 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:25.110 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:25.110 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:25.118 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:25.164 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:25.175+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:25.198 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:25.198 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:25.215 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:25.215 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:25.221 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:25.222 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:25.230 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:25.231 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:25.232 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:25.248 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:25.248 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:25.265 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:25.277+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:25.265 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:25.265 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:25.283 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:25.283 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:25.300 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:25.300 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:25.318 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:25.318 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:25.370 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:25.382+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:25.374 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:25.374 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:25.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:25.466 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:25.478+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:25.487 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:25.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:25.567 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:25.579+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:25.639 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:25.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:25.692 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:25.704+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:25.750 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:25.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:25.768 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:25.780+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:25.869 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:25.881+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:25.900 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:25.901 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:25.909 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:25.970 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:25.981+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:26.046 INFO:teuthology.orchestra.run.smithi077.stdout:2787 read 0x22b7127 thru 0x22bc70a (0x55e4 bytes) 2024-04-23T23:38:26.055 INFO:teuthology.orchestra.run.smithi077.stdout:2788 write 0x76fdeee thru 0x770dc39 (0xfd4c bytes) 2024-04-23T23:38:26.059 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:26.059 INFO:teuthology.orchestra.run.smithi077.stdout:2791 writesame 0x33ae931 thru 0x33be8b8 data_size 0x34(0xff88 bytes) 2024-04-23T23:38:26.065 INFO:teuthology.orchestra.run.smithi077.stdout:2792 punch from 0x1e01b8f to 0x1e080b3, (0x6524 bytes) 2024-04-23T23:38:26.065 INFO:teuthology.orchestra.run.smithi077.stdout:2794 writesame 0x70e78e4 thru 0x70f695e data_size 0x1(0xf07b bytes) 2024-04-23T23:38:26.070 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:26.082+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:26.106 INFO:teuthology.orchestra.run.smithi077.stdout:2796 write 0x7792f50 thru 0x77a0a1c (0xdacd bytes) 2024-04-23T23:38:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:2798 read 0x55f6c70 thru 0x55f8023 (0x13b4 bytes) 2024-04-23T23:38:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:2799 punch from 0x33a2bb7 to 0x33aabf5, (0x803e bytes) 2024-04-23T23:38:26.110 INFO:teuthology.orchestra.run.smithi077.stdout:2800 write 0x2003b45 thru 0x200d67b (0x9b37 bytes) 2024-04-23T23:38:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:2801 write 0x76c942e thru 0x76d6b53 (0xd726 bytes) 2024-04-23T23:38:26.114 INFO:teuthology.orchestra.run.smithi077.stdout:2804 writesame 0x5daa973 thru 0x5dae151 data_size 0x1(0x37df bytes) 2024-04-23T23:38:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.136 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.137 INFO:teuthology.orchestra.run.smithi077.stdout:2805 writesame 0xe799309 thru 0xe79e9d6 data_size 0x29(0x56ce bytes) 2024-04-23T23:38:26.137 INFO:teuthology.orchestra.run.smithi077.stdout:2806 read 0x6da9697 thru 0x6db596d (0xc2d7 bytes) 2024-04-23T23:38:26.138 INFO:teuthology.orchestra.run.smithi077.stdout:2807 write 0xb140453 thru 0xb1415e6 (0x1194 bytes) 2024-04-23T23:38:26.140 INFO:teuthology.orchestra.run.smithi077.stdout:2808 write 0xa46c019 thru 0xa473a45 (0x7a2d bytes) 2024-04-23T23:38:26.144 INFO:teuthology.orchestra.run.smithi077.stdout:2809 write 0x88d6522 thru 0x88e15b9 (0xb098 bytes) 2024-04-23T23:38:26.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:26.147 INFO:teuthology.orchestra.run.smithi077.stdout:2813 read 0x4bc83eb thru 0x4bd451b (0xc131 bytes) 2024-04-23T23:38:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:2815 read 0x6225b9a thru 0x6230df0 (0xb257 bytes) 2024-04-23T23:38:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:2817 read 0x9fac7b9 thru 0x9fb6212 (0x9a5a bytes) 2024-04-23T23:38:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:2818 read 0xd232514 thru 0xd235399 (0x2e86 bytes) 2024-04-23T23:38:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:26.148 INFO:teuthology.orchestra.run.smithi077.stdout:2820 write 0x3144a03 thru 0x314b4be (0x6abc bytes) 2024-04-23T23:38:26.150 INFO:teuthology.orchestra.run.smithi077.stdout:2821 write 0x874e5 thru 0x937da (0xc2f6 bytes) 2024-04-23T23:38:26.152 INFO:teuthology.orchestra.run.smithi077.stdout:2822 write 0x1692ba8 thru 0x16a0779 (0xdbd2 bytes) 2024-04-23T23:38:26.153 INFO:teuthology.orchestra.run.smithi077.stdout:2825 read 0x340d451 thru 0x340ec4c (0x17fc bytes) 2024-04-23T23:38:26.154 INFO:teuthology.orchestra.run.smithi077.stdout:2826 read 0x12bbbc6 thru 0x12bedc7 (0x3202 bytes) 2024-04-23T23:38:26.159 INFO:teuthology.orchestra.run.smithi077.stdout:2827 trunc from 0xe79e9d7 to 0xa2c5d0c 2024-04-23T23:38:26.166 INFO:teuthology.orchestra.run.smithi077.stdout:2828 write 0x7bc5a0 thru 0x7c75b1 (0xb012 bytes) 2024-04-23T23:38:26.168 INFO:teuthology.orchestra.run.smithi077.stdout:2831 write 0x6f527a5 thru 0x6f541f2 (0x1a4e bytes) 2024-04-23T23:38:26.169 INFO:teuthology.orchestra.run.smithi077.stdout:2832 punch from 0x3433063 to 0x343ef3d, (0xbeda bytes) 2024-04-23T23:38:26.170 INFO:teuthology.orchestra.run.smithi077.stdout:2833 writesame 0x8febaa3 thru 0x8fef3ad data_size 0x1(0x390b bytes) 2024-04-23T23:38:26.171 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:26.182+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:26.179 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:26.179 INFO:teuthology.orchestra.run.smithi077.stdout:2837 punch from 0xa22495c to 0xa231ff2, (0xd696 bytes) 2024-04-23T23:38:26.182 INFO:teuthology.orchestra.run.smithi077.stdout:2838 trunc from 0xa2c5d0c to 0xd04c073 2024-04-23T23:38:26.187 INFO:teuthology.orchestra.run.smithi077.stdout:2839 writesame 0xc1cbb1 thru 0xc22348 data_size 0x8(0x5798 bytes) 2024-04-23T23:38:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:2840 read 0x482163f thru 0x48293da (0x7d9c bytes) 2024-04-23T23:38:26.190 INFO:teuthology.orchestra.run.smithi077.stdout:2841 write 0x6e09149 thru 0x6e133a2 (0xa25a bytes) 2024-04-23T23:38:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:2842 punch from 0x2ecc6df to 0x2ed6aa9, (0xa3ca bytes) 2024-04-23T23:38:26.191 INFO:teuthology.orchestra.run.smithi077.stdout:2843 write 0x6925f09 thru 0x692ca7a (0x6b72 bytes) 2024-04-23T23:38:26.194 INFO:teuthology.orchestra.run.smithi077.stdout:2844 write 0x946153f thru 0x946a939 (0x93fb bytes) 2024-04-23T23:38:26.197 INFO:teuthology.orchestra.run.smithi077.stdout:2845 write 0x2846600 thru 0x284cabd (0x64be bytes) 2024-04-23T23:38:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:2846 read 0xc4d9774 thru 0xc4e6410 (0xcc9d bytes) 2024-04-23T23:38:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:2848 read 0x5546e9d thru 0x554c977 (0x5adb bytes) 2024-04-23T23:38:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:2849 read 0x6b14678 thru 0x6b19651 (0x4fda bytes) 2024-04-23T23:38:26.200 INFO:teuthology.orchestra.run.smithi077.stdout:2851 punch from 0x2ff2399 to 0x2ff9bdc, (0x7843 bytes) 2024-04-23T23:38:26.205 INFO:teuthology.orchestra.run.smithi077.stdout:2854 write 0xd637c79 thru 0xd6401bb (0x8543 bytes) 2024-04-23T23:38:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:26.211 INFO:teuthology.orchestra.run.smithi077.stdout:2858 write 0x3a3fcf0 thru 0x3a4dbdc (0xdeed bytes) 2024-04-23T23:38:26.213 INFO:teuthology.orchestra.run.smithi077.stdout:2859 punch from 0x6621416 to 0x662b179, (0x9d63 bytes) 2024-04-23T23:38:26.226 INFO:teuthology.orchestra.run.smithi077.stdout:2860 trunc from 0xd6401bc to 0x203af71 2024-04-23T23:38:26.249 INFO:teuthology.orchestra.run.smithi077.stdout:2862 read 0xb8e7a8 thru 0xb9af5d (0xc7b6 bytes) 2024-04-23T23:38:26.259 INFO:teuthology.orchestra.run.smithi077.stdout:2863 trunc from 0x203af71 to 0xa3e259e 2024-04-23T23:38:26.263 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.263 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.264 INFO:teuthology.orchestra.run.smithi077.stdout:2864 writesame 0x1f6aaad thru 0x1f76205 data_size 0x11(0xb759 bytes) 2024-04-23T23:38:26.267 INFO:teuthology.orchestra.run.smithi077.stdout:2865 write 0x7ae4a37 thru 0x7af08e7 (0xbeb1 bytes) 2024-04-23T23:38:26.270 INFO:teuthology.orchestra.run.smithi077.stdout:2866 punch from 0x5164f71 to 0x5168beb, (0x3c7a bytes) 2024-04-23T23:38:26.270 INFO:teuthology.orchestra.run.smithi077.stdout:2867 writesame 0x488cfc8 thru 0x4899f71 data_size 0x13(0xcfaa bytes) 2024-04-23T23:38:26.271 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:26.284+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:26.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2868 punch from 0xa2c722e to 0xa2d44a5, (0xd277 bytes) 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2869 read 0x86c1e76 thru 0x86ce823 (0xc9ae bytes) 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2870 read 0x3a72fac thru 0x3a7b68a (0x86df bytes) 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2871 read 0x21037b9 thru 0x21062ad (0x2af5 bytes) 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2872 punch from 0x34f3a5a to 0x34fb35e, (0x7904 bytes) 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2874 read 0x1f7d3ae thru 0x1f7fba6 (0x27f9 bytes) 2024-04-23T23:38:26.275 INFO:teuthology.orchestra.run.smithi077.stdout:2876 write 0x55a9863 thru 0x55aa958 (0x10f6 bytes) 2024-04-23T23:38:26.278 INFO:teuthology.orchestra.run.smithi077.stdout:2877 read 0xa0bf2ec thru 0xa0c0d79 (0x1a8e bytes) 2024-04-23T23:38:26.278 INFO:teuthology.orchestra.run.smithi077.stdout:2878 clone 21 order 25 su 524288 sc 6 2024-04-23T23:38:26.372 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:26.384+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.375 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:26.474 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:26.486+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.527 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:26.575 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:26.587+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:26.677 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:26.689+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:26.678 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.678 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:26.778 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:26.790+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.789 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.798 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:26.880 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:26.892+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:26.940 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:26.948 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:26.993 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:27.005+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:27.024 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [3, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:27.025 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:27.025 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-23T23:38:27.025 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.154658 2024-04-23T23:38:27.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.15465838239876728 2024-04-23T23:38:27.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:38:27.069 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:27.069 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:27.079 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:27.094 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone20 from 0xa3e259e (overlap 0x144c42) to 0x40f40 2024-04-23T23:38:27.094 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:27.106+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:27.163 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-04-23T23:38:27.183 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:27.195+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:27.224 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:27.225 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:27.233 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:27.284 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:27.296+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:27.308 INFO:teuthology.orchestra.run.smithi077.stdout:2879 writesame 0xbe342fd thru 0xbe3fd24 data_size 0x1c(0xba28 bytes) 2024-04-23T23:38:27.319 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.319 INFO:teuthology.orchestra.run.smithi077.stdout:2883 read 0xb5441df thru 0xb5498a9 (0x56cb bytes) 2024-04-23T23:38:27.320 INFO:teuthology.orchestra.run.smithi077.stdout:2884 writesame 0x333d148 thru 0x3340f74 data_size 0x1(0x3e2d bytes) 2024-04-23T23:38:27.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:2886 read 0x647f204 thru 0x648d4ce (0xe2cb bytes) 2024-04-23T23:38:27.335 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:2888 read 0xaf0c28e thru 0xaf0fbd4 (0x3947 bytes) 2024-04-23T23:38:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:2889 read 0x31b72a thru 0x320e5e (0x5735 bytes) 2024-04-23T23:38:27.336 INFO:teuthology.orchestra.run.smithi077.stdout:2892 writesame 0x8412bf6 thru 0x841f37d data_size 0x14(0xc788 bytes) 2024-04-23T23:38:27.338 INFO:teuthology.orchestra.run.smithi077.stdout:2894 punch from 0x814f7ef to 0x8154881, (0x5092 bytes) 2024-04-23T23:38:27.348 INFO:teuthology.orchestra.run.smithi077.stdout:2895 trunc from 0xbe3fd25 to 0x41cd426 2024-04-23T23:38:27.374 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.385 INFO:teuthology.orchestra.run.smithi077.stdout:2898 writesame 0x78b5b7f thru 0x78b9933 data_size 0x1(0x3db5 bytes) 2024-04-23T23:38:27.386 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:27.398+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:27.386 INFO:teuthology.orchestra.run.smithi077.stdout:2899 punch from 0x40ea29 to 0x411929, (0x2f00 bytes) 2024-04-23T23:38:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:2900 trunc from 0x78b9934 to 0xad4509e 2024-04-23T23:38:27.391 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:27.391 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:27.400 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:27.402 INFO:teuthology.orchestra.run.smithi077.stdout:2902 trunc from 0xad4509e to 0x4eeb150 2024-04-23T23:38:27.429 INFO:teuthology.orchestra.run.smithi077.stdout:2903 write 0xdd3ce8c thru 0xdd40c66 (0x3ddb bytes) 2024-04-23T23:38:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:2904 punch from 0x24c7320 to 0x24cea30, (0x7710 bytes) 2024-04-23T23:38:27.433 INFO:teuthology.orchestra.run.smithi077.stdout:2905 writesame 0x93f1df4 thru 0x93feda6 data_size 0x1(0xcfb3 bytes) 2024-04-23T23:38:27.462 INFO:teuthology.orchestra.run.smithi077.stdout:2906 writesame 0xcf3bc28 thru 0xcf480e5 data_size 0x1(0xc4be bytes) 2024-04-23T23:38:27.468 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:27.469 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:27.486 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:27.486 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:27.487 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:27.498+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:27.496 INFO:teuthology.orchestra.run.smithi077.stdout:2907 write 0xe6ac280 thru 0xe6ac2ec (0x6d bytes) 2024-04-23T23:38:27.504 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:27.505 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:27.509 INFO:teuthology.orchestra.run.smithi077.stdout:2909 trunc from 0xe6ac2ed to 0x5e8f6ca 2024-04-23T23:38:27.518 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:27.518 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:27.522 INFO:teuthology.orchestra.run.smithi077.stdout:2911 read 0x8198b9 thru 0x81e93d (0x5085 bytes) 2024-04-23T23:38:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.523 INFO:teuthology.orchestra.run.smithi077.stdout:2913 read 0x593bc9d thru 0x5949f81 (0xe2e5 bytes) 2024-04-23T23:38:27.524 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:27.527 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:27.534 INFO:teuthology.orchestra.run.smithi077.stdout:2915 write 0xb088426 thru 0xb09397a (0xb555 bytes) 2024-04-23T23:38:27.535 INFO:teuthology.orchestra.run.smithi077.stdout:2916 write 0x1d31e3c thru 0x1d35d2d (0x3ef2 bytes) 2024-04-23T23:38:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:2917 read 0x6152f6f thru 0x6159da1 (0x6e33 bytes) 2024-04-23T23:38:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:2918 write 0x1c97eb4 thru 0x1c99d9d (0x1eea bytes) 2024-04-23T23:38:27.538 INFO:teuthology.orchestra.run.smithi077.stdout:2920 punch from 0x3f68fed to 0x3f7330f, (0xa322 bytes) 2024-04-23T23:38:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:2921 punch from 0xa65b3fd to 0xa65e480, (0x3083 bytes) 2024-04-23T23:38:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:2922 read 0x2465e4d thru 0x24730a2 (0xd256 bytes) 2024-04-23T23:38:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:2925 read 0x140ee1d thru 0x141dd1c (0xef00 bytes) 2024-04-23T23:38:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:2927 punch from 0x6e26911 to 0x6e27f53, (0x1642 bytes) 2024-04-23T23:38:27.539 INFO:teuthology.orchestra.run.smithi077.stdout:2929 write 0x6a01e32 thru 0x6a0923d (0x740c bytes) 2024-04-23T23:38:27.541 INFO:teuthology.orchestra.run.smithi077.stdout:2931 punch from 0x2d5fc3f to 0x2d6b6f7, (0xbab8 bytes) 2024-04-23T23:38:27.541 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.543 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:27.543 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:27.547 INFO:teuthology.orchestra.run.smithi077.stdout:2933 trunc from 0xb09397b to 0x575f374 2024-04-23T23:38:27.562 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:27.562 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:2934 write 0xda59924 thru 0xda5d98f (0x406c bytes) 2024-04-23T23:38:27.572 INFO:teuthology.orchestra.run.smithi077.stdout:2935 trunc from 0xda5d990 to 0xea17bcb 2024-04-23T23:38:27.578 INFO:teuthology.orchestra.run.smithi077.stdout:2936 read 0x30f9bf4 thru 0x3102e86 (0x9293 bytes) 2024-04-23T23:38:27.581 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.581 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:27.581 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:27.584 INFO:teuthology.orchestra.run.smithi077.stdout:2938 trunc from 0xea17bcb to 0xa15210c 2024-04-23T23:38:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:2940 read 0x5030858 thru 0x50309c0 (0x169 bytes) 2024-04-23T23:38:27.597 INFO:teuthology.orchestra.run.smithi077.stdout:2941 trunc from 0xa15210c to 0xc22d9ba 2024-04-23T23:38:27.602 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:27.602 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:27.611 INFO:teuthology.orchestra.run.smithi077.stdout:2942 trunc from 0xc22d9ba to 0x64cf7fc 2024-04-23T23:38:27.611 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:27.623+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:27.634 INFO:teuthology.orchestra.run.smithi077.stdout:2943 write 0xc9f93b5 thru 0xca02914 (0x9560 bytes) 2024-04-23T23:38:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:2944 write 0x843463e thru 0x84442a2 (0xfc65 bytes) 2024-04-23T23:38:27.642 INFO:teuthology.orchestra.run.smithi077.stdout:2945 read 0x16ec9ba thru 0x16edef2 (0x1539 bytes) 2024-04-23T23:38:27.648 INFO:teuthology.orchestra.run.smithi077.stdout:2946 writesame 0xdae5bd5 thru 0xdaed4f4 data_size 0x72(0x7920 bytes) 2024-04-23T23:38:27.663 INFO:teuthology.orchestra.run.smithi077.stdout:2947 trunc from 0xdaed4f5 to 0xff5ed4 2024-04-23T23:38:27.676 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:27.676 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:27.677 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:27.677 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:27.677 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:27.681 INFO:teuthology.orchestra.run.smithi077.stdout:2948 punch from 0xbf215e to 0xbf7651, (0x54f3 bytes) 2024-04-23T23:38:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:2949 read 0x61e140 thru 0x6200e7 (0x1fa8 bytes) 2024-04-23T23:38:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:2950 punch from 0xdbb62a to 0xdc876f, (0xd145 bytes) 2024-04-23T23:38:27.682 INFO:teuthology.orchestra.run.smithi077.stdout:truncating to largest ever: 0xee1736d 2024-04-23T23:38:27.686 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:27.698 INFO:teuthology.orchestra.run.smithi077.stdout:2951 trunc from 0xff5ed4 to 0xee1736d 2024-04-23T23:38:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.703 INFO:teuthology.orchestra.run.smithi077.stdout:2955 writesame 0x63d91ca thru 0x63e5dd7 data_size 0x1(0xcc0e bytes) 2024-04-23T23:38:27.726 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:27.738+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:27.728 INFO:teuthology.orchestra.run.smithi077.stdout:2956 writesame 0x1756762 thru 0x176100d data_size 0x7f(0xa8ac bytes) 2024-04-23T23:38:27.730 INFO:teuthology.orchestra.run.smithi077.stdout:2957 read 0x878ac01 thru 0x8793225 (0x8625 bytes) 2024-04-23T23:38:27.731 INFO:teuthology.orchestra.run.smithi077.stdout:2958 write 0x2f0e0e5 thru 0x2f1056f (0x248b bytes) 2024-04-23T23:38:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:2959 read 0x5fe45c1 thru 0x5fe7cee (0x372e bytes) 2024-04-23T23:38:27.732 INFO:teuthology.orchestra.run.smithi077.stdout:2960 writesame 0x9bb61f1 thru 0x9bc06e0 data_size 0x74(0xa4f0 bytes) 2024-04-23T23:38:27.734 INFO:teuthology.orchestra.run.smithi077.stdout:2961 writesame 0x2aa46dd thru 0x2aa9f96 data_size 0x29(0x58ba bytes) 2024-04-23T23:38:27.736 INFO:teuthology.orchestra.run.smithi077.stdout:2962 writesame 0x80d2f09 thru 0x80df9a4 data_size 0x2(0xca9c bytes) 2024-04-23T23:38:27.750 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:27.751 INFO:teuthology.orchestra.run.smithi077.stdout:2964 punch from 0x2b6bf26 to 0x2b73e4b, (0x7f25 bytes) 2024-04-23T23:38:27.751 INFO:teuthology.orchestra.run.smithi077.stdout:2966 write 0x256ee05 thru 0x257ec36 (0xfe32 bytes) 2024-04-23T23:38:27.759 INFO:teuthology.orchestra.run.smithi077.stdout:2967 trunc from 0xee1736d to 0x9ca9504 2024-04-23T23:38:27.768 INFO:teuthology.orchestra.run.smithi077.stdout:2968 clone 22 order 24 su 131072 sc 15 2024-04-23T23:38:27.789 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:27.801+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13704 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 432128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.935146891000002, 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030259801999999999, 2024-04-23T23:38:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13704 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909422+0000", 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909423+0000", 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909426+0000", 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8320000000000002e-06 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909432+0000", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1090000000000003e-06 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.909443+0000", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1014e-05 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939489+0000", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030046209000000001 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939570+0000", 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1037000000000004e-05 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.939682+0000", 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011209000000000001 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.934178392, 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.934144191000001, 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.934110601, 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.934073066000003, 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.934049530000003, 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932660314000003, 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932631927000003, 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932609618000001, 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932441394999998, 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932392669000002, 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932297474000002, 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932265524000002, 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932243223999997, 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932213028, 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932053263, 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.932017643999998, 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.931918363000001, 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.931888796999999, 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.931866372999998, 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:27.915 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.916 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.916 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.916 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:27.916 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:27.916 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:27.917 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:27.918 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:27.929+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:28.018 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:28.030+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:28.031 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.6 primary-affinity to 0.154658 (8101352) 2024-04-23T23:38:28.037 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3.4b589811 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.022926563, 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022943061000000001, 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:38:28.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.068 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:38:28.068 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 1 2024-04-23T23:38:28.068 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:28.073 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:28.157 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:28.169+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:28.217 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:28.217 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:28.217 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:28.217 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:28.217 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:28.219 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:28.231+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:28.226 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:28.320 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:28.332+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:28.371 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:28.371 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:28.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 70.654487954999993, 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:38:28.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:28.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:38:28.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:7994 3.13 3:cbf42c78:::rbd_data.1194137ed5d1.0000000000000013:5 [read 503808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.380 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.921257793999999, 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034041705999999998, 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 7994 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.381 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461188+0000", 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461189+0000", 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5600000000000002e-07 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461190+0000", 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461193+0000", 2024-04-23T23:38:28.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0860000000000002e-06 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461195+0000", 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3800000000000001e-06 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495064+0000", 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033868478 2024-04-23T23:38:28.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495146+0000", 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1927000000000004e-05 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495230+0000", 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4598999999999994e-05 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8049 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 302080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920950550000001, 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024337000000002, 2024-04-23T23:38:28.386 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8049 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:28.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461496+0000", 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2200000000000004e-07 2024-04-23T23:38:28.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461500+0000", 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6739999999999999e-06 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461508+0000", 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6650000000000003e-06 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461513+0000", 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5740000000000003e-06 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495262+0000", 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033749023000000003 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495369+0000", 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010689200000000001 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495520+0000", 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000150987 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8050 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 314368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.392 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920915309999998, 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034238880999999999, 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8050 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:28.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461531+0000", 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461534+0000", 2024-04-23T23:38:28.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3929999999999998e-06 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461541+0000", 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9460000000000001e-06 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461548+0000", 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9229999999999996e-06 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495572+0000", 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034024167000000001 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495663+0000", 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1079e-05 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495770+0000", 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010681800000000001 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8051 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 325632~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920870925999999, 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034417270999999999, 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8051 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461575+0000", 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461576+0000", 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461578+0000", 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.407e-06 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461586+0000", 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0010000000000001e-06 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461592+0000", 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495803+0000", 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034211245000000001 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495880+0000", 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7002999999999994e-05 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.495993+0000", 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000112111 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.400 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8052 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 337920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920846406999999, 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034632123000000001, 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8052 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.401 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461600+0000", 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:38:28.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461602+0000", 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461608+0000", 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2269999999999998e-06 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461629+0000", 2024-04-23T23:38:28.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0832999999999999e-05 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496041+0000", 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034411774999999999 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496129+0000", 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8263999999999994e-05 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496232+0000", 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102701 2024-04-23T23:38:28.404 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8053 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 350208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920805827999999, 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034759724999999998, 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.405 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8053 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461640+0000", 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461641+0000", 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461643+0000", 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5119999999999998e-06 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461663+0000", 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9483999999999998e-05 2024-04-23T23:38:28.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461675+0000", 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1989e-05 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496280+0000", 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034604677 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496329+0000", 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9072e-05 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496400+0000", 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1486e-05 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8054 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 362496~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920761855999999, 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034935358, 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8054 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461684+0000", 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461685+0000", 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461706+0000", 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1420000000000002e-05 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461717+0000", 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0563e-05 2024-04-23T23:38:28.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461723+0000", 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9050000000000002e-06 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496438+0000", 2024-04-23T23:38:28.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034714753000000001 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496521+0000", 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.365e-05 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496620+0000", 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8559000000000003e-05 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8055 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 373760~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920702779999999, 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035088333999999999, 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8055 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461743+0000", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461744+0000", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461747+0000", 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5000000000000002e-06 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461771+0000", 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4871999999999998e-05 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461783+0000", 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1762e-05 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496665+0000", 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034881844000000002 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496749+0000", 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4398000000000001e-05 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496832+0000", 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2367999999999995e-05 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920655557000003, 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:38:28.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:28.423 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920642766999997, 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:28.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:38:28.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.427 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920632615000002, 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.428 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:38:28.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:38:28.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920616858000002, 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.432 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:28.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:38:28.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920598261999999, 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.436 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:28.440 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.92057853, 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:38:28.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920558598, 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.445 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:28.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920526670999998, 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:28.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:38:28.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:38:28.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920498371000001, 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:38:28.453 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.457 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920472340000003, 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.461 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.920451702999998, 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.462 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.466 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:28.468 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:28.468 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:28.480+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:28.569 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:28.580+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:28.611 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:28.611 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:28.612 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:28.612 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:28.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:28.670 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:28.683+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:28.763 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:28.763 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:28.764 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:28.764 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:28.764 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:28.771 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:28.783+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:28.772 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:28.872 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:28.883+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681155689000001, 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.916 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.920 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681133255999999, 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:28.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.924 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681112152000001, 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:28.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:28.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681091868999999, 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.929 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:28.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:28.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:28.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681070300999998, 2024-04-23T23:38:28.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:28.937 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681052702999999, 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:28.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:28.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:28.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.681032128999998, 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.942 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:28.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:28.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:28.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.68100299, 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.946 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.680982315000001, 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.950 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:28.954 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.680959515000001, 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:28.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:28.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.679943093999999, 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:28.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:28.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:28.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.679923439, 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.963 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.679884344000001, 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.967 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:28.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:28.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.971 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.679864553000002, 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:28.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:28.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.679845954000001, 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:28.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.980 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.679809626000001, 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:28.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:28.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:28.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.677627663999999, 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.985 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:28.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:28.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.677617569999999, 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:28.989 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:28.993 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.677601798000001, 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:28.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:28.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:28.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:28.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.677591654, 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.998 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:28.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:29.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:29.001 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:29.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:29.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:29.002 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:29.002 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:29.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:29.004 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:29.016+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:29.104 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:29.116+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:29.107 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone21 from 0x9ca9504 (overlap 0xff5ed4) to 0x9938e5 2024-04-23T23:38:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:29.133 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:29.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-04-23T23:38:29.178 INFO:teuthology.orchestra.run.smithi077.stdout:2969 punch from 0x7251f97 to 0x72567d3, (0x483c bytes) 2024-04-23T23:38:29.181 INFO:teuthology.orchestra.run.smithi077.stdout:2970 write 0x3965444 thru 0x396b401 (0x5fbe bytes) 2024-04-23T23:38:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:2971 punch from 0x2dbde04 to 0x2dc3d1d, (0x5f19 bytes) 2024-04-23T23:38:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:2973 read 0x351707f thru 0x3525c64 (0xebe6 bytes) 2024-04-23T23:38:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:2974 read 0x9901760 thru 0x990443d (0x2cde bytes) 2024-04-23T23:38:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:2975 read 0x11e432a thru 0x11eada1 (0x6a78 bytes) 2024-04-23T23:38:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:2976 write 0xa5a1f4 thru 0xa62153 (0x7f60 bytes) 2024-04-23T23:38:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:2977 read 0x1871ae3 thru 0x1873c1c (0x213a bytes) 2024-04-23T23:38:29.204 INFO:teuthology.orchestra.run.smithi077.stdout:2978 writesame 0x3834e01 thru 0x384144a data_size 0x11(0xc64a bytes) 2024-04-23T23:38:29.205 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:29.217+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:29.219 INFO:teuthology.orchestra.run.smithi077.stdout:2979 writesame 0x1977d5f thru 0x19872ef data_size 0x7f(0xf591 bytes) 2024-04-23T23:38:29.221 INFO:teuthology.orchestra.run.smithi077.stdout:2980 writesame 0x81b4be8 thru 0x81b93ed data_size 0xe(0x4806 bytes) 2024-04-23T23:38:29.230 INFO:teuthology.orchestra.run.smithi077.stdout:2981 write 0x764108a thru 0x764c783 (0xb6fa bytes) 2024-04-23T23:38:29.238 INFO:teuthology.orchestra.run.smithi077.stdout:2982 read 0x7c3c510 thru 0x7c48b9c (0xc68d bytes) 2024-04-23T23:38:29.245 INFO:teuthology.orchestra.run.smithi077.stdout:2983 trunc from 0x9ca9504 to 0x496a68a 2024-04-23T23:38:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:2984 punch from 0x4121b10 to 0x412ea88, (0xcf78 bytes) 2024-04-23T23:38:29.296 INFO:teuthology.orchestra.run.smithi077.stdout:2986 write 0x1c00885 thru 0x1c0a731 (0x9ead bytes) 2024-04-23T23:38:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:2987 punch from 0x3350b2c to 0x335e192, (0xd666 bytes) 2024-04-23T23:38:29.298 INFO:teuthology.orchestra.run.smithi077.stdout:2991 write 0x3529797 thru 0x35355c4 (0xbe2e bytes) 2024-04-23T23:38:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:2992 punch from 0x373b809 to 0x3746130, (0xa927 bytes) 2024-04-23T23:38:29.299 INFO:teuthology.orchestra.run.smithi077.stdout:2993 punch from 0x2ff7998 to 0x3003d9a, (0xc402 bytes) 2024-04-23T23:38:29.305 INFO:teuthology.orchestra.run.smithi077.stdout:2995 write 0x527c78f thru 0x527e7af (0x2021 bytes) 2024-04-23T23:38:29.305 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:29.317+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:29.310 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:29.310 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:29.310 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:29.310 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:29.311 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:29.314 INFO:teuthology.orchestra.run.smithi077.stdout:2996 writesame 0x7d44d0e thru 0x7d50849 data_size 0x2e(0xbb3c bytes) 2024-04-23T23:38:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.315 INFO:teuthology.orchestra.run.smithi077.stdout:2998 read 0x434f058 thru 0x43538c0 (0x4869 bytes) 2024-04-23T23:38:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:2999 punch from 0x1f82eb1 to 0x1f89048, (0x6197 bytes) 2024-04-23T23:38:29.316 INFO:teuthology.orchestra.run.smithi077.stdout:3000 writesame 0x3f7b25d thru 0x3f8752a data_size 0x5(0xc2ce bytes) 2024-04-23T23:38:29.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:29.325 INFO:teuthology.orchestra.run.smithi077.stdout:3001 writesame 0x80db46b thru 0x80e99d9 data_size 0x11(0xe56f bytes) 2024-04-23T23:38:29.327 INFO:teuthology.orchestra.run.smithi077.stdout:3003 read 0x1883b9d thru 0x188c123 (0x8587 bytes) 2024-04-23T23:38:29.337 INFO:teuthology.orchestra.run.smithi077.stdout:3004 write 0xc8960ab thru 0xc89a8bb (0x4811 bytes) 2024-04-23T23:38:29.340 INFO:teuthology.orchestra.run.smithi077.stdout:3006 trunc from 0xc89a8bc to 0xdc079c7 2024-04-23T23:38:29.345 INFO:teuthology.orchestra.run.smithi077.stdout:3007 writesame 0x1e9bdf1 thru 0x1ea8110 data_size 0x20(0xc320 bytes) 2024-04-23T23:38:29.347 INFO:teuthology.orchestra.run.smithi077.stdout:3008 read 0xac43950 thru 0xac4e692 (0xad43 bytes) 2024-04-23T23:38:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:3009 punch from 0xbb17209 to 0xbb226d8, (0xb4cf bytes) 2024-04-23T23:38:29.348 INFO:teuthology.orchestra.run.smithi077.stdout:3010 write 0x4411357 thru 0x44150d0 (0x3d7a bytes) 2024-04-23T23:38:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:3013 read 0x47b6160 thru 0x47bfbad (0x9a4e bytes) 2024-04-23T23:38:29.350 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.357 INFO:teuthology.orchestra.run.smithi077.stdout:3015 trunc from 0xdc079c7 to 0x7cb7407 2024-04-23T23:38:29.375 INFO:teuthology.orchestra.run.smithi077.stdout:3016 trunc from 0x7cb7407 to 0xeac215b 2024-04-23T23:38:29.380 INFO:teuthology.orchestra.run.smithi077.stdout:3018 write 0x7d3dad0 thru 0x7d4c5b8 (0xeae9 bytes) 2024-04-23T23:38:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:3019 read 0x6825fff thru 0x6833a9f (0xdaa1 bytes) 2024-04-23T23:38:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:3021 punch from 0xe92bfe0 to 0xe9315b8, (0x55d8 bytes) 2024-04-23T23:38:29.382 INFO:teuthology.orchestra.run.smithi077.stdout:3022 writesame 0x57b8f6c thru 0x57bdebc data_size 0x1f(0x4f51 bytes) 2024-04-23T23:38:29.383 INFO:teuthology.orchestra.run.smithi077.stdout:3023 read 0x68870e thru 0x690124 (0x7a17 bytes) 2024-04-23T23:38:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:3024 punch from 0x1e588c3 to 0x1e5da0a, (0x5147 bytes) 2024-04-23T23:38:29.384 INFO:teuthology.orchestra.run.smithi077.stdout:3025 writesame 0x191a4a0 thru 0x1920bb7 data_size 0x4(0x6718 bytes) 2024-04-23T23:38:29.387 INFO:teuthology.orchestra.run.smithi077.stdout:3026 writesame 0x2ceb741 thru 0x2cf9c39 data_size 0xd(0xe4f9 bytes) 2024-04-23T23:38:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.390 INFO:teuthology.orchestra.run.smithi077.stdout:3029 punch from 0x85dbe4a to 0x85e3490, (0x7646 bytes) 2024-04-23T23:38:29.393 INFO:teuthology.orchestra.run.smithi077.stdout:3030 trunc from 0xeac215b to 0xc5b597e 2024-04-23T23:38:29.400 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.401 INFO:teuthology.orchestra.run.smithi077.stdout:3032 read 0x71bc11 thru 0x7212d8 (0x56c8 bytes) 2024-04-23T23:38:29.407 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:29.418+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:29.409 INFO:teuthology.orchestra.run.smithi077.stdout:3033 writesame 0xebff402 thru 0xec0043f data_size 0x16(0x103e bytes) 2024-04-23T23:38:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:3034 punch from 0x1a8b549 to 0x1a8c296, (0xd4d bytes) 2024-04-23T23:38:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.410 INFO:teuthology.orchestra.run.smithi077.stdout:3036 write 0x7472b5a thru 0x747eb98 (0xc03f bytes) 2024-04-23T23:38:29.411 INFO:teuthology.orchestra.run.smithi077.stdout:3037 write 0xbcc66b4 thru 0xbcd2207 (0xbb54 bytes) 2024-04-23T23:38:29.413 INFO:teuthology.orchestra.run.smithi077.stdout:3038 write 0xd928cf thru 0xd961dc (0x390e bytes) 2024-04-23T23:38:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:3041 punch from 0x3700ad6 to 0x37079bb, (0x6ee5 bytes) 2024-04-23T23:38:29.414 INFO:teuthology.orchestra.run.smithi077.stdout:3042 read 0x68df51c thru 0x68eaa73 (0xb558 bytes) 2024-04-23T23:38:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.415 INFO:teuthology.orchestra.run.smithi077.stdout:3047 write 0xdef9327 thru 0xdf01e57 (0x8b31 bytes) 2024-04-23T23:38:29.416 INFO:teuthology.orchestra.run.smithi077.stdout:3048 write 0x5d9d107 thru 0x5da2b25 (0x5a1f bytes) 2024-04-23T23:38:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:3052 punch from 0xcd80161 to 0xcd81d22, (0x1bc1 bytes) 2024-04-23T23:38:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:3053 punch from 0x115a721 to 0x11660d3, (0xb9b2 bytes) 2024-04-23T23:38:29.419 INFO:teuthology.orchestra.run.smithi077.stdout:3054 write 0x6560435 thru 0x656f4cf (0xf09b bytes) 2024-04-23T23:38:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:3055 read 0x251a050 thru 0x251b39f (0x1350 bytes) 2024-04-23T23:38:29.420 INFO:teuthology.orchestra.run.smithi077.stdout:3056 read 0xc9966bd thru 0xc9991af (0x2af3 bytes) 2024-04-23T23:38:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:3057 read 0xc0fe72c thru 0xc0ff3ca (0xc9f bytes) 2024-04-23T23:38:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:3058 punch from 0xa292770 to 0xa295d32, (0x35c2 bytes) 2024-04-23T23:38:29.421 INFO:teuthology.orchestra.run.smithi077.stdout:3059 write 0x848c84b thru 0x8497b6b (0xb321 bytes) 2024-04-23T23:38:29.422 INFO:teuthology.orchestra.run.smithi077.stdout:3061 write 0xd72f864 thru 0xd73ede3 (0xf580 bytes) 2024-04-23T23:38:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:3062 read 0x8be646a thru 0x8bf41f5 (0xdd8c bytes) 2024-04-23T23:38:29.424 INFO:teuthology.orchestra.run.smithi077.stdout:3063 writesame 0x882ff4f thru 0x883298f data_size 0x1(0x2a41 bytes) 2024-04-23T23:38:29.434 INFO:teuthology.orchestra.run.smithi077.stdout:3066 trunc from 0xec00440 to 0xb842385 2024-04-23T23:38:29.445 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347844223999999, 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:29.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:29.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347830578999996, 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:29.450 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:29.454 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347817528999997, 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:29.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:29.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347806509999998, 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:29.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:29.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:29.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:29.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347797434999997, 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.463 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347785491000003, 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.467 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:29.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:29.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.347776379999999, 2024-04-23T23:38:29.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:29.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:29.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.346131008, 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:29.479 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.346118758999999, 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.480 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341940166000001, 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.484 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.485 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:29.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341928383999999, 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.488 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.489 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.490 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341918315000001, 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.492 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:29.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.495 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341906655999999, 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.496 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:29.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:29.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341897336000002, 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.500 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.501 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.503 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341886823999999, 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:29.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:29.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:29.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341877384, 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341682290999998, 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:29.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341661258000002, 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.341647367999997, 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:29.523 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 36.738490863000003, 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:29.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:29.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:29.528 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:3067 punch from 0x7c355aa to 0x7c371ab, (0x1c01 bytes) 2024-04-23T23:38:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:3068 read 0x8467a0f thru 0x84740b3 (0xc6a5 bytes) 2024-04-23T23:38:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:3070 trunc from 0xb842385 to 0xe7b5b00 2024-04-23T23:38:29.529 INFO:teuthology.orchestra.run.smithi077.stdout:3072 punch from 0x4b9c675 to 0x4ba5c0b, (0x9596 bytes) 2024-04-23T23:38:29.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:29.532 INFO:teuthology.orchestra.run.smithi077.stdout:3073 trunc from 0xe7b5b00 to 0x48c13a3 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3074 write 0x3429e7d thru 0x342b865 (0x19e9 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3076 punch from 0x26a715d to 0x26aa020, (0x2ec3 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3077 read 0x1c33224 thru 0x1c347fb (0x15d8 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3080 read 0x4434a11 thru 0x443b445 (0x6a35 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3081 write 0xb2519a3 thru 0xb25abda (0x9238 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3083 read 0x7f624a7 thru 0x7f6c5e0 (0xa13a bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3085 read 0x5239b53 thru 0x5247816 (0xdcc4 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3086 trunc from 0xb25abdb to 0x7334425 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3087 writesame 0x1413692 thru 0x1417394 data_size 0x1(0x3d03 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3088 punch from 0x216bd4f to 0x216f7fb, (0x3aac bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3090 write 0x68c45c3 thru 0x68c4f93 (0x9d1 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3092 punch from 0x6ebb457 to 0x6ecb34c, (0xfef5 bytes) 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.533 INFO:teuthology.orchestra.run.smithi077.stdout:3094 write 0x5f7f2a8 thru 0x5f8eac2 (0xf81b bytes) 2024-04-23T23:38:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:3095 punch from 0x6fbcff to 0x708ea1, (0xd1a2 bytes) 2024-04-23T23:38:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:3097 read 0x5d78289 thru 0x5d8063a (0x83b2 bytes) 2024-04-23T23:38:29.534 INFO:teuthology.orchestra.run.smithi077.stdout:3099 trunc from 0x7334425 to 0xc97abd9 2024-04-23T23:38:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:3100 write 0x7c2764e thru 0x7c2d269 (0x5c1c bytes) 2024-04-23T23:38:29.535 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:29.547+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:3101 read 0x1f622af thru 0x1f662cb (0x401d bytes) 2024-04-23T23:38:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:3104 read 0x7cca351 thru 0x7cd2dbc (0x8a6c bytes) 2024-04-23T23:38:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.540 INFO:teuthology.orchestra.run.smithi077.stdout:3106 write 0xb5d16cf thru 0xb5df3cb (0xdcfd bytes) 2024-04-23T23:38:29.554 INFO:teuthology.orchestra.run.smithi077.stdout:3107 trunc from 0xc97abd9 to 0x2404924 2024-04-23T23:38:29.566 INFO:teuthology.orchestra.run.smithi077.stdout:3109 read 0x17a55f3 thru 0x17b0436 (0xae44 bytes) 2024-04-23T23:38:29.567 INFO:teuthology.orchestra.run.smithi077.stdout:3110 write 0x1c76bc6 thru 0x1c7a5a0 (0x39db bytes) 2024-04-23T23:38:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:3111 write 0x1b3ab3a thru 0x1b466f3 (0xbbba bytes) 2024-04-23T23:38:29.569 INFO:teuthology.orchestra.run.smithi077.stdout:3112 read 0x1d3573a thru 0x1d43dd0 (0xe697 bytes) 2024-04-23T23:38:29.570 INFO:teuthology.orchestra.run.smithi077.stdout:3113 read 0x1b5a8a3 thru 0x1b61eae (0x760c bytes) 2024-04-23T23:38:29.587 INFO:teuthology.orchestra.run.smithi077.stdout:3114 writesame 0xb302c74 thru 0xb30ac1d data_size 0x27(0x7faa bytes) 2024-04-23T23:38:29.588 INFO:teuthology.orchestra.run.smithi077.stdout:3115 read 0xab43472 thru 0xab48986 (0x5515 bytes) 2024-04-23T23:38:29.596 INFO:teuthology.orchestra.run.smithi077.stdout:3116 write 0xcfda4f0 thru 0xcfe4ff4 (0xab05 bytes) 2024-04-23T23:38:29.598 INFO:teuthology.orchestra.run.smithi077.stdout:3117 write 0x254708d thru 0x2548fcf (0x1f43 bytes) 2024-04-23T23:38:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.599 INFO:teuthology.orchestra.run.smithi077.stdout:3119 writesame 0x3af776d thru 0x3afb319 data_size 0x1(0x3bad bytes) 2024-04-23T23:38:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:3120 read 0x1b61aee thru 0x1b6cc44 (0xb157 bytes) 2024-04-23T23:38:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:3121 read 0x6615289 thru 0x662489a (0xf612 bytes) 2024-04-23T23:38:29.607 INFO:teuthology.orchestra.run.smithi077.stdout:3122 read 0xe7cc31 thru 0xe822c9 (0x5699 bytes) 2024-04-23T23:38:29.608 INFO:teuthology.orchestra.run.smithi077.stdout:3124 writesame 0x7840fef thru 0x7846131 data_size 0x1(0x5143 bytes) 2024-04-23T23:38:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:3125 writesame 0x461446 thru 0x46dd94 data_size 0xb(0xc94f bytes) 2024-04-23T23:38:29.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:29.622 INFO:teuthology.orchestra.run.smithi077.stdout:3126 write 0xa8b23f3 thru 0xa8b94b1 (0x70bf bytes) 2024-04-23T23:38:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:3127 punch from 0x28b30e4 to 0x28bf52a, (0xc446 bytes) 2024-04-23T23:38:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:3129 write 0x8cd8057 thru 0x8ce2025 (0x9fcf bytes) 2024-04-23T23:38:29.625 INFO:teuthology.orchestra.run.smithi077.stdout:3130 read 0x9fe2636 thru 0x9ff24f7 (0xfec2 bytes) 2024-04-23T23:38:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:3133 write 0xd124cb3 thru 0xd1267dd (0x1b2b bytes) 2024-04-23T23:38:29.633 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.634 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:29.646+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:29.643 INFO:teuthology.orchestra.run.smithi077.stdout:3137 trunc from 0xd1267de to 0x4439268 2024-04-23T23:38:29.657 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:29.658 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:29.662 INFO:teuthology.orchestra.run.smithi077.stdout:3138 write 0x75ba411 thru 0x75c7484 (0xd074 bytes) 2024-04-23T23:38:29.664 INFO:teuthology.orchestra.run.smithi077.stdout:3142 write 0x6a95aa9 thru 0x6aa5a0c (0xff64 bytes) 2024-04-23T23:38:29.665 INFO:teuthology.orchestra.run.smithi077.stdout:3143 writesame 0x9c1276 thru 0x9c7d29 data_size 0x2(0x6ab4 bytes) 2024-04-23T23:38:29.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:29.687 INFO:teuthology.orchestra.run.smithi077.stdout:3145 write 0xdf83fdc thru 0xdf89434 (0x5459 bytes) 2024-04-23T23:38:29.689 INFO:teuthology.orchestra.run.smithi077.stdout:3146 writesame 0x46e6bc6 thru 0x46f18bc data_size 0x1(0xacf7 bytes) 2024-04-23T23:38:29.717 INFO:teuthology.orchestra.run.smithi077.stdout:3147 read 0xa396db7 thru 0xa398314 (0x155e bytes) 2024-04-23T23:38:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:3148 writesame 0xe3a8dfc thru 0xe3aa431 data_size 0x1(0x1636 bytes) 2024-04-23T23:38:29.724 INFO:teuthology.orchestra.run.smithi077.stdout:3150 write 0x85019a2 thru 0x850df81 (0xc5e0 bytes) 2024-04-23T23:38:29.725 INFO:teuthology.orchestra.run.smithi077.stdout:3152 write 0xa41d066 thru 0xa41d99b (0x936 bytes) 2024-04-23T23:38:29.727 INFO:teuthology.orchestra.run.smithi077.stdout:3153 trunc from 0xe3aa432 to 0xeb163ca 2024-04-23T23:38:29.732 INFO:teuthology.orchestra.run.smithi077.stdout:3154 writesame 0x5af24c0 thru 0x5afcd55 data_size 0x3(0xa896 bytes) 2024-04-23T23:38:29.736 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:29.747+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:29.739 INFO:teuthology.orchestra.run.smithi077.stdout:3156 write 0x7ea6111 thru 0x7eae2c2 (0x81b2 bytes) 2024-04-23T23:38:29.741 INFO:teuthology.orchestra.run.smithi077.stdout:3157 writesame 0x1709e3a thru 0x1713f9a data_size 0x2f(0xa161 bytes) 2024-04-23T23:38:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:3158 punch from 0x61b380c to 0x61b8ec9, (0x56bd bytes) 2024-04-23T23:38:29.743 INFO:teuthology.orchestra.run.smithi077.stdout:3159 punch from 0x5db404 to 0x5e3ca1, (0x889d bytes) 2024-04-23T23:38:29.744 INFO:teuthology.orchestra.run.smithi077.stdout:3160 writesame 0x13474d thru 0x138430 data_size 0x12(0x3ce4 bytes) 2024-04-23T23:38:29.745 INFO:teuthology.orchestra.run.smithi077.stdout:3161 read 0x8a0b8c5 thru 0x8a13027 (0x7763 bytes) 2024-04-23T23:38:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:3162 read 0x2e4be8e thru 0x2e4fb11 (0x3c84 bytes) 2024-04-23T23:38:29.746 INFO:teuthology.orchestra.run.smithi077.stdout:3163 read 0x16effa4 thru 0x16faa87 (0xaae4 bytes) 2024-04-23T23:38:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:3164 punch from 0x1a43a58 to 0x1a4ea93, (0xb03b bytes) 2024-04-23T23:38:29.747 INFO:teuthology.orchestra.run.smithi077.stdout:3167 writesame 0x2ce6e6f thru 0x2cf5a42 data_size 0xac(0xebd4 bytes) 2024-04-23T23:38:29.748 INFO:teuthology.orchestra.run.smithi077.stdout:3168 writesame 0x16a1e36 thru 0x16a32eb data_size 0xb(0x14b6 bytes) 2024-04-23T23:38:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:3175 read 0x6ccb3c0 thru 0x6cd883a (0xd47b bytes) 2024-04-23T23:38:29.750 INFO:teuthology.orchestra.run.smithi077.stdout:3176 write 0xb651e97 thru 0xb65226a (0x3d4 bytes) 2024-04-23T23:38:29.754 INFO:teuthology.orchestra.run.smithi077.stdout:3177 trunc from 0xeb163ca to 0xc306b72 2024-04-23T23:38:29.763 INFO:teuthology.orchestra.run.smithi077.stdout:3179 write 0x645614a thru 0x6464cbb (0xeb72 bytes) 2024-04-23T23:38:29.764 INFO:teuthology.orchestra.run.smithi077.stdout:3180 read 0x5b66aca thru 0x5b6c57c (0x5ab3 bytes) 2024-04-23T23:38:29.765 INFO:teuthology.orchestra.run.smithi077.stdout:3181 read 0x61e632d thru 0x61ec67b (0x634f bytes) 2024-04-23T23:38:29.774 INFO:teuthology.orchestra.run.smithi077.stdout:3182 trunc from 0xc306b72 to 0x452444b 2024-04-23T23:38:29.779 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:29.779 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:29.795 INFO:teuthology.orchestra.run.smithi077.stdout:3183 writesame 0x79d3c8f thru 0x79def68 data_size 0x27(0xb2da bytes) 2024-04-23T23:38:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:3184 read 0xb55294 thru 0xb585fb (0x3368 bytes) 2024-04-23T23:38:29.797 INFO:teuthology.orchestra.run.smithi077.stdout:3189 punch from 0x363d688 to 0x364624e, (0x8bc6 bytes) 2024-04-23T23:38:29.797 INFO:teuthology.orchestra.run.smithi077.stdout:3190 write 0x5ce2e5d thru 0x5cede2c (0xafd0 bytes) 2024-04-23T23:38:29.798 INFO:teuthology.orchestra.run.smithi077.stdout:3191 write 0x2ad3323 thru 0x2ae1b3a (0xe818 bytes) 2024-04-23T23:38:29.799 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:29.799 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:29.800 INFO:teuthology.orchestra.run.smithi077.stdout:3193 read 0x661a36e thru 0x6624a17 (0xa6aa bytes) 2024-04-23T23:38:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:3196 read 0xc8aac9 thru 0xc924fe (0x7a36 bytes) 2024-04-23T23:38:29.801 INFO:teuthology.orchestra.run.smithi077.stdout:3197 read 0x613af74 thru 0x614a290 (0xf31d bytes) 2024-04-23T23:38:29.812 INFO:teuthology.orchestra.run.smithi077.stdout:3198 write 0xb85be32 thru 0xb85f152 (0x3321 bytes) 2024-04-23T23:38:29.814 INFO:teuthology.orchestra.run.smithi077.stdout:3199 read 0x8906a65 thru 0x8914c1b (0xe1b7 bytes) 2024-04-23T23:38:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:29.815 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:29.818 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:29.818 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:29.819 INFO:teuthology.orchestra.run.smithi077.stdout:3200 write 0xbc6fb5c thru 0xbc74d0f (0x51b4 bytes) 2024-04-23T23:38:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:3201 read 0x2b65219 thru 0x2b74772 (0xf55a bytes) 2024-04-23T23:38:29.825 INFO:teuthology.orchestra.run.smithi077.stdout:3202 trunc from 0xbc74d10 to 0xed5f97e 2024-04-23T23:38:29.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:29.830 INFO:teuthology.orchestra.run.smithi077.stdout:3203 writesame 0x72b40be thru 0x72ba509 data_size 0x62(0x644c bytes) 2024-04-23T23:38:29.832 INFO:teuthology.orchestra.run.smithi077.stdout:3205 writesame 0x657e632 thru 0x657f550 data_size 0x7(0xf1f bytes) 2024-04-23T23:38:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:3207 read 0x5933355 thru 0x593b7a7 (0x8453 bytes) 2024-04-23T23:38:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.833 INFO:teuthology.orchestra.run.smithi077.stdout:3209 read 0xbca549f thru 0xbca7766 (0x22c8 bytes) 2024-04-23T23:38:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:3210 read 0x6f5dcb3 thru 0x6f6b127 (0xd475 bytes) 2024-04-23T23:38:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:3211 punch from 0xcea65c0 to 0xceb0474, (0x9eb4 bytes) 2024-04-23T23:38:29.834 INFO:teuthology.orchestra.run.smithi077.stdout:3212 write 0x9f3527b thru 0x9f36a2f (0x17b5 bytes) 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:3214 read 0x225ee07 thru 0x226b1b9 (0xc3b3 bytes) 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:3216 punch from 0x482ed45 to 0x4837dee, (0x90a9 bytes) 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:3218 read 0x32738f2 thru 0x3277cd6 (0x43e5 bytes) 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:3220 read 0xb8420f5 thru 0xb8452f4 (0x3200 bytes) 2024-04-23T23:38:29.838 INFO:teuthology.orchestra.run.smithi077.stdout:3221 write 0x5d3fe49 thru 0x5d460ec (0x62a4 bytes) 2024-04-23T23:38:29.839 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:29.849+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:3223 clone 23 order 18 su 65536 sc 3 2024-04-23T23:38:29.839 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:29.839 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:29.857 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:29.857 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:29.875 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:29.875 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:29.892 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:29.892 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:29.910 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:29.910 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:29.935 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:29.939 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:29.951+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:29.944 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:30.040 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:30.052+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:30.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:38:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.095 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:30.126 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone22 from 0xed5f97e (overlap 0x2404924) to 0x1cd0750 2024-04-23T23:38:30.141 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:30.153+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:30.229 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-04-23T23:38:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.242 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:30.254+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:3226 writesame 0xc60d097 thru 0xc611c74 data_size 0x9(0x4bde bytes) 2024-04-23T23:38:30.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:30.253 INFO:teuthology.orchestra.run.smithi077.stdout:3227 write 0x630045a thru 0x630fa85 (0xf62c bytes) 2024-04-23T23:38:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.256 INFO:teuthology.orchestra.run.smithi077.stdout:3230 write 0x1fb64a6 thru 0x1fc6004 (0xfb5f bytes) 2024-04-23T23:38:30.262 INFO:teuthology.orchestra.run.smithi077.stdout:3231 write 0xb4015d0 thru 0xb403e6d (0x289e bytes) 2024-04-23T23:38:30.278 INFO:teuthology.orchestra.run.smithi077.stdout:3232 trunc from 0xed5f97e to 0x3f36b43 2024-04-23T23:38:30.310 INFO:teuthology.orchestra.run.smithi077.stdout:3233 writesame 0x833bf0b thru 0x834079c data_size 0x7(0x4892 bytes) 2024-04-23T23:38:30.310 INFO:teuthology.orchestra.run.smithi077.stdout:3234 read 0x75b0828 thru 0x75b0867 (0x40 bytes) 2024-04-23T23:38:30.311 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.312 INFO:teuthology.orchestra.run.smithi077.stdout:3236 trunc from 0x834079d to 0x6ce5f2d 2024-04-23T23:38:30.326 INFO:teuthology.orchestra.run.smithi077.stdout:3237 trunc from 0x6ce5f2d to 0x5ee694 2024-04-23T23:38:30.343 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:30.355+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:30.350 INFO:teuthology.orchestra.run.smithi077.stdout:3238 trunc from 0x5ee694 to 0x6405e8e 2024-04-23T23:38:30.361 INFO:teuthology.orchestra.run.smithi077.stdout:3239 trunc from 0x6405e8e to 0x1c1839d 2024-04-23T23:38:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:3240 read 0x961447 thru 0x963b6e (0x2728 bytes) 2024-04-23T23:38:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:3241 read 0x1349492 thru 0x1352d5c (0x98cb bytes) 2024-04-23T23:38:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:3242 read 0xb2a042 thru 0xb3437d (0xa33c bytes) 2024-04-23T23:38:30.368 INFO:teuthology.orchestra.run.smithi077.stdout:3243 punch from 0xb3b66a to 0xb4093f, (0x52d5 bytes) 2024-04-23T23:38:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.375 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.383 INFO:teuthology.orchestra.run.smithi077.stdout:3244 write 0x953ecf2 thru 0x954d917 (0xec26 bytes) 2024-04-23T23:38:30.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:3245 read 0x3dc3d7e thru 0x3dc534e (0x15d1 bytes) 2024-04-23T23:38:30.387 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.397 INFO:teuthology.orchestra.run.smithi077.stdout:3247 write 0xdcf7d8a thru 0xdcfc4f3 (0x476a bytes) 2024-04-23T23:38:30.400 INFO:teuthology.orchestra.run.smithi077.stdout:3248 punch from 0x607893d to 0x6084ed3, (0xc596 bytes) 2024-04-23T23:38:30.412 INFO:teuthology.orchestra.run.smithi077.stdout:3249 trunc from 0xdcfc4f4 to 0x379fca0 2024-04-23T23:38:30.421 INFO:teuthology.orchestra.run.smithi077.stdout:3250 read 0x3ad386 thru 0x3af10c (0x1d87 bytes) 2024-04-23T23:38:30.439 INFO:teuthology.orchestra.run.smithi077.stdout:3251 write 0xb89df72 thru 0xb8a25e6 (0x4675 bytes) 2024-04-23T23:38:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:3254 write 0x3d9fade thru 0x3daabaa (0xb0cd bytes) 2024-04-23T23:38:30.444 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:30.455+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:30.445 INFO:teuthology.orchestra.run.smithi077.stdout:3255 writesame 0x3c7c956 thru 0x3c808b1 data_size 0xa(0x3f5c bytes) 2024-04-23T23:38:30.449 INFO:teuthology.orchestra.run.smithi077.stdout:3257 write 0x3e4c4ab thru 0x3e53b64 (0x76ba bytes) 2024-04-23T23:38:30.462 INFO:teuthology.orchestra.run.smithi077.stdout:3258 writesame 0xe0d9f73 thru 0xe0e410c data_size 0x2a(0xa19a bytes) 2024-04-23T23:38:30.469 INFO:teuthology.orchestra.run.smithi077.stdout:3259 trunc from 0xe0e410d to 0x8325411 2024-04-23T23:38:30.484 INFO:teuthology.orchestra.run.smithi077.stdout:3260 trunc from 0x8325411 to 0xd0b14b6 2024-04-23T23:38:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.489 INFO:teuthology.orchestra.run.smithi077.stdout:3264 read 0x291b307 thru 0x292b299 (0xff93 bytes) 2024-04-23T23:38:30.503 INFO:teuthology.orchestra.run.smithi077.stdout:3265 trunc from 0xd0b14b6 to 0x102f3cc 2024-04-23T23:38:30.506 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.507 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:30.529 INFO:teuthology.orchestra.run.smithi077.stdout:3266 writesame 0xb42c1a1 thru 0xb438f6a data_size 0x6a(0xcdca bytes) 2024-04-23T23:38:30.531 INFO:teuthology.orchestra.run.smithi077.stdout:3267 trunc from 0xb438f6b to 0x8e71d12 2024-04-23T23:38:30.540 INFO:teuthology.orchestra.run.smithi077.stdout:3268 write 0x5ce6884 thru 0x5ce6e3c (0x5b9 bytes) 2024-04-23T23:38:30.544 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:30.556+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:30.547 INFO:teuthology.orchestra.run.smithi077.stdout:3269 write 0x8e814aa thru 0x8e8d3a5 (0xbefc bytes) 2024-04-23T23:38:30.550 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.550 INFO:teuthology.orchestra.run.smithi077.stdout:3272 read 0x3f77707 thru 0x3f7e6f4 (0x6fee bytes) 2024-04-23T23:38:30.550 INFO:teuthology.orchestra.run.smithi077.stdout:3273 read 0x777dcdc thru 0x778a40a (0xc72f bytes) 2024-04-23T23:38:30.555 INFO:teuthology.orchestra.run.smithi077.stdout:3274 writesame 0x8f54793 thru 0x8f5f4e6 data_size 0x2(0xad54 bytes) 2024-04-23T23:38:30.555 INFO:teuthology.orchestra.run.smithi077.stdout:3275 read 0x4e36897 thru 0x4e374c1 (0xc2b bytes) 2024-04-23T23:38:30.555 INFO:teuthology.orchestra.run.smithi077.stdout:3276 punch from 0x2d0cf1b to 0x2d0dc70, (0xd55 bytes) 2024-04-23T23:38:30.555 INFO:teuthology.orchestra.run.smithi077.stdout:3279 writesame 0x4abfa6f thru 0x4ac21ff data_size 0x1(0x2791 bytes) 2024-04-23T23:38:30.564 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.564 INFO:teuthology.orchestra.run.smithi077.stdout:3282 punch from 0x27eade5 to 0x27ec5c6, (0x17e1 bytes) 2024-04-23T23:38:30.564 INFO:teuthology.orchestra.run.smithi077.stdout:3283 writesame 0x103cbe2 thru 0x1049eeb data_size 0x77(0xd30a bytes) 2024-04-23T23:38:30.568 INFO:teuthology.orchestra.run.smithi077.stdout:3284 write 0x45c0e1c thru 0x45c92c8 (0x84ad bytes) 2024-04-23T23:38:30.572 INFO:teuthology.orchestra.run.smithi077.stdout:3285 writesame 0x6d702f7 thru 0x6d7929d data_size 0x5(0x8fa7 bytes) 2024-04-23T23:38:30.579 INFO:teuthology.orchestra.run.smithi077.stdout:3286 writesame 0x1015c70 thru 0x101d2aa data_size 0x13(0x763b bytes) 2024-04-23T23:38:30.581 INFO:teuthology.orchestra.run.smithi077.stdout:3288 write 0x8426ac4 thru 0x84341e0 (0xd71d bytes) 2024-04-23T23:38:30.593 INFO:teuthology.orchestra.run.smithi077.stdout:3289 trunc from 0x8f5f4e7 to 0xc7996fe 2024-04-23T23:38:30.597 INFO:teuthology.orchestra.run.smithi077.stdout:3290 read 0x83a1b0 thru 0x83aa57 (0x8a8 bytes) 2024-04-23T23:38:30.604 INFO:teuthology.orchestra.run.smithi077.stdout:3291 write 0xe61e765 thru 0xe620fd9 (0x2875 bytes) 2024-04-23T23:38:30.608 INFO:teuthology.orchestra.run.smithi077.stdout:3293 write 0x1108c10 thru 0x110aee7 (0x22d8 bytes) 2024-04-23T23:38:30.611 INFO:teuthology.orchestra.run.smithi077.stdout:3294 punch from 0xc2ff714 to 0xc302d9c, (0x3688 bytes) 2024-04-23T23:38:30.611 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:30.624 INFO:teuthology.orchestra.run.smithi077.stdout:3296 trunc from 0xe620fda to 0x3451b09 2024-04-23T23:38:30.639 INFO:teuthology.orchestra.run.smithi077.stdout:3297 write 0x194baf4 thru 0x1956f0b (0xb418 bytes) 2024-04-23T23:38:30.643 INFO:teuthology.orchestra.run.smithi077.stdout:3298 punch from 0x200a024 to 0x200ed7f, (0x4d5b bytes) 2024-04-23T23:38:30.645 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:30.657+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:30.650 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.650 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.659 INFO:teuthology.orchestra.run.smithi077.stdout:3299 write 0xcb64097 thru 0xcb6a4e2 (0x644c bytes) 2024-04-23T23:38:30.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:30.665 INFO:teuthology.orchestra.run.smithi077.stdout:3300 trunc from 0xcb6a4e3 to 0xa0b9888 2024-04-23T23:38:30.675 INFO:teuthology.orchestra.run.smithi077.stdout:3301 write 0x94aa261 thru 0x94ac6f5 (0x2495 bytes) 2024-04-23T23:38:30.680 INFO:teuthology.orchestra.run.smithi077.stdout:3303 clone 24 order 23 su 32768 sc 2 2024-04-23T23:38:30.746 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:30.758+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:30.768 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.768 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.777 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:30.847 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:30.860+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:30.882 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.882 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:30.891 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:30.948 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:30.960+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:30.992 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:30.993 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.001 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:31.049 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:31.062+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:31.054 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:38:31.135 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone23 2024-04-23T23:38:31.150 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:31.163+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:31.152 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.152 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.162 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:31.251 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:31.263+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:31.265 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.266 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.275 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:31.291 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-04-23T23:38:31.331 INFO:teuthology.orchestra.run.smithi077.stdout:3304 trunc from 0xa0b9888 to 0xc77a1f2 2024-04-23T23:38:31.348 INFO:teuthology.orchestra.run.smithi077.stdout:3305 trunc from 0xc77a1f2 to 0x62fc0a3 2024-04-23T23:38:31.352 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:31.364+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:31.361 INFO:teuthology.orchestra.run.smithi077.stdout:3306 read 0x1ac2faf thru 0x1ac4bb4 (0x1c06 bytes) 2024-04-23T23:38:31.362 INFO:teuthology.orchestra.run.smithi077.stdout:3307 punch from 0x13a32c7 to 0x13b26ba, (0xf3f3 bytes) 2024-04-23T23:38:31.362 INFO:teuthology.orchestra.run.smithi077.stdout:3308 read 0x1496a05 thru 0x1497c81 (0x127d bytes) 2024-04-23T23:38:31.362 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:31.362 INFO:teuthology.orchestra.run.smithi077.stdout:3311 read 0x352b8da thru 0x352d05c (0x1783 bytes) 2024-04-23T23:38:31.362 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:31.373 INFO:teuthology.orchestra.run.smithi077.stdout:3313 writesame 0xa3bd2ea thru 0xa3bd5e2 data_size 0x1(0x2f9 bytes) 2024-04-23T23:38:31.373 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:31.373 INFO:teuthology.orchestra.run.smithi077.stdout:3315 writesame 0x128003f thru 0x1284b19 data_size 0x1(0x4adb bytes) 2024-04-23T23:38:31.381 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.381 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.384 INFO:teuthology.orchestra.run.smithi077.stdout:3316 writesame 0x2075635 thru 0x20761bc data_size 0x18(0xb88 bytes) 2024-04-23T23:38:31.390 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:31.391 INFO:teuthology.orchestra.run.smithi077.stdout:3317 trunc from 0xa3bd5e3 to 0x8e05607 2024-04-23T23:38:31.394 INFO:teuthology.orchestra.run.smithi077.stdout:3318 write 0x6108e75 thru 0x6118089 (0xf215 bytes) 2024-04-23T23:38:31.396 INFO:teuthology.orchestra.run.smithi077.stdout:3319 write 0x152586c thru 0x1525b97 (0x32c bytes) 2024-04-23T23:38:31.401 INFO:teuthology.orchestra.run.smithi077.stdout:3320 read 0x4360f94 thru 0x4361f76 (0xfe3 bytes) 2024-04-23T23:38:31.401 INFO:teuthology.orchestra.run.smithi077.stdout:3321 read 0x27dc9a3 thru 0x27e2986 (0x5fe4 bytes) 2024-04-23T23:38:31.401 INFO:teuthology.orchestra.run.smithi077.stdout:3323 punch from 0x51ae492 to 0x51b06d6, (0x2244 bytes) 2024-04-23T23:38:31.409 INFO:teuthology.orchestra.run.smithi077.stdout:3324 write 0xd1395e3 thru 0xd140f4e (0x796c bytes) 2024-04-23T23:38:31.412 INFO:teuthology.orchestra.run.smithi077.stdout:3327 read 0x1d586df thru 0x1d637a8 (0xb0ca bytes) 2024-04-23T23:38:31.412 INFO:teuthology.orchestra.run.smithi077.stdout:3328 write 0xd130ad6 thru 0xd13d4d5 (0xca00 bytes) 2024-04-23T23:38:31.416 INFO:teuthology.orchestra.run.smithi077.stdout:3329 trunc from 0xd140f4f to 0xe666b13 2024-04-23T23:38:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:3330 writesame 0xa5dc496 thru 0xa5e2293 data_size 0x2(0x5dfe bytes) 2024-04-23T23:38:31.428 INFO:teuthology.orchestra.run.smithi077.stdout:3331 clone 25 order 22 su 16384 sc 7 2024-04-23T23:38:31.454 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:31.466+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:31.493 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.493 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.502 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:31.555 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:31.568+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:31.605 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.605 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.613 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:31.658 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:31.670+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:31.715 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.715 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.724 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:31.764 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:31.777+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:31.858 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:31.871+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:31.866 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.866 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.875 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:31.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:31.959 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:31.971+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:31.976 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:31.976 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:31.985 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:32.045 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:32.045 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:32.062 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:32.063 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:32.069 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:32.082+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:32.082 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:32.082 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:32.099 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:32.100 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:32.118 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:32.118 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:32.127 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone24 2024-04-23T23:38:32.135 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:32.136 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:32.142 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:32.142 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:32.148 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:32.160 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:32.173+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:32.171 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:32.171 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:32.193 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:32.194 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:32.262 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:32.274+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.059001791, 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:32.294 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:32.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058979357999998, 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.299 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:32.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:32.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:32.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058958254, 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:32.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058937970999999, 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058916403000001, 2024-04-23T23:38:32.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:32.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:32.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.317 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058898804999998, 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:32.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058878231000001, 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.322 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:32.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058849091999999, 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058828417000001, 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:32.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:32.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.058805617000001, 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.335 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:32.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.057789196000002, 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.343 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.057769540999999, 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:32.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.057730446000001, 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.348 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:32.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:32.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.057710655000001, 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:32.352 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.356 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.057692056, 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.057655728, 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.361 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:32.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:32.364 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.055473765999999, 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.365 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:32.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:32.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.055463671999998, 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.369 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.373 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.055447900000001, 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:32.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.055437756, 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.378 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:32.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:32.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:32.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:32.382 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:32.382 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:32.383 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-04-23T23:38:32.384 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:32.396+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:32.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:32.485 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:32.498+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:32.491 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:32.491 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:32.491 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:32.491 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:32.498 INFO:teuthology.orchestra.run.smithi077.stdout:3332 write 0x999e622 thru 0x99ae0ee (0xfacd bytes) 2024-04-23T23:38:32.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:32.542 INFO:teuthology.orchestra.run.smithi077.stdout:3333 read 0x9d3b155 thru 0x9d44e05 (0x9cb1 bytes) 2024-04-23T23:38:32.552 INFO:teuthology.orchestra.run.smithi077.stdout:3334 trunc from 0xe666b13 to 0x617294b 2024-04-23T23:38:32.586 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:32.599+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:32.644 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:32.645 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:32.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:32.697 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:32.709+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:32.703 INFO:teuthology.orchestra.run.smithi077.stdout:3335 write 0x76039ff thru 0x76085df (0x4be1 bytes) 2024-04-23T23:38:32.707 INFO:teuthology.orchestra.run.smithi077.stdout:3336 read 0x386b339 thru 0x3879473 (0xe13b bytes) 2024-04-23T23:38:32.717 INFO:teuthology.orchestra.run.smithi077.stdout:3339 writesame 0xa3dbaa4 thru 0xa3dc7e3 data_size 0x8(0xd40 bytes) 2024-04-23T23:38:32.717 INFO:teuthology.orchestra.run.smithi077.stdout:3340 read 0x783f26b thru 0x784a296 (0xb02c bytes) 2024-04-23T23:38:32.717 INFO:teuthology.orchestra.run.smithi077.stdout:3341 read 0x951d680 thru 0x9522199 (0x4b1a bytes) 2024-04-23T23:38:32.717 INFO:teuthology.orchestra.run.smithi077.stdout:3344 write 0x4f17483 thru 0x4f23ab1 (0xc62f bytes) 2024-04-23T23:38:32.722 INFO:teuthology.orchestra.run.smithi077.stdout:3346 punch from 0x5c39f61 to 0x5c41e27, (0x7ec6 bytes) 2024-04-23T23:38:32.723 INFO:teuthology.orchestra.run.smithi077.stdout:3347 write 0x246eb7c thru 0x2475b08 (0x6f8d bytes) 2024-04-23T23:38:32.752 INFO:teuthology.orchestra.run.smithi077.stdout:3348 read 0x36b06e7 thru 0x36b7df0 (0x770a bytes) 2024-04-23T23:38:32.752 INFO:teuthology.orchestra.run.smithi077.stdout:3349 read 0x202bea8 thru 0x202f954 (0x3aad bytes) 2024-04-23T23:38:32.754 INFO:teuthology.orchestra.run.smithi077.stdout:3350 trunc from 0xa3dc7e4 to 0x8dcc7ce 2024-04-23T23:38:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:3351 punch from 0x5e1c658 to 0x5e26f48, (0xa8f0 bytes) 2024-04-23T23:38:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:3352 write 0x460cd94 thru 0x4615a03 (0x8c70 bytes) 2024-04-23T23:38:32.766 INFO:teuthology.orchestra.run.smithi077.stdout:3353 read 0x756db76 thru 0x7574ad9 (0x6f64 bytes) 2024-04-23T23:38:32.767 INFO:teuthology.orchestra.run.smithi077.stdout:3354 punch from 0xe6d070 to 0xe730bd, (0x604d bytes) 2024-04-23T23:38:32.767 INFO:teuthology.orchestra.run.smithi077.stdout:3355 write 0x1565287 thru 0x156c3fe (0x7178 bytes) 2024-04-23T23:38:32.788 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:32.800+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:32.824 INFO:teuthology.orchestra.run.smithi077.stdout:3357 write 0x6c9cd7d thru 0x6cab6ce (0xe952 bytes) 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727804151999997, 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:32.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:32.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727790507000002, 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:32.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:32.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727777457000002, 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:32.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.838 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727766438000003, 2024-04-23T23:38:32.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:32.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:32.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727757363000002, 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727745419000001, 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:32.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.727736307999997, 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.852 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:32.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.856 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.726090935999999, 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:32.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:32.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.726078686999998, 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:32.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:32.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:32.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721900093999999, 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.868 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721888311999997, 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:32.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:32.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:32.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:32.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721878242999999, 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:32.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:32.876 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721866583999997, 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.877 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:32.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721857264, 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.881 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.884 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721846751999998, 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.885 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:32.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721837311999998, 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:32.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:32.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.892 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721642219000003, 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.896 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721621186, 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.900 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.721607296000002, 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:32.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 40.118450791000001, 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:32.904 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:32.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:32.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:32.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:32.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:32.909 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.909 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.909 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.909 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:32.909 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:32.909 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:32.910 INFO:teuthology.orchestra.run.smithi077.stdout:3358 write 0x8b007f7 thru 0x8b03165 (0x296f bytes) 2024-04-23T23:38:32.910 INFO:teuthology.orchestra.run.smithi077.stdout:3359 read 0x348ba87 thru 0x348f3f0 (0x396a bytes) 2024-04-23T23:38:32.910 INFO:teuthology.orchestra.run.smithi077.stdout:3360 punch from 0x44e4137 to 0x44f2805, (0xe6ce bytes) 2024-04-23T23:38:32.910 INFO:teuthology.orchestra.run.smithi077.stdout:3361 write 0x24ca5e1 thru 0x24d6847 (0xc267 bytes) 2024-04-23T23:38:32.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:32.912 INFO:teuthology.orchestra.run.smithi077.stdout:3363 trunc from 0x8dcc7ce to 0xad843ad 2024-04-23T23:38:32.912 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:32.912 INFO:teuthology.orchestra.run.smithi077.stdout:3365 read 0x5d04d74 thru 0x5d0b745 (0x69d2 bytes) 2024-04-23T23:38:32.912 INFO:teuthology.orchestra.run.smithi077.stdout:3367 write 0xde83ff5 thru 0xde8ca85 (0x8a91 bytes) 2024-04-23T23:38:32.913 INFO:teuthology.orchestra.run.smithi077.stdout:3368 writesame 0xc6198a5 thru 0xc6229b4 data_size 0x58(0x9110 bytes) 2024-04-23T23:38:32.913 INFO:teuthology.orchestra.run.smithi077.stdout:3370 trunc from 0xde8ca86 to 0xd46064e 2024-04-23T23:38:32.913 INFO:teuthology.orchestra.run.smithi077.stdout:3373 write 0x9967aad thru 0x9972472 (0xa9c6 bytes) 2024-04-23T23:38:32.913 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:32.913 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:32.922+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:32.917 INFO:teuthology.orchestra.run.smithi077.stdout:3375 trunc from 0xd46064e to 0x41ddb2a 2024-04-23T23:38:32.949 INFO:teuthology.orchestra.run.smithi077.stdout:3376 write 0xd4a1671 thru 0xd4acdeb (0xb77b bytes) 2024-04-23T23:38:32.954 INFO:teuthology.orchestra.run.smithi077.stdout:3377 write 0x654efae thru 0x65551f4 (0x6247 bytes) 2024-04-23T23:38:32.958 INFO:teuthology.orchestra.run.smithi077.stdout:3378 write 0xaa33ad thru 0xaabeab (0x8aff bytes) 2024-04-23T23:38:33.012 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:33.024+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:33.019 INFO:teuthology.orchestra.run.smithi077.stdout:3379 read 0xc27ede1 thru 0xc28e538 (0xf758 bytes) 2024-04-23T23:38:33.019 INFO:teuthology.orchestra.run.smithi077.stdout:3380 clone 26 order 20 su 262144 sc 11 2024-04-23T23:38:33.044 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:33.045 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:33.045 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:33.045 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:33.048 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 5, 6, 7] out_osds: [3, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:33.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-23T23:38:33.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:33.071 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:38:33.112 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:33.124+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:33.135 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone25 from 0xd4acdec (overlap 0x41ddb2a) to 0x0 2024-04-23T23:38:33.213 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:33.225+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:33.222 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:33.223 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:33.227 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-04-23T23:38:33.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:33.321 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:33.333+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:33.391 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:33.391 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:33.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:33.391 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:33.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.008500832000003, 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.392 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:33.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:33.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:33.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:33.397 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 36.009850204000003, 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32786 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.317398532999999, 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018228132000000001, 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.403 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32786 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084948+0000", 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9920000000000002e-06 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086902+0000", 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019542050000000001 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086923+0000", 2024-04-23T23:38:33.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1571999999999999e-05 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086933+0000", 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.73e-06 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087015+0000", 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2066999999999999e-05 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087175+0000", 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016020699999999999 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087648+0000", 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00047274399999999999 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.101505+0000", 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013856736 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103090+0000", 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015848979999999999 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103128+0000", 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8120000000000001e-05 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103174+0000", 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5861e-05 2024-04-23T23:38:33.408 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.570196791000001, 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.409 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:38:33.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:38:33.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56689 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 20971520~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281439+0000", 2024-04-23T23:38:33.415 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1209053759999996, 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017310648000000001, 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56689 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281439+0000", 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281439+0000", 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281439+0000", 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.58e-07 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281441+0000", 2024-04-23T23:38:33.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281447+0000", 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0820000000000004e-06 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281452+0000", 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6779999999999999e-06 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298567+0000", 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115295999999999 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298650+0000", 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2871e-05 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298749+0000", 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9270000000000003e-05 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.419 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56690 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 22937600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281458+0000", 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1208864829999996, 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017444529, 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.420 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56690 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281458+0000", 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281458+0000", 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281458+0000", 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2799999999999996e-07 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281460+0000", 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1390000000000002e-06 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281466+0000", 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8080000000000001e-06 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281470+0000", 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2119999999999997e-06 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298788+0000", 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017317763 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298848+0000", 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9880999999999998e-05 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298902+0000", 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4197999999999998e-05 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56691 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 23592960~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281476+0000", 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1208677429999998, 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017636578, 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.424 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56691 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281476+0000", 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281476+0000", 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281477+0000", 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281479+0000", 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281484+0000", 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6230000000000002e-06 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281488+0000", 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2350000000000001e-06 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298935+0000", 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017446397999999998 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299023+0000", 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8239000000000007e-05 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299113+0000", 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9938000000000005e-05 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56692 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 25559040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1208504069999998, 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017758131, 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.428 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56692 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5699999999999998e-07 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281496+0000", 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281502+0000", 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6910000000000002e-06 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281506+0000", 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299146+0000", 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017639644999999999 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299199+0000", 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2954999999999997e-05 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299252+0000", 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3053999999999997e-05 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56693 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 26214400~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.432 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1208322490000002, 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017954739000000001, 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56693 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.53e-07 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281514+0000", 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.858e-06 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281520+0000", 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5879999999999997e-06 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281525+0000", 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4020000000000001e-06 2024-04-23T23:38:33.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299283+0000", 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017757959 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299362+0000", 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8955000000000006e-05 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299467+0000", 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010462400000000001 2024-04-23T23:38:33.436 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56756 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 131072~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282454+0000", 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1198902640000004, 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017151795000000001, 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.437 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56756 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282454+0000", 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282454+0000", 2024-04-23T23:38:33.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282455+0000", 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8800000000000002e-07 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282458+0000", 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.016e-06 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282467+0000", 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.927e-06 2024-04-23T23:38:33.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282474+0000", 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6370000000000002e-06 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299497+0000", 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017023093 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299547+0000", 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9740999999999997e-05 2024-04-23T23:38:33.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299606+0000", 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8693000000000002e-05 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56757 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 2752512~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282483+0000", 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1198606719999997, 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017273495, 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56757 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282483+0000", 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282483+0000", 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282484+0000", 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7399999999999998e-07 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282486+0000", 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2450000000000001e-06 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282493+0000", 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1119999999999998e-06 2024-04-23T23:38:33.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282499+0000", 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2190000000000001e-06 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299644+0000", 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017144973000000001 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299694+0000", 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9438000000000003e-05 2024-04-23T23:38:33.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299757+0000", 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3034000000000007e-05 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56758 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 5373952~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282507+0000", 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1198374209999997, 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017390563000000001, 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.445 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56758 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282507+0000", 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282507+0000", 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282507+0000", 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5600000000000001e-07 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282510+0000", 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8310000000000003e-06 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282522+0000", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1420000000000001e-06 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299785+0000", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017263359999999998 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299840+0000", 2024-04-23T23:38:33.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5072999999999999e-05 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299897+0000", 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7054e-05 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56759 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 7995392~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282568+0000", 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1197756270000001, 2024-04-23T23:38:33.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017486277000000001, 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56759 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282568+0000", 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282568+0000", 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282569+0000", 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3300000000000002e-07 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282574+0000", 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8609999999999997e-06 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282581+0000", 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282586+0000", 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0769999999999998e-06 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299931+0000", 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017345154000000002 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300000+0000", 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9461999999999993e-05 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300055+0000", 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4543000000000003e-05 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56760 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 10616832~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282594+0000", 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1197496899999999, 2024-04-23T23:38:33.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017604246, 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56760 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282594+0000", 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282594+0000", 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282595+0000", 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2099999999999997e-07 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282597+0000", 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.289e-06 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282604+0000", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5629999999999997e-06 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282615+0000", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1517e-05 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300086+0000", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017470521999999999 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300138+0000", 2024-04-23T23:38:33.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1805000000000003e-05 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300199+0000", 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1029000000000001e-05 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56761 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 13238272~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1197231470000002, 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017707678000000001, 2024-04-23T23:38:33.457 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56761 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282623+0000", 2024-04-23T23:38:33.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.68e-06 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282627+0000", 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8659999999999999e-06 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282630+0000", 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.151e-06 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300229+0000", 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017599193999999999 2024-04-23T23:38:33.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300277+0000", 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7757999999999999e-05 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300329+0000", 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1598000000000003e-05 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56762 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 15859712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.119710854, 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017823252000000001, 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56762 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2600000000000001e-07 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282635+0000", 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.243e-06 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1499999999999999e-06 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282641+0000", 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9699999999999999e-06 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300354+0000", 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017712848 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300404+0000", 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0698000000000001e-05 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300457+0000", 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2117000000000003e-05 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.465 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56763 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 18481152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1197003670000001, 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017950035, 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56763 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282645+0000", 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.189e-06 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282648+0000", 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1389999999999999e-06 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282651+0000", 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5720000000000001e-06 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300483+0000", 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017831544000000001 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300539+0000", 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6368e-05 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300594+0000", 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4901000000000002e-05 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.469 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56764 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 21102592~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1196903389999999, 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018064566000000001, 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.470 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56764 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:33.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1e-07 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282655+0000", 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1400000000000001e-06 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282658+0000", 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.101e-06 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282661+0000", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.571e-06 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300620+0000", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017959284999999998 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300668+0000", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7994999999999997e-05 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300718+0000", 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0263999999999999e-05 2024-04-23T23:38:33.473 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56765 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 23724032~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1196805679999997, 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018197768999999999, 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.474 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56765 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1e-07 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282665+0000", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0020000000000001e-06 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282668+0000", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0819999999999999e-06 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282671+0000", 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2289999999999999e-06 2024-04-23T23:38:33.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300753+0000", 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018081611000000001 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300808+0000", 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5084999999999999e-05 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300861+0000", 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3550000000000001e-05 2024-04-23T23:38:33.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56766 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 26345472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.1196692480000001, 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018325915000000002, 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.478 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56766 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282676+0000", 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0759999999999999e-06 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282680+0000", 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.782e-06 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282683+0000", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7070000000000001e-06 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300877+0000", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018194254999999999 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300931+0000", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4060000000000001e-05 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.301001+0000", 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9813000000000004e-05 2024-04-23T23:38:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.482 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.482 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.482 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.482 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.482 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:33.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:33.484 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:33.495+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:33.527 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:33.527 INFO:teuthology.orchestra.run.smithi077.stdout:3388 read 0x594e8e7 thru 0x5956c41 (0x835b bytes) 2024-04-23T23:38:33.537 INFO:teuthology.orchestra.run.smithi077.stdout:3389 writesame 0xea979c8 thru 0xeaa2137 data_size 0x5e(0xa770 bytes) 2024-04-23T23:38:33.537 INFO:teuthology.orchestra.run.smithi077.stdout:3390 clone 27 order 24 su 524288 sc 13 2024-04-23T23:38:33.584 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:33.596+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:33.627 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:33.627 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:33.628 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:33.628 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:33.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:33.685 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:33.697+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:33.778 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:33.778 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:33.778 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:33.778 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:33.778 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:33.787 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:33.798+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:33.787 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:33.886 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:33.899+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:33.891 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.493734453999998, 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:33.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:33.895 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 36.494038600000003, 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:33.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:33.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.814781502999999, 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:38:33.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:38:33.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56709 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12713984~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.904 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269105+0000", 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6336649159999999, 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012223446000000001, 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56709 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269105+0000", 2024-04-23T23:38:33.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269105+0000", 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269106+0000", 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269111+0000", 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.203e-06 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269117+0000", 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2210000000000002e-06 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269122+0000", 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6439999999999999e-06 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281143+0000", 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012021263000000001 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281227+0000", 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4543999999999996e-05 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281329+0000", 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101173 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56710 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15335424~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6336414829999999, 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012433191, 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56710 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.909 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:33.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269131+0000", 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269137+0000", 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.981e-06 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269142+0000", 2024-04-23T23:38:33.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281371+0000", 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012229019000000001 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281460+0000", 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8807000000000005e-05 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281562+0000", 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010218 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56711 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 17956864~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6336214990000002, 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012636282, 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56711 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269151+0000", 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9870000000000002e-06 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269157+0000", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1990000000000003e-06 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269161+0000", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1969999999999998e-06 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281604+0000", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01244255 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281683+0000", 2024-04-23T23:38:33.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8776000000000006e-05 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281785+0000", 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000102168 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.633604558, 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.917 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6335942289999998, 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.921 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:38:33.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6335833109999998, 2024-04-23T23:38:33.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:38:33.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:38:33.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.633555125, 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.930 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:33.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.63353942, 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.934 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6335284369999998, 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.938 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:33.942 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.633514066, 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.944 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.946 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6334767269999997, 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.950 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6334544080000004, 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.951 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.953 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:38:33.953 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6334271940000002, 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.957 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.958 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:38:33.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6334071410000002, 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:38:33.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:38:33.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:38:33.965 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6333877640000001, 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.966 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6333683399999996, 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.970 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:38:33.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:38:33.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.722019191, 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:38:33.974 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.976 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.977 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:33.978 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:33.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:34.024 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:34.036+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:34.074 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-04-23T23:38:34.080 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:38:34.088 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:34.100+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:34.088 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:34.089 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:34.089 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:34.089 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:34.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-23T23:38:34.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:34.146 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone26 from 0xeaa2138 (overlap 0xd4acdec) to 0x0 2024-04-23T23:38:34.189 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:34.201+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:34.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:34.289 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:34.302+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:34.310 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:34.310 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:34.310 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:34.310 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:34.310 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:34.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:34.390 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:34.402+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:34.414 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:34.452 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:34.452 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:34.480 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:34.491 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:34.504+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37869 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.299060984, 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045333998, 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.496 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37869 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207482+0000", 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8299999999999995e-07 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.498 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207485+0000", 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9620000000000002e-06 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207488+0000", 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6800000000000002e-06 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252696+0000", 2024-04-23T23:38:34.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045208527999999998 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252756+0000", 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9828999999999999e-05 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252815+0000", 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8900999999999997e-05 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37870 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1155072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.299049433, 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045543751, 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37870 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.501 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207493+0000", 2024-04-23T23:38:34.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8799999999999998e-07 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207501+0000", 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0269999999999995e-06 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207507+0000", 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207512+0000", 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6909999999999996e-06 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252853+0000", 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045341765999999999 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252932+0000", 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8846999999999999e-05 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.504 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253036+0000", 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103788 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37871 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.299021727, 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045672261999999998, 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.505 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37871 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:34.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207521+0000", 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.44e-07 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207523+0000", 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207529+0000", 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2999999999999998e-06 2024-04-23T23:38:34.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207533+0000", 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5029999999999999e-06 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253082+0000", 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045548271000000001 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253139+0000", 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7237000000000001e-05 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253192+0000", 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3470000000000001e-05 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37872 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1196032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:34.509 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.299002376000001, 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806959000000001, 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37872 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207540+0000", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207542+0000", 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7749999999999999e-06 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207546+0000", 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8239999999999999e-06 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207553+0000", 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253231+0000", 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045677698000000003 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253276+0000", 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5238000000000003e-05 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253346+0000", 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0234000000000006e-05 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37873 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.298984587, 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046012472999999998, 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37873 2024-04-23T23:38:34.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207558+0000", 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207559+0000", 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4610000000000001e-06 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207565+0000", 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0700000000000003e-06 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207569+0000", 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.189e-06 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253392+0000", 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045822300000000003 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253471+0000", 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9354e-05 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253570+0000", 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8748999999999999e-05 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37874 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1236992~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.298965834000001, 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046114845000000002, 2024-04-23T23:38:34.518 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37874 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.46e-07 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207578+0000", 2024-04-23T23:38:34.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207584+0000", 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2249999999999997e-06 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207589+0000", 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253602+0000", 2024-04-23T23:38:34.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046013314 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253641+0000", 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8980000000000003e-05 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253691+0000", 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9503999999999999e-05 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37875 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.298946741000002, 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046215125000000003, 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37875 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207597+0000", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.632e-06 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207603+0000", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207614+0000", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1326e-05 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253723+0000", 2024-04-23T23:38:34.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046108359000000002 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253761+0000", 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8124999999999998e-05 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253810+0000", 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9431000000000002e-05 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37876 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1277952~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.298921259, 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046358498999999997, 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37876 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207826+0000", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00020521100000000001 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207829+0000", 2024-04-23T23:38:34.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4259999999999999e-06 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207839+0000", 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0229e-05 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207847+0000", 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253839+0000", 2024-04-23T23:38:34.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991727000000003 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253887+0000", 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8353999999999998e-05 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253979+0000", 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.187e-05 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.530 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37877 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.298684349999998, 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046312513999999999, 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37877 2024-04-23T23:38:34.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208979+0000", 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011215649999999999 2024-04-23T23:38:34.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208984+0000", 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208994+0000", 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0223e-05 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209001+0000", 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0570000000000004e-06 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254010+0000", 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045008632999999999 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254075+0000", 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5227000000000004e-05 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254170+0000", 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5038999999999996e-05 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37878 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1318912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297528836000001, 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045355536000000002, 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37878 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209016+0000", 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209023+0000", 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8000000000000001e-06 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209028+0000", 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.575e-06 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254215+0000", 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045186357000000003 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254284+0000", 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9089000000000002e-05 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254368+0000", 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4845000000000005e-05 2024-04-23T23:38:34.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37879 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297506182999999, 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045494123999999997, 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37879 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.539 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:38:34.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209038+0000", 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8449999999999999e-06 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209045+0000", 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8009999999999998e-06 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209050+0000", 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:38:34.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254409+0000", 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045358974000000003 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254462+0000", 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2913e-05 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254530+0000", 2024-04-23T23:38:34.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7968999999999999e-05 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37880 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297485237, 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045602333000000002, 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37880 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209059+0000", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.792e-06 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209068+0000", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5559999999999996e-06 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209074+0000", 2024-04-23T23:38:34.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5060000000000003e-06 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254562+0000", 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045488622999999999 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254606+0000", 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3798999999999999e-05 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254659+0000", 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2626000000000001e-05 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.546 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37881 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297461180999999, 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045722411999999997, 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37881 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209091+0000", 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4700000000000008e-06 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209099+0000", 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209104+0000", 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.541e-06 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254679+0000", 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045574605999999997 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254732+0000", 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3081000000000002e-05 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254803+0000", 2024-04-23T23:38:34.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0926999999999994e-05 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37882 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1400832~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297412974, 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045814737000000001, 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.551 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37882 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:34.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209136+0000", 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1380000000000004e-06 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209145+0000", 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0119999999999994e-06 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209150+0000", 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5759999999999996e-06 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254835+0000", 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045685022999999998 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254884+0000", 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8758999999999999e-05 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254944+0000", 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9620000000000002e-05 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37883 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297382818999999, 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991057000000002, 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.555 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37883 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2399999999999998e-07 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209168+0000", 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5469999999999997e-06 2024-04-23T23:38:34.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209175+0000", 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1910000000000003e-06 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209180+0000", 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9699999999999998e-06 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254987+0000", 2024-04-23T23:38:34.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806988 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255056+0000", 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8942000000000005e-05 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255150+0000", 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3894999999999995e-05 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.559 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37884 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1441792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.297350564999999, 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.04609659, 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37884 2024-04-23T23:38:34.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210975+0000", 2024-04-23T23:38:34.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017842330000000001 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210980+0000", 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1010000000000002e-06 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210991+0000", 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1173e-05 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211005+0000", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4579999999999999e-05 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255182+0000", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.044176766999999999 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255231+0000", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8928999999999999e-05 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255288+0000", 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6807e-05 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37944 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 53248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.295335376000001, 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045325582000000003, 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37944 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:34.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211207+0000", 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211209+0000", 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211216+0000", 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211227+0000", 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1769e-05 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256438+0000", 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045210798000000003 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256480+0000", 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1458000000000002e-05 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256532+0000", 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2441999999999997e-05 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.568 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37945 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.295307672, 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045467075000000003, 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.569 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37945 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212977+0000", 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017429780000000001 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212984+0000", 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0999999999999998e-06 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212993+0000", 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212999+0000", 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.784e-06 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256567+0000", 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043567620000000001 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256618+0000", 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1518999999999999e-05 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256701+0000", 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2922000000000003e-05 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37956 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 299008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.293304821, 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045237267999999997, 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.573 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37956 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:34.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214975+0000", 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001738131 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214980+0000", 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4580000000000003e-06 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214988+0000", 2024-04-23T23:38:34.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4470000000000006e-06 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214993+0000", 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258367+0000", 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043374366999999997 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258414+0000", 2024-04-23T23:38:34.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6390000000000001e-05 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258474+0000", 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0609000000000002e-05 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37967 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 524288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 20.291399543000001, 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045227928000000001, 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:34.577 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37967 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216974+0000", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018321850000000001 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216978+0000", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.208e-06 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216985+0000", 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2529999999999998e-06 2024-04-23T23:38:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216990+0000", 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260276+0000", 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043285591999999998 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260319+0000", 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2654000000000002e-05 2024-04-23T23:38:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260370+0000", 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1486999999999997e-05 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:34.581 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:34.582 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:34.583 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:34.583 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:34.583 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:34.584 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:34.584 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:34.584 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:34.584 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-04-23T23:38:34.585 INFO:teuthology.orchestra.run.smithi077.stdout:3393 writesame 0x22f7319 thru 0x2304bcf data_size 0x1(0xd8b7 bytes) 2024-04-23T23:38:34.585 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:34.585 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:34.600 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:34.600 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:34.601 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:34.613+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:34.603 INFO:teuthology.orchestra.run.smithi077.stdout:3394 punch from 0x674c201 to 0x6757c07, (0xba06 bytes) 2024-04-23T23:38:34.603 INFO:teuthology.orchestra.run.smithi077.stdout:3395 writesame 0xc59d22a thru 0xc5a9c14 data_size 0x1(0xc9eb bytes) 2024-04-23T23:38:34.629 INFO:teuthology.orchestra.run.smithi077.stdout:3396 read 0xe5510ee thru 0xe560e85 (0xfd98 bytes) 2024-04-23T23:38:34.629 INFO:teuthology.orchestra.run.smithi077.stdout:3398 writesame 0xc93e858 thru 0xc93f705 data_size 0x1(0xeae bytes) 2024-04-23T23:38:34.693 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:34.705+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:34.694 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:34.694 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:34.702 INFO:teuthology.orchestra.run.smithi077.stdout:3399 trunc from 0xeaa2138 to 0x49708a3 2024-04-23T23:38:34.703 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:34.794 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:34.806+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:34.840 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:34.840 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:34.850 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:34.854 INFO:teuthology.orchestra.run.smithi077.stdout:3400 read 0x7e57f thru 0x8a5b0 (0xc032 bytes) 2024-04-23T23:38:34.854 INFO:teuthology.orchestra.run.smithi077.stdout:3402 punch from 0xfada58 to 0xfb12be, (0x3866 bytes) 2024-04-23T23:38:34.858 INFO:teuthology.orchestra.run.smithi077.stdout:3403 trunc from 0x49708a3 to 0x8088823 2024-04-23T23:38:34.864 INFO:teuthology.orchestra.run.smithi077.stdout:3404 write 0x1cdb422 thru 0x1cdd53f (0x211e bytes) 2024-04-23T23:38:34.866 INFO:teuthology.orchestra.run.smithi077.stdout:3405 read 0x12f9955 thru 0x12fa447 (0xaf3 bytes) 2024-04-23T23:38:34.866 INFO:teuthology.orchestra.run.smithi077.stdout:3407 punch from 0x87c7fb to 0x87facb, (0x32d0 bytes) 2024-04-23T23:38:34.866 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.874 INFO:teuthology.orchestra.run.smithi077.stdout:3411 write 0xb1736ff thru 0xb179e8e (0x6790 bytes) 2024-04-23T23:38:34.876 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.876 INFO:teuthology.orchestra.run.smithi077.stdout:3413 read 0x525fad9 thru 0x526a3a2 (0xa8ca bytes) 2024-04-23T23:38:34.876 INFO:teuthology.orchestra.run.smithi077.stdout:3415 write 0xabad856 thru 0xabb9174 (0xb91f bytes) 2024-04-23T23:38:34.881 INFO:teuthology.orchestra.run.smithi077.stdout:3416 trunc from 0xb179e8f to 0x8e9aebd 2024-04-23T23:38:34.888 INFO:teuthology.orchestra.run.smithi077.stdout:3418 read 0x51cb640 thru 0x51d2169 (0x6b2a bytes) 2024-04-23T23:38:34.888 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.889 INFO:teuthology.orchestra.run.smithi077.stdout:3422 write 0x5200877 thru 0x5201ddb (0x1565 bytes) 2024-04-23T23:38:34.890 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.890 INFO:teuthology.orchestra.run.smithi077.stdout:3426 write 0x36023c2 thru 0x36070e1 (0x4d20 bytes) 2024-04-23T23:38:34.895 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:34.907+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:34.901 INFO:teuthology.orchestra.run.smithi077.stdout:3427 write 0xd1e75c6 thru 0xd1e9235 (0x1c70 bytes) 2024-04-23T23:38:34.904 INFO:teuthology.orchestra.run.smithi077.stdout:3428 read 0x45ea9ac thru 0x45f28d1 (0x7f26 bytes) 2024-04-23T23:38:34.905 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.905 INFO:teuthology.orchestra.run.smithi077.stdout:3430 write 0x86fd169 thru 0x870ba0f (0xe8a7 bytes) 2024-04-23T23:38:34.906 INFO:teuthology.orchestra.run.smithi077.stdout:3431 read 0xc10a205 thru 0xc10aade (0x8da bytes) 2024-04-23T23:38:34.907 INFO:teuthology.orchestra.run.smithi077.stdout:3432 punch from 0x1c7fa5a to 0x1c88f7e, (0x9524 bytes) 2024-04-23T23:38:34.907 INFO:teuthology.orchestra.run.smithi077.stdout:3433 punch from 0x6feec9b to 0x6ffebd2, (0xff37 bytes) 2024-04-23T23:38:34.907 INFO:teuthology.orchestra.run.smithi077.stdout:3434 write 0x20fe8c2 thru 0x2102f0c (0x464b bytes) 2024-04-23T23:38:34.923 INFO:teuthology.orchestra.run.smithi077.stdout:3435 trunc from 0xd1e9236 to 0x8fdc0e 2024-04-23T23:38:34.940 INFO:teuthology.orchestra.run.smithi077.stdout:3436 read 0x31221c thru 0x3178b2 (0x5697 bytes) 2024-04-23T23:38:34.941 INFO:teuthology.orchestra.run.smithi077.stdout:3439 punch from 0x39c963 to 0x3abbe0, (0xf27d bytes) 2024-04-23T23:38:34.941 INFO:teuthology.orchestra.run.smithi077.stdout:3440 punch from 0x8e68e9 to 0x8e863d, (0x1d54 bytes) 2024-04-23T23:38:34.953 INFO:teuthology.orchestra.run.smithi077.stdout:3441 writesame 0x6e38e70 thru 0x6e39a5d data_size 0x3(0xbee bytes) 2024-04-23T23:38:34.955 INFO:teuthology.orchestra.run.smithi077.stdout:3443 trunc from 0x6e39a5e to 0x6cb94b9 2024-04-23T23:38:34.961 INFO:teuthology.orchestra.run.smithi077.stdout:3445 write 0x857b7e thru 0x85e07b (0x64fe bytes) 2024-04-23T23:38:34.963 INFO:teuthology.orchestra.run.smithi077.stdout:3446 write 0x50031a8 thru 0x5011ed1 (0xed2a bytes) 2024-04-23T23:38:34.965 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.973 INFO:teuthology.orchestra.run.smithi077.stdout:3448 trunc from 0x6cb94b9 to 0xd75fcd6 2024-04-23T23:38:34.978 INFO:teuthology.orchestra.run.smithi077.stdout:3450 read 0x4035771 thru 0x403f00f (0x989f bytes) 2024-04-23T23:38:34.979 INFO:teuthology.orchestra.run.smithi077.stdout:3452 punch from 0xba769ff to 0xba846e5, (0xdce6 bytes) 2024-04-23T23:38:34.979 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:34.979 INFO:teuthology.orchestra.run.smithi077.stdout:3454 write 0x7e34e74 thru 0x7e372f2 (0x247f bytes) 2024-04-23T23:38:34.981 INFO:teuthology.orchestra.run.smithi077.stdout:3455 write 0x1c31a3 thru 0x1ce82f (0xb68d bytes) 2024-04-23T23:38:34.982 INFO:teuthology.orchestra.run.smithi077.stdout:3456 read 0x2d9e045 thru 0x2dab17e (0xd13a bytes) 2024-04-23T23:38:34.982 INFO:teuthology.orchestra.run.smithi077.stdout:3459 writesame 0x2d64b10 thru 0x2d685c0 data_size 0x5(0x3ab1 bytes) 2024-04-23T23:38:34.984 INFO:teuthology.orchestra.run.smithi077.stdout:3460 writesame 0x635147a thru 0x635e3d6 data_size 0x5(0xcf5d bytes) 2024-04-23T23:38:34.990 INFO:teuthology.orchestra.run.smithi077.stdout:3462 write 0x25cff4 thru 0x26b5b3 (0xe5c0 bytes) 2024-04-23T23:38:34.993 INFO:teuthology.orchestra.run.smithi077.stdout:3463 writesame 0x37c7c1b thru 0x37cdba5 data_size 0x1f(0x5f8b bytes) 2024-04-23T23:38:34.996 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:35.008+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:35.000 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.000 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.009 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:35.010 INFO:teuthology.orchestra.run.smithi077.stdout:3464 trunc from 0xd75fcd6 to 0x160645d 2024-04-23T23:38:35.035 INFO:teuthology.orchestra.run.smithi077.stdout:3465 writesame 0xc164320 thru 0xc167687 data_size 0x14(0x3368 bytes) 2024-04-23T23:38:35.036 INFO:teuthology.orchestra.run.smithi077.stdout:3466 write 0x826a622 thru 0x8278764 (0xe143 bytes) 2024-04-23T23:38:35.049 INFO:teuthology.orchestra.run.smithi077.stdout:3467 trunc from 0xc167688 to 0x22efa97 2024-04-23T23:38:35.066 INFO:teuthology.orchestra.run.smithi077.stdout:3468 trunc from 0x22efa97 to 0x97082d4 2024-04-23T23:38:35.071 INFO:teuthology.orchestra.run.smithi077.stdout:3469 punch from 0x4505fd4 to 0x450b191, (0x51bd bytes) 2024-04-23T23:38:35.081 INFO:teuthology.orchestra.run.smithi077.stdout:3470 write 0xd6fe33d thru 0xd707509 (0x91cd bytes) 2024-04-23T23:38:35.082 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-04-23T23:38:35.088 INFO:teuthology.orchestra.run.smithi077.stdout:3473 writesame 0x43518f5 thru 0x4359fa9 data_size 0x39(0x86b5 bytes) 2024-04-23T23:38:35.091 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.092 INFO:teuthology.orchestra.run.smithi077.stdout:3475 write 0x6d717df thru 0x6d802fc (0xeb1e bytes) 2024-04-23T23:38:35.093 INFO:teuthology.orchestra.run.smithi077.stdout:3477 write 0x229dfa2 thru 0x22a7862 (0x98c1 bytes) 2024-04-23T23:38:35.095 INFO:teuthology.orchestra.run.smithi077.stdout:3479 punch from 0x19888b0 to 0x1996407, (0xdb57 bytes) 2024-04-23T23:38:35.095 INFO:teuthology.orchestra.run.smithi077.stdout:3481 read 0xe315c thru 0xf1d0a (0xebaf bytes) 2024-04-23T23:38:35.095 INFO:teuthology.orchestra.run.smithi077.stdout:3482 writesame 0xd2ea76e thru 0xd2f3b1e data_size 0x3(0x93b1 bytes) 2024-04-23T23:38:35.097 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:35.110+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:35.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-23T23:38:35.104 INFO:teuthology.orchestra.run.smithi077.stdout:3483 write 0xa114a88 thru 0xa118f21 (0x449a bytes) 2024-04-23T23:38:35.106 INFO:teuthology.orchestra.run.smithi077.stdout:3484 read 0x8d65df6 thru 0x8d71226 (0xb431 bytes) 2024-04-23T23:38:35.106 INFO:teuthology.orchestra.run.smithi077.stdout:3485 writesame 0x952d4cf thru 0x953643c data_size 0xb(0x8f6e bytes) 2024-04-23T23:38:35.108 INFO:teuthology.orchestra.run.smithi077.stdout:3486 read 0xb5bbb81 thru 0xb5c240b (0x688b bytes) 2024-04-23T23:38:35.108 INFO:teuthology.orchestra.run.smithi077.stdout:3488 read 0xc8485be thru 0xc8558cd (0xd310 bytes) 2024-04-23T23:38:35.109 INFO:teuthology.orchestra.run.smithi077.stdout:3490 write 0x7a204e1 thru 0x7a2d420 (0xcf40 bytes) 2024-04-23T23:38:35.110 INFO:teuthology.orchestra.run.smithi077.stdout:3492 read 0x42eaff9 thru 0x42ef700 (0x4708 bytes) 2024-04-23T23:38:35.119 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.120 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.124 INFO:teuthology.orchestra.run.smithi077.stdout:3493 trunc from 0xd70750a to 0x23b8738 2024-04-23T23:38:35.129 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:35.136 INFO:teuthology.orchestra.run.smithi077.stdout:3494 read 0x10b0cfe thru 0x10bd10f (0xc412 bytes) 2024-04-23T23:38:35.136 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.136 INFO:teuthology.orchestra.run.smithi077.stdout:3497 read 0x1eaa189 thru 0x1eb5730 (0xb5a8 bytes) 2024-04-23T23:38:35.137 INFO:teuthology.orchestra.run.smithi077.stdout:3498 punch from 0x1000262 to 0x100ba0a, (0xb7a8 bytes) 2024-04-23T23:38:35.137 INFO:teuthology.orchestra.run.smithi077.stdout:3499 read 0x19d32cd thru 0x19d6087 (0x2dbb bytes) 2024-04-23T23:38:35.137 INFO:teuthology.orchestra.run.smithi077.stdout:3500 read 0xa09d7 thru 0xa7140 (0x676a bytes) 2024-04-23T23:38:35.137 INFO:teuthology.orchestra.run.smithi077.stdout:3501 read 0x3ef291 thru 0x3f2260 (0x2fd0 bytes) 2024-04-23T23:38:35.144 INFO:teuthology.orchestra.run.smithi077.stdout:3503 trunc from 0x23b8738 to 0x7945e25 2024-04-23T23:38:35.149 INFO:teuthology.orchestra.run.smithi077.stdout:3504 read 0x2f5a84f thru 0x2f6932d (0xeadf bytes) 2024-04-23T23:38:35.149 INFO:teuthology.orchestra.run.smithi077.stdout:3505 trunc from 0x7945e25 to 0x771f614 2024-04-23T23:38:35.158 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.158 INFO:teuthology.orchestra.run.smithi077.stdout:3508 read 0x5618a10 thru 0x561f0a1 (0x6692 bytes) 2024-04-23T23:38:35.158 INFO:teuthology.orchestra.run.smithi077.stdout:3509 punch from 0x42bb3a7 to 0x42c0f61, (0x5bba bytes) 2024-04-23T23:38:35.158 INFO:teuthology.orchestra.run.smithi077.stdout:3511 write 0x6a40d3e thru 0x6a41c18 (0xedb bytes) 2024-04-23T23:38:35.159 INFO:teuthology.orchestra.run.smithi077.stdout:3512 read 0x563d814 thru 0x56493c6 (0xbbb3 bytes) 2024-04-23T23:38:35.164 INFO:teuthology.orchestra.run.smithi077.stdout:3513 trunc from 0x771f614 to 0x4035727 2024-04-23T23:38:35.173 INFO:teuthology.orchestra.run.smithi077.stdout:3514 write 0x29a7095 thru 0x29af29a (0x8206 bytes) 2024-04-23T23:38:35.182 INFO:teuthology.orchestra.run.smithi077.stdout:3515 trunc from 0x4035727 to 0xac3a709 2024-04-23T23:38:35.196 INFO:teuthology.orchestra.run.smithi077.stdout:3516 writesame 0xd3e3ac9 thru 0xd3f09d8 data_size 0x8(0xcf10 bytes) 2024-04-23T23:38:35.196 INFO:teuthology.orchestra.run.smithi077.stdout:3517 read 0x8008256 thru 0x8009627 (0x13d2 bytes) 2024-04-23T23:38:35.196 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.198 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:35.211+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:35.202 INFO:teuthology.orchestra.run.smithi077.stdout:3519 trunc from 0xd3f09d9 to 0x7d43a4c 2024-04-23T23:38:35.212 INFO:teuthology.orchestra.run.smithi077.stdout:3520 write 0x5e6cd5 thru 0x5e7bc8 (0xef4 bytes) 2024-04-23T23:38:35.214 INFO:teuthology.orchestra.run.smithi077.stdout:3522 punch from 0x51778fb to 0x517c526, (0x4c2b bytes) 2024-04-23T23:38:35.214 INFO:teuthology.orchestra.run.smithi077.stdout:3523 read 0x1459f21 thru 0x1463cea (0x9dca bytes) 2024-04-23T23:38:35.214 INFO:teuthology.orchestra.run.smithi077.stdout:3525 read 0x5dc6a57 thru 0x5dd2d1e (0xc2c8 bytes) 2024-04-23T23:38:35.220 INFO:teuthology.orchestra.run.smithi077.stdout:3526 trunc from 0x7d43a4c to 0x33e4766 2024-04-23T23:38:35.228 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.235 INFO:teuthology.orchestra.run.smithi077.stdout:3528 trunc from 0x33e4766 to 0x871fd47 2024-04-23T23:38:35.247 INFO:teuthology.orchestra.run.smithi077.stdout:3529 write 0x9df522d thru 0x9dfcba3 (0x7977 bytes) 2024-04-23T23:38:35.248 INFO:teuthology.orchestra.run.smithi077.stdout:3530 write 0x7f53bc1 thru 0x7f5a262 (0x66a2 bytes) 2024-04-23T23:38:35.249 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.250 INFO:teuthology.orchestra.run.smithi077.stdout:3535 read 0x55ff933 thru 0x56067a4 (0x6e72 bytes) 2024-04-23T23:38:35.250 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.250 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.250 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.250 INFO:teuthology.orchestra.run.smithi077.stdout:3540 read 0x2b0da50 thru 0x2b18f3d (0xb4ee bytes) 2024-04-23T23:38:35.251 INFO:teuthology.orchestra.run.smithi077.stdout:3544 write 0x4d866d7 thru 0x4d90883 (0xa1ad bytes) 2024-04-23T23:38:35.252 INFO:teuthology.orchestra.run.smithi077.stdout:3547 read 0x9b04577 thru 0x9b11e75 (0xd8ff bytes) 2024-04-23T23:38:35.252 INFO:teuthology.orchestra.run.smithi077.stdout:3548 read 0x5c8ac7a thru 0x5c8b35f (0x6e6 bytes) 2024-04-23T23:38:35.253 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.253 INFO:teuthology.orchestra.run.smithi077.stdout:3552 trunc from 0x9dfcba4 to 0xa496dc9 2024-04-23T23:38:35.258 INFO:teuthology.orchestra.run.smithi077.stdout:3553 writesame 0x865402d thru 0x865ff17 data_size 0x19(0xbeeb bytes) 2024-04-23T23:38:35.260 INFO:teuthology.orchestra.run.smithi077.stdout:3554 read 0x89d977 thru 0x8a73b0 (0x9a3a bytes) 2024-04-23T23:38:35.261 INFO:teuthology.orchestra.run.smithi077.stdout:3555 read 0x93358d4 thru 0x933e8be (0x8feb bytes) 2024-04-23T23:38:35.261 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:35.261 INFO:teuthology.orchestra.run.smithi077.stdout:3558 write 0x7fded4e thru 0x7fe74b1 (0x8764 bytes) 2024-04-23T23:38:35.268 INFO:teuthology.orchestra.run.smithi077.stdout:3561 trunc from 0xa496dc9 to 0x5bbdfff 2024-04-23T23:38:35.277 INFO:teuthology.orchestra.run.smithi077.stdout:3563 clone 28 order 22 su 32768 sc 7 2024-04-23T23:38:35.279 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.279 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:35.332 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:35.345+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:35.390 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.390 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.399 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:35.400 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:35.412+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:35.501 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:35.514+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:35.541 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.541 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:35.634 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:35.647+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:35.692 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.692 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.700 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:35.742 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:35.754+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:35.804 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:35.817+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:35.845 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.845 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:35.854 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:35.905 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:35.918+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:35.997 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:35.997 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:36.006 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:36.006 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:36.018+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:36.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:38:36.100 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-04-23T23:38:36.106 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:36.119+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:36.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-23T23:38:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:36.151 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:36.161 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:36.174 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone27 from 0x5bbdfff (overlap 0x8fdc0e) to 0x64b3a3 2024-04-23T23:38:36.245 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:36.258+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:36.248 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-04-23T23:38:36.249 INFO:teuthology.orchestra.run.smithi077.stdout:3564 punch from 0x5489787 to 0x5498711, (0xef8a bytes) 2024-04-23T23:38:36.253 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.270 INFO:teuthology.orchestra.run.smithi077.stdout:3566 write 0xe819a6d thru 0xe82662d (0xcbc1 bytes) 2024-04-23T23:38:36.273 INFO:teuthology.orchestra.run.smithi077.stdout:3568 read 0x2064af7 thru 0x2068830 (0x3d3a bytes) 2024-04-23T23:38:36.274 INFO:teuthology.orchestra.run.smithi077.stdout:3571 read 0x492ad12 thru 0x493aada (0xfdc9 bytes) 2024-04-23T23:38:36.275 INFO:teuthology.orchestra.run.smithi077.stdout:3572 punch from 0x9894006 to 0x98942a3, (0x29d bytes) 2024-04-23T23:38:36.275 INFO:teuthology.orchestra.run.smithi077.stdout:3574 write 0x8aebf7d thru 0x8af2d20 (0x6da4 bytes) 2024-04-23T23:38:36.282 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.282 INFO:teuthology.orchestra.run.smithi077.stdout:3580 write 0x37da171 thru 0x37e0cf9 (0x6b89 bytes) 2024-04-23T23:38:36.308 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:36.321+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:36.315 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:36.315 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:36.319 INFO:teuthology.orchestra.run.smithi077.stdout:3581 write 0x454ba0c thru 0x454ff5f (0x4554 bytes) 2024-04-23T23:38:36.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:36.330 INFO:teuthology.orchestra.run.smithi077.stdout:3582 write 0xdd8fa9b thru 0xdd96e07 (0x736d bytes) 2024-04-23T23:38:36.334 INFO:teuthology.orchestra.run.smithi077.stdout:3583 writesame 0x93e2bb4 thru 0x93e4534 data_size 0x1(0x1981 bytes) 2024-04-23T23:38:36.339 INFO:teuthology.orchestra.run.smithi077.stdout:3584 read 0x1eb68e4 thru 0x1ec186d (0xaf8a bytes) 2024-04-23T23:38:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:3585 read 0xb0d9d50 thru 0xb0da514 (0x7c5 bytes) 2024-04-23T23:38:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:3586 read 0x68a8135 thru 0x68af6f1 (0x75bd bytes) 2024-04-23T23:38:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:3589 read 0x3995627 thru 0x39a084c (0xb226 bytes) 2024-04-23T23:38:36.341 INFO:teuthology.orchestra.run.smithi077.stdout:3591 read 0x2452163 thru 0x245790f (0x57ad bytes) 2024-04-23T23:38:36.342 INFO:teuthology.orchestra.run.smithi077.stdout:3592 read 0x397d59b thru 0x398c83e (0xf2a4 bytes) 2024-04-23T23:38:36.342 INFO:teuthology.orchestra.run.smithi077.stdout:3593 write 0x5c4d382 thru 0x5c4e72b (0x13aa bytes) 2024-04-23T23:38:36.347 INFO:teuthology.orchestra.run.smithi077.stdout:3594 read 0xe7d599a thru 0xe7e40b8 (0xe71f bytes) 2024-04-23T23:38:36.348 INFO:teuthology.orchestra.run.smithi077.stdout:3596 read 0x963a123 thru 0x9643c47 (0x9b25 bytes) 2024-04-23T23:38:36.348 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.348 INFO:teuthology.orchestra.run.smithi077.stdout:3599 punch from 0x2caaee1 to 0x2cb0d36, (0x5e55 bytes) 2024-04-23T23:38:36.348 INFO:teuthology.orchestra.run.smithi077.stdout:3600 write 0xd11dc7c thru 0xd1278bb (0x9c40 bytes) 2024-04-23T23:38:36.352 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.352 INFO:teuthology.orchestra.run.smithi077.stdout:3602 read 0x80bddac thru 0x80c6097 (0x82ec bytes) 2024-04-23T23:38:36.352 INFO:teuthology.orchestra.run.smithi077.stdout:3604 read 0xc054ce9 thru 0xc064a7c (0xfd94 bytes) 2024-04-23T23:38:36.352 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.352 INFO:teuthology.orchestra.run.smithi077.stdout:3607 read 0xd42f8d1 thru 0xd43d761 (0xde91 bytes) 2024-04-23T23:38:36.352 INFO:teuthology.orchestra.run.smithi077.stdout:3608 write 0xa2b4f1d thru 0xa2bb813 (0x68f7 bytes) 2024-04-23T23:38:36.356 INFO:teuthology.orchestra.run.smithi077.stdout:3609 writesame 0xcc2b500 thru 0xcc32aeb data_size 0x2(0x75ec bytes) 2024-04-23T23:38:36.364 INFO:teuthology.orchestra.run.smithi077.stdout:3610 read 0x6904d71 thru 0x6905abe (0xd4e bytes) 2024-04-23T23:38:36.364 INFO:teuthology.orchestra.run.smithi077.stdout:3611 read 0x25e44bf thru 0x25f4004 (0xfb46 bytes) 2024-04-23T23:38:36.371 INFO:teuthology.orchestra.run.smithi077.stdout:3612 trunc from 0xe82662e to 0x975fd7c 2024-04-23T23:38:36.384 INFO:teuthology.orchestra.run.smithi077.stdout:3613 trunc from 0x975fd7c to 0x813a294 2024-04-23T23:38:36.404 INFO:teuthology.orchestra.run.smithi077.stdout:3614 writesame 0xbefbed4 thru 0xbf073dc data_size 0x73(0xb509 bytes) 2024-04-23T23:38:36.404 INFO:teuthology.orchestra.run.smithi077.stdout:3615 read 0x74b9d3f thru 0x74bf43e (0x5700 bytes) 2024-04-23T23:38:36.406 INFO:teuthology.orchestra.run.smithi077.stdout:3616 trunc from 0xbf073dd to 0xdf9fc90 2024-04-23T23:38:36.408 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:36.421+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:36.411 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.414 INFO:teuthology.orchestra.run.smithi077.stdout:3619 trunc from 0xdf9fc90 to 0xbf94ea5 2024-04-23T23:38:36.419 INFO:teuthology.orchestra.run.smithi077.stdout:3620 read 0x631d950 thru 0x632d71f (0xfdd0 bytes) 2024-04-23T23:38:36.419 INFO:teuthology.orchestra.run.smithi077.stdout:3621 read 0x89d01fc thru 0x89de548 (0xe34d bytes) 2024-04-23T23:38:36.419 INFO:teuthology.orchestra.run.smithi077.stdout:3622 write 0x983e9f8 thru 0x9847cc6 (0x92cf bytes) 2024-04-23T23:38:36.424 INFO:teuthology.orchestra.run.smithi077.stdout:3624 read 0x604bce0 thru 0x605215e (0x647f bytes) 2024-04-23T23:38:36.434 INFO:teuthology.orchestra.run.smithi077.stdout:3625 trunc from 0xbf94ea5 to 0x3a0ee93 2024-04-23T23:38:36.487 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:36.487 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:36.498 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:36.509 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:36.522+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:36.511 INFO:teuthology.orchestra.run.smithi077.stdout:3627 trunc from 0x3a0ee93 to 0xe741e7e 2024-04-23T23:38:36.531 INFO:teuthology.orchestra.run.smithi077.stdout:3629 trunc from 0xe741e7e to 0x2290c12 2024-04-23T23:38:36.586 INFO:teuthology.orchestra.run.smithi077.stdout:3630 writesame 0x34e3425 thru 0x34e9faf data_size 0x17(0x6b8b bytes) 2024-04-23T23:38:36.602 INFO:teuthology.orchestra.run.smithi077.stdout:3631 write 0xaeced59 thru 0xaedcce5 (0xdf8d bytes) 2024-04-23T23:38:36.607 INFO:teuthology.orchestra.run.smithi077.stdout:3632 punch from 0x84b7adb to 0x84b9382, (0x18a7 bytes) 2024-04-23T23:38:36.607 INFO:teuthology.orchestra.run.smithi077.stdout:3633 punch from 0x3d94392 to 0x3da0929, (0xc597 bytes) 2024-04-23T23:38:36.607 INFO:teuthology.orchestra.run.smithi077.stdout:3634 read 0x6dafc5e thru 0x6db204d (0x23f0 bytes) 2024-04-23T23:38:36.607 INFO:teuthology.orchestra.run.smithi077.stdout:3635 punch from 0x3c73b48 to 0x3c7f03d, (0xb4f5 bytes) 2024-04-23T23:38:36.607 INFO:teuthology.orchestra.run.smithi077.stdout:3636 write 0x103f19b thru 0x104a66f (0xb4d5 bytes) 2024-04-23T23:38:36.611 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:36.622+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:36.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:36.649 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:36.649 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:36.658 INFO:teuthology.orchestra.run.smithi077.stdout:3637 write 0xdcb7877 thru 0xdcc76dc (0xfe66 bytes) 2024-04-23T23:38:36.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:36.663 INFO:teuthology.orchestra.run.smithi077.stdout:3638 punch from 0x7479da6 to 0x7485a60, (0xbcba bytes) 2024-04-23T23:38:36.663 INFO:teuthology.orchestra.run.smithi077.stdout:3639 write 0xd65dcac thru 0xd6683e4 (0xa739 bytes) 2024-04-23T23:38:36.665 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.665 INFO:teuthology.orchestra.run.smithi077.stdout:3642 punch from 0x6c55ec8 to 0x6c63ebf, (0xdff7 bytes) 2024-04-23T23:38:36.665 INFO:teuthology.orchestra.run.smithi077.stdout:3644 flatten 2024-04-23T23:38:36.712 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:36.724+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:36.730 INFO:teuthology.orchestra.run.smithi077.stdout:3646 read 0x1a57462 thru 0x1a635e8 (0xc187 bytes) 2024-04-23T23:38:36.731 INFO:teuthology.orchestra.run.smithi077.stdout:3647 writesame 0xbbb66ae thru 0xbbc55da data_size 0x1(0xef2d bytes) 2024-04-23T23:38:36.750 INFO:teuthology.orchestra.run.smithi077.stdout:3649 punch from 0x8e37b6f to 0x8e3d4aa, (0x593b bytes) 2024-04-23T23:38:36.750 INFO:teuthology.orchestra.run.smithi077.stdout:3650 punch from 0xd18caff to 0xd191de3, (0x52e4 bytes) 2024-04-23T23:38:36.750 INFO:teuthology.orchestra.run.smithi077.stdout:3651 read 0x7e47b40 thru 0x7e54dff (0xd2c0 bytes) 2024-04-23T23:38:36.750 INFO:teuthology.orchestra.run.smithi077.stdout:3652 write 0x1e2ccee thru 0x1e39005 (0xc318 bytes) 2024-04-23T23:38:36.752 INFO:teuthology.orchestra.run.smithi077.stdout:3655 writesame 0xbaf58c5 thru 0xbafdb6b data_size 0x1(0x82a7 bytes) 2024-04-23T23:38:36.768 INFO:teuthology.orchestra.run.smithi077.stdout:3656 write 0xbe4971 thru 0xbf3dff (0xf48f bytes) 2024-04-23T23:38:36.770 INFO:teuthology.orchestra.run.smithi077.stdout:3657 write 0x6f52fa7 thru 0x6f62ae2 (0xfb3c bytes) 2024-04-23T23:38:36.772 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:36.772 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:36.774 INFO:teuthology.orchestra.run.smithi077.stdout:3658 read 0xbce7f2e thru 0xbce9c8e (0x1d61 bytes) 2024-04-23T23:38:36.775 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.775 INFO:teuthology.orchestra.run.smithi077.stdout:3661 punch from 0x23213d4 to 0x232b541, (0xa16d bytes) 2024-04-23T23:38:36.775 INFO:teuthology.orchestra.run.smithi077.stdout:3662 write 0xc01a53 thru 0xc1105a (0xf608 bytes) 2024-04-23T23:38:36.777 INFO:teuthology.orchestra.run.smithi077.stdout:3663 read 0xb8a694c thru 0xb8b12c1 (0xa976 bytes) 2024-04-23T23:38:36.778 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.778 INFO:teuthology.orchestra.run.smithi077.stdout:3665 read 0x9d24214 thru 0x9d2f2f6 (0xb0e3 bytes) 2024-04-23T23:38:36.778 INFO:teuthology.orchestra.run.smithi077.stdout:3666 write 0x12ae0df thru 0x12b4412 (0x6334 bytes) 2024-04-23T23:38:36.779 INFO:teuthology.orchestra.run.smithi077.stdout:3667 read 0x4f1451c thru 0x4f1b35a (0x6e3f bytes) 2024-04-23T23:38:36.780 INFO:teuthology.orchestra.run.smithi077.stdout:3668 writesame 0x2ec9e12 thru 0x2ed2477 data_size 0x1(0x8666 bytes) 2024-04-23T23:38:36.793 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.793 INFO:teuthology.orchestra.run.smithi077.stdout:3670 write 0x28c6de thru 0x296304 (0x9c27 bytes) 2024-04-23T23:38:36.795 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:36.795 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:36.804 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:36.804 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706623792000002, 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:36.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:36.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706610146999999, 2024-04-23T23:38:36.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:36.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706597097, 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.814 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:36.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:36.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:36.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706586078000001, 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.820 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:36.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:36.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706577003, 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:36.824 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.828 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706565058999999, 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:36.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.833 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.706555948000002, 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:36.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:36.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.704910576000003, 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:36.838 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:36.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:36.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.842 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.704898327000002, 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.843 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700719734000003, 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700707952000002, 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.851 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:36.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:36.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700697882999997, 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.855 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:36.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:36.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700686224000002, 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.859 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:36.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700676903999998, 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:36.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700666392000002, 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:36.867 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:36.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700656952000003, 2024-04-23T23:38:36.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:36.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.875 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700461859000001, 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:36.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:36.879 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700440825999998, 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:36.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:36.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.700426936, 2024-04-23T23:38:36.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:36.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.097270430999998, 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:36.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:36.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:36.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:36.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:36.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:36.892 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:36.893 INFO:teuthology.orchestra.run.smithi077.stdout:3671 trunc from 0xdcc76dd to 0x60a47ae 2024-04-23T23:38:36.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:36.895 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:36.895 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:36.895 INFO:teuthology.orchestra.run.smithi077.stdout:3673 write 0xb9c2038 thru 0xb9d0489 (0xe452 bytes) 2024-04-23T23:38:36.895 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:36.896 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:36.896 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.896 INFO:teuthology.orchestra.run.smithi077.stdout:3675 trunc from 0xb9d048a to 0x71e0429 2024-04-23T23:38:36.896 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:36.897 INFO:teuthology.orchestra.run.smithi077.stdout:3676 writesame 0xdd38dac thru 0xdd3b400 data_size 0x1(0x2655 bytes) 2024-04-23T23:38:36.897 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:36.897 INFO:teuthology.orchestra.run.smithi077.stdout:3679 trunc from 0xdd3b401 to 0xbbee70 2024-04-23T23:38:36.898 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:36.898 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:36.898 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:36.905+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:36.919 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:36.919 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:36.925 INFO:teuthology.orchestra.run.smithi077.stdout:3680 write 0xd6bea9d thru 0xd6c10eb (0x264f bytes) 2024-04-23T23:38:36.930 INFO:teuthology.orchestra.run.smithi077.stdout:3681 read 0xcdcaf32 thru 0xcdd8ef1 (0xdfc0 bytes) 2024-04-23T23:38:36.938 INFO:teuthology.orchestra.run.smithi077.stdout:3682 write 0xec2e5a9 thru 0xec3be0b (0xd863 bytes) 2024-04-23T23:38:36.939 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:36.962 INFO:teuthology.orchestra.run.smithi077.stdout:3683 trunc from 0xec3be0c to 0x18c7f68 2024-04-23T23:38:36.991 INFO:teuthology.orchestra.run.smithi077.stdout:3684 write 0x9c57742 thru 0x9c5aba0 (0x345f bytes) 2024-04-23T23:38:36.994 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:37.006+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:36.995 INFO:teuthology.orchestra.run.smithi077.stdout:3685 read 0x947d93 thru 0x955273 (0xd4e1 bytes) 2024-04-23T23:38:36.996 INFO:teuthology.orchestra.run.smithi077.stdout:3686 read 0x44c09de thru 0x44c85b1 (0x7bd4 bytes) 2024-04-23T23:38:37.006 INFO:teuthology.orchestra.run.smithi077.stdout:3690 write 0xd27b7bd thru 0xd281d56 (0x659a bytes) 2024-04-23T23:38:37.009 INFO:teuthology.orchestra.run.smithi077.stdout:3691 read 0x14be5c5 thru 0x14c3103 (0x4b3f bytes) 2024-04-23T23:38:37.016 INFO:teuthology.orchestra.run.smithi077.stdout:3692 trunc from 0xd281d57 to 0x785445f 2024-04-23T23:38:37.025 INFO:teuthology.orchestra.run.smithi077.stdout:3695 punch from 0x38fc81 to 0x39df58, (0xe2d7 bytes) 2024-04-23T23:38:37.026 INFO:teuthology.orchestra.run.smithi077.stdout:3696 trunc from 0x785445f to 0x690dcfb 2024-04-23T23:38:37.037 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:37.037 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:37.037 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:37.037 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:37.039 INFO:teuthology.orchestra.run.smithi077.stdout:3698 writesame 0x92e8aa2 thru 0x92f6e56 data_size 0x33(0xe3b5 bytes) 2024-04-23T23:38:37.040 INFO:teuthology.orchestra.run.smithi077.stdout:3699 punch from 0x32a3a9e to 0x32aab6f, (0x70d1 bytes) 2024-04-23T23:38:37.040 INFO:teuthology.orchestra.run.smithi077.stdout:3700 read 0x7e4e701 thru 0x7e5d834 (0xf134 bytes) 2024-04-23T23:38:37.040 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.045 INFO:teuthology.orchestra.run.smithi077.stdout:3703 trunc from 0x92f6e57 to 0x4116b73 2024-04-23T23:38:37.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:37.050 INFO:teuthology.orchestra.run.smithi077.stdout:3704 write 0x16447c3 thru 0x16474ad (0x2ceb bytes) 2024-04-23T23:38:37.067 INFO:teuthology.orchestra.run.smithi077.stdout:3705 write 0xd3163c5 thru 0xd316a11 (0x64d bytes) 2024-04-23T23:38:37.070 INFO:teuthology.orchestra.run.smithi077.stdout:3706 read 0x84dfa0d thru 0x84e5a2a (0x601e bytes) 2024-04-23T23:38:37.070 INFO:teuthology.orchestra.run.smithi077.stdout:3707 write 0xce0f965 thru 0xce1cec1 (0xd55d bytes) 2024-04-23T23:38:37.082 INFO:teuthology.orchestra.run.smithi077.stdout:3708 write 0xdd37786 thru 0xdd3f07c (0x78f7 bytes) 2024-04-23T23:38:37.086 INFO:teuthology.orchestra.run.smithi077.stdout:3711 read 0x32e23b8 thru 0x32e3aa9 (0x16f2 bytes) 2024-04-23T23:38:37.086 INFO:teuthology.orchestra.run.smithi077.stdout:3712 punch from 0xd4adb9b to 0xd4b803b, (0xa4a0 bytes) 2024-04-23T23:38:37.086 INFO:teuthology.orchestra.run.smithi077.stdout:3713 writesame 0x33dbf67 thru 0x33e130b data_size 0x31(0x53a5 bytes) 2024-04-23T23:38:37.089 INFO:teuthology.orchestra.run.smithi077.stdout:3714 punch from 0xba444fb to 0xba514b0, (0xcfb5 bytes) 2024-04-23T23:38:37.089 INFO:teuthology.orchestra.run.smithi077.stdout:3715 punch from 0x1d8e6dc to 0x1d909b5, (0x22d9 bytes) 2024-04-23T23:38:37.090 INFO:teuthology.orchestra.run.smithi077.stdout:3717 write 0xb89a5c8 thru 0xb89f0eb (0x4b24 bytes) 2024-04-23T23:38:37.092 INFO:teuthology.orchestra.run.smithi077.stdout:3718 punch from 0x117c904 to 0x1185363, (0x8a5f bytes) 2024-04-23T23:38:37.092 INFO:teuthology.orchestra.run.smithi077.stdout:3719 write 0xb7723ab thru 0xb77a777 (0x83cd bytes) 2024-04-23T23:38:37.095 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:37.107+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:37.096 INFO:teuthology.orchestra.run.smithi077.stdout:3722 read 0xa11298f thru 0xa11ba6b (0x90dd bytes) 2024-04-23T23:38:37.104 INFO:teuthology.orchestra.run.smithi077.stdout:3723 trunc from 0xdd3f07d to 0x79e9cd9 2024-04-23T23:38:37.105 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:38:37.106 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.5 to 1 (10000) 2024-04-23T23:38:37.118 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.118 INFO:teuthology.orchestra.run.smithi077.stdout:3727 write 0x13b782 thru 0x140d07 (0x5586 bytes) 2024-04-23T23:38:37.120 INFO:teuthology.orchestra.run.smithi077.stdout:3728 punch from 0x41cdca4 to 0x41d79c0, (0x9d1c bytes) 2024-04-23T23:38:37.120 INFO:teuthology.orchestra.run.smithi077.stdout:3729 read 0x5bd051f thru 0x5bdade1 (0xa8c3 bytes) 2024-04-23T23:38:37.120 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.120 INFO:teuthology.orchestra.run.smithi077.stdout:3732 write 0x33d439b thru 0x33dff6f (0xbbd5 bytes) 2024-04-23T23:38:37.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-23T23:38:37.127 INFO:teuthology.orchestra.run.smithi077.stdout:3734 read 0xb403e7 thru 0xb4ba5d (0xb677 bytes) 2024-04-23T23:38:37.128 INFO:teuthology.orchestra.run.smithi077.stdout:3736 read 0x5ee3228 thru 0x5eea269 (0x7042 bytes) 2024-04-23T23:38:37.128 INFO:teuthology.orchestra.run.smithi077.stdout:3737 read 0x160fac8 thru 0x16194bb (0x99f4 bytes) 2024-04-23T23:38:37.128 INFO:teuthology.orchestra.run.smithi077.stdout:3738 read 0x480c700 thru 0x481baac (0xf3ad bytes) 2024-04-23T23:38:37.128 INFO:teuthology.orchestra.run.smithi077.stdout:3739 read 0x31b882d thru 0x31b9e00 (0x15d4 bytes) 2024-04-23T23:38:37.128 INFO:teuthology.orchestra.run.smithi077.stdout:3740 punch from 0x720b8ae to 0x721a09d, (0xe7ef bytes) 2024-04-23T23:38:37.143 INFO:teuthology.orchestra.run.smithi077.stdout:3741 write 0xd2a446b thru 0xd2b1752 (0xd2e8 bytes) 2024-04-23T23:38:37.147 INFO:teuthology.orchestra.run.smithi077.stdout:3742 writesame 0x60cd96 thru 0x6192fc data_size 0x3(0xc567 bytes) 2024-04-23T23:38:37.155 INFO:teuthology.orchestra.run.smithi077.stdout:3743 write 0x47bed1a thru 0x47cc7ff (0xdae6 bytes) 2024-04-23T23:38:37.160 INFO:teuthology.orchestra.run.smithi077.stdout:3744 punch from 0xb549406 to 0xb55182d, (0x8427 bytes) 2024-04-23T23:38:37.160 INFO:teuthology.orchestra.run.smithi077.stdout:3745 read 0x2e001f1 thru 0x2e02eb9 (0x2cc9 bytes) 2024-04-23T23:38:37.161 INFO:teuthology.orchestra.run.smithi077.stdout:3746 write 0x9d54025 thru 0x9d5882c (0x4808 bytes) 2024-04-23T23:38:37.164 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.164 INFO:teuthology.orchestra.run.smithi077.stdout:3750 write 0xa1399d6 thru 0xa13aef9 (0x1524 bytes) 2024-04-23T23:38:37.167 INFO:teuthology.orchestra.run.smithi077.stdout:3751 write 0xc218aec thru 0xc220092 (0x75a7 bytes) 2024-04-23T23:38:37.176 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:37.176 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:37.177 INFO:teuthology.orchestra.run.smithi077.stdout:3752 writesame 0xdc874d7 thru 0xdc8fbe2 data_size 0x56(0x870c bytes) 2024-04-23T23:38:37.184 INFO:teuthology.orchestra.run.smithi077.stdout:3753 writesame 0xe83b217 thru 0xe84589f data_size 0x9(0xa689 bytes) 2024-04-23T23:38:37.184 INFO:teuthology.orchestra.run.smithi077.stdout:3754 write 0xa146569 thru 0xa151807 (0xb29f bytes) 2024-04-23T23:38:37.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:37.188 INFO:teuthology.orchestra.run.smithi077.stdout:3757 write 0x2b98c90 thru 0x2b9c24d (0x35be bytes) 2024-04-23T23:38:37.190 INFO:teuthology.orchestra.run.smithi077.stdout:3758 writesame 0x38acb34 thru 0x38af2b0 data_size 0x1(0x277d bytes) 2024-04-23T23:38:37.196 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:37.208+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:37.197 INFO:teuthology.orchestra.run.smithi077.stdout:3759 trunc from 0xe8458a0 to 0xd36e3fd 2024-04-23T23:38:37.204 INFO:teuthology.orchestra.run.smithi077.stdout:3760 punch from 0x3878a6a to 0x3886afe, (0xe094 bytes) 2024-04-23T23:38:37.204 INFO:teuthology.orchestra.run.smithi077.stdout:3761 write 0x2b89717 thru 0x2b91c55 (0x853f bytes) 2024-04-23T23:38:37.206 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.206 INFO:teuthology.orchestra.run.smithi077.stdout:3764 writesame 0x21b5f2c thru 0x21bedcf data_size 0x66(0x8ea4 bytes) 2024-04-23T23:38:37.207 INFO:teuthology.orchestra.run.smithi077.stdout:3765 read 0x60dabe2 thru 0x60e3d09 (0x9128 bytes) 2024-04-23T23:38:37.208 INFO:teuthology.orchestra.run.smithi077.stdout:3766 write 0xaf2caae thru 0xaf3476a (0x7cbd bytes) 2024-04-23T23:38:37.211 INFO:teuthology.orchestra.run.smithi077.stdout:3768 punch from 0x434aac0 to 0x434ad70, (0x2b0 bytes) 2024-04-23T23:38:37.217 INFO:teuthology.orchestra.run.smithi077.stdout:3769 trunc from 0xd36e3fd to 0x868eb14 2024-04-23T23:38:37.228 INFO:teuthology.orchestra.run.smithi077.stdout:3770 punch from 0x2b63eb8 to 0x2b7276a, (0xe8b2 bytes) 2024-04-23T23:38:37.229 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.229 INFO:teuthology.orchestra.run.smithi077.stdout:3772 write 0x7e780df thru 0x7e83f14 (0xbe36 bytes) 2024-04-23T23:38:37.232 INFO:teuthology.orchestra.run.smithi077.stdout:3775 writesame 0x218325f thru 0x2189b2d data_size 0x1(0x68cf bytes) 2024-04-23T23:38:37.243 INFO:teuthology.orchestra.run.smithi077.stdout:3776 punch from 0x6dd1799 to 0x6ddbfe2, (0xa849 bytes) 2024-04-23T23:38:37.243 INFO:teuthology.orchestra.run.smithi077.stdout:3777 punch from 0xc8a71b to 0xc8f7a9, (0x508e bytes) 2024-04-23T23:38:37.256 INFO:teuthology.orchestra.run.smithi077.stdout:3778 write 0xe606680 thru 0xe616454 (0xfdd5 bytes) 2024-04-23T23:38:37.261 INFO:teuthology.orchestra.run.smithi077.stdout:3779 read 0xa613a61 thru 0xa61b3d2 (0x7972 bytes) 2024-04-23T23:38:37.261 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.261 INFO:teuthology.orchestra.run.smithi077.stdout:3781 punch from 0x84751bb to 0x8482d81, (0xdbc6 bytes) 2024-04-23T23:38:37.276 INFO:teuthology.orchestra.run.smithi077.stdout:3782 trunc from 0xe616455 to 0x151a201 2024-04-23T23:38:37.297 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:37.309+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:37.308 INFO:teuthology.orchestra.run.smithi077.stdout:3783 writesame 0xc1ce1e1 thru 0xc1daaba data_size 0x2f(0xc8da bytes) 2024-04-23T23:38:37.308 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.308 INFO:teuthology.orchestra.run.smithi077.stdout:3785 read 0x6d966e6 thru 0x6d99c8d (0x35a8 bytes) 2024-04-23T23:38:37.308 INFO:teuthology.orchestra.run.smithi077.stdout:3786 punch from 0x2aaeb7f to 0x2ab6e19, (0x829a bytes) 2024-04-23T23:38:37.308 INFO:teuthology.orchestra.run.smithi077.stdout:3788 write 0x809c5ad thru 0x80a20ce (0x5b22 bytes) 2024-04-23T23:38:37.319 INFO:teuthology.orchestra.run.smithi077.stdout:3789 trunc from 0xc1daabb to 0x5486514 2024-04-23T23:38:37.332 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.335 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:37.335 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:37.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:37.335 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:37.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.335 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 48.952667642000002, 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:37.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 39.954017014000001, 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.341 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:37.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:32786 3.4 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:37.346 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.261565343000001, 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018228132000000001, 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 32786 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084946+0000", 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.084948+0000", 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9920000000000002e-06 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086902+0000", 2024-04-23T23:38:37.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0019542050000000001 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086923+0000", 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1571999999999999e-05 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.086933+0000", 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.73e-06 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087015+0000", 2024-04-23T23:38:37.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2066999999999999e-05 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087175+0000", 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016020699999999999 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087648+0000", 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00047274399999999999 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:37.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.101505+0000", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013856736 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103090+0000", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015848979999999999 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103128+0000", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8120000000000001e-05 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.103174+0000", 2024-04-23T23:38:37.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5861e-05 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.514363600999999, 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.352 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:38:37.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:38:37.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:37.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56691 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 23592960~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.358 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281476+0000", 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0650345530000003, 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017636578, 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56691 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281476+0000", 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281476+0000", 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281477+0000", 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281479+0000", 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281484+0000", 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6230000000000002e-06 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281488+0000", 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2350000000000001e-06 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.298935+0000", 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017446397999999998 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299023+0000", 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8239000000000007e-05 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299113+0000", 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9938000000000005e-05 2024-04-23T23:38:37.362 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56692 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 25559040~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0650172169999994, 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017758131, 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56692 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281494+0000", 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5699999999999998e-07 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281496+0000", 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281502+0000", 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6910000000000002e-06 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281506+0000", 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5850000000000001e-06 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299146+0000", 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017639644999999999 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299199+0000", 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2954999999999997e-05 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299252+0000", 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3053999999999997e-05 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56693 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 26214400~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0649990589999998, 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017954739000000001, 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.367 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56693 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281512+0000", 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.53e-07 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281514+0000", 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.858e-06 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281520+0000", 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5879999999999997e-06 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281525+0000", 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4020000000000001e-06 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299283+0000", 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017757959 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299362+0000", 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8955000000000006e-05 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299467+0000", 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010462400000000001 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56759 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 7995392~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282568+0000", 2024-04-23T23:38:37.371 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0639424369999997, 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017486277000000001, 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56759 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282568+0000", 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282568+0000", 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282569+0000", 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3300000000000002e-07 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282574+0000", 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8609999999999997e-06 2024-04-23T23:38:37.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282581+0000", 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282586+0000", 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0769999999999998e-06 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.299931+0000", 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017345154000000002 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300000+0000", 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9461999999999993e-05 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300055+0000", 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4543000000000003e-05 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56760 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 10616832~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282594+0000", 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0639164999999995, 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017604246, 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56760 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.376 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282594+0000", 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282594+0000", 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282595+0000", 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2099999999999997e-07 2024-04-23T23:38:37.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282597+0000", 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.289e-06 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282604+0000", 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5629999999999997e-06 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282615+0000", 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1517e-05 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300086+0000", 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017470521999999999 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300138+0000", 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1805000000000003e-05 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300199+0000", 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1029000000000001e-05 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56761 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 13238272~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0638899570000007, 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017707678000000001, 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.380 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56761 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282621+0000", 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282623+0000", 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.68e-06 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282627+0000", 2024-04-23T23:38:37.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8659999999999999e-06 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282630+0000", 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.151e-06 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300229+0000", 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017599193999999999 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300277+0000", 2024-04-23T23:38:37.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7757999999999999e-05 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300329+0000", 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1598000000000003e-05 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56762 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 15859712~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0638776639999996, 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017823252000000001, 2024-04-23T23:38:37.384 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56762 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282633+0000", 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2600000000000001e-07 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282635+0000", 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.243e-06 2024-04-23T23:38:37.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1499999999999999e-06 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282641+0000", 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9699999999999999e-06 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300354+0000", 2024-04-23T23:38:37.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017712848 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300404+0000", 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0698000000000001e-05 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300457+0000", 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2117000000000003e-05 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56763 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 18481152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0638671770000006, 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017950035, 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56763 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282644+0000", 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282645+0000", 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.189e-06 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282648+0000", 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1389999999999999e-06 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282651+0000", 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5720000000000001e-06 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300483+0000", 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017831544000000001 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300539+0000", 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6368e-05 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300594+0000", 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4901000000000002e-05 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.392 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56764 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 21102592~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0638571490000004, 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018064566000000001, 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56764 2024-04-23T23:38:37.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282654+0000", 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1e-07 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282655+0000", 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1400000000000001e-06 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282658+0000", 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.101e-06 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282661+0000", 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.571e-06 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300620+0000", 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017959284999999998 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300668+0000", 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7994999999999997e-05 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300718+0000", 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0263999999999999e-05 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56765 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 23724032~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0638473780000002, 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018197768999999999, 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.397 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56765 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282664+0000", 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1e-07 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282665+0000", 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0020000000000001e-06 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282668+0000", 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0819999999999999e-06 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282671+0000", 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2289999999999999e-06 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300753+0000", 2024-04-23T23:38:37.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018081611000000001 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300808+0000", 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5084999999999999e-05 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300861+0000", 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3550000000000001e-05 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56766 3.8 3:1674a16f:::rbd_data.1194dbf22edf.0000000000000003:18 [sparse-read 26345472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.0638360579999997, 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018325915000000002, 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56766 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282675+0000", 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282676+0000", 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0759999999999999e-06 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282680+0000", 2024-04-23T23:38:37.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.782e-06 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282683+0000", 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7070000000000001e-06 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300877+0000", 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018194254999999999 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.300931+0000", 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4060000000000001e-05 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.301001+0000", 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9813000000000004e-05 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:64189 3.19 3:99aaf915:::rbd_data.119412e0677c.0000000000000001:1c [read 1130496~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-23T23:38:37.406 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:34.166142+0000", 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.1803688920000002, 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017888224000000001, 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 64189 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166142+0000", 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166142+0000", 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166143+0000", 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2099999999999997e-07 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166145+0000", 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.627e-06 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166151+0000", 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1369999999999999e-06 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166156+0000", 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.183574+0000", 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017417202999999999 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.183655+0000", 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1594000000000005e-05 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184030+0000", 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000375082 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.410 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:64191 3.19 3:99aaf915:::rbd_data.119412e0677c.0000000000000001:1c [read 1540096~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:34.166164+0000", 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.1803471170000002, 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523265000000001, 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 64191 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166164+0000", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166164+0000", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166164+0000", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166166+0000", 2024-04-23T23:38:37.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0159999999999998e-06 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166172+0000", 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4430000000000002e-06 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166176+0000", 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4530000000000004e-06 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184075+0000", 2024-04-23T23:38:37.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017898879999999999 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184293+0000", 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000218087 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184687+0000", 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00039400299999999997 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:64211 3.8 3:14c69d1e:::rbd_data.119412e0677c.0000000000000006:1c [read 1523712~49152] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e71)", 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:34.166335+0000", 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.1801758449999999, 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017914685, 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 64211 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166335+0000", 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166335+0000", 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166335+0000", 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1e-07 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166336+0000", 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.195e-06 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166340+0000", 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1920000000000001e-06 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.166342+0000", 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5519999999999999e-06 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.183765+0000", 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017423153 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.183847+0000", 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1749000000000006e-05 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184250+0000", 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00040263400000000002 2024-04-23T23:38:37.418 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:64216 3.8 3:123d0d5e:::rbd_data.1194de69c758.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 1048576 write_size 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:34.174498+0000", 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.172012777, 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.019201863999999999, 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.419 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 64216 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.174498+0000", 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.174498+0000", 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.174499+0000", 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2920000000000001e-06 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.175067+0000", 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00056720700000000002 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.175077+0000", 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0005e-05 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.175083+0000", 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8279999999999997e-06 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184288+0000", 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0092049999999999996 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184360+0000", 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1509999999999998e-05 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.184732+0000", 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00037221200000000002 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.188299+0000", 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035667250000000002 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.193602+0000", 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0053027719999999999 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.193645+0000", 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3393999999999998e-05 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.193700+0000", 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4919000000000001e-05 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:64278 3.8 3:14c69d1e:::rbd_data.119412e0677c.0000000000000006:1c [read 2916352~32768] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e71)", 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:34.189793+0000", 2024-04-23T23:38:37.424 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 3.156718347, 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018728709, 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 64278 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.189793+0000", 2024-04-23T23:38:37.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.189793+0000", 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.189793+0000", 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.189800+0000", 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.189869+0000", 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9511000000000006e-05 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.189876+0000", 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3389999999999998e-06 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.207193+0000", 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017317526 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.207950+0000", 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00075646299999999997 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:34.208521+0000", 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00057172799999999997 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.429 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.429 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:37.430 INFO:teuthology.orchestra.run.smithi077.stdout:3791 write 0xce8a982 thru 0xce8f977 (0x4ff6 bytes) 2024-04-23T23:38:37.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3792 read 0x39ddb20 thru 0x39ecbf1 (0xf0d2 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3793 read 0x60e0922 thru 0x60ef999 (0xf078 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3795 trunc from 0xce8f978 to 0x31c08d0 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3796 write 0xabe5243 thru 0xabf1742 (0xc500 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3798 punch from 0x9c8603e to 0x9c8b8d0, (0x5892 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3799 punch from 0x479b9a4 to 0x47a7dca, (0xc426 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3802 read 0x7f040d4 thru 0x7f08244 (0x4171 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3803 read 0x548a249 thru 0x5492a83 (0x883b bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3804 write 0x4e34dcd thru 0x4e3f7e3 (0xaa17 bytes) 2024-04-23T23:38:37.433 INFO:teuthology.orchestra.run.smithi077.stdout:3805 write 0x6b63cb0 thru 0x6b6e8c8 (0xac19 bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3806 writesame 0xd01135 thru 0xd0bef8 data_size 0x2(0xadc4 bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3808 read 0x69053ec thru 0x6908b64 (0x3779 bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3810 trunc from 0xabf1743 to 0xc1719b2 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3811 read 0x9252b71 thru 0x925a42a (0x78ba bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3812 read 0x592b98e thru 0x5939081 (0xd6f4 bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3813 punch from 0x3dabb09 to 0x3db8f48, (0xd43f bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:3815 writesame 0xb764e12 thru 0xb76ca90 data_size 0x1d(0x7c7f bytes) 2024-04-23T23:38:37.434 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.434 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:37.442+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:37.435 INFO:teuthology.orchestra.run.smithi077.stdout:3818 trunc from 0xc1719b2 to 0x3609cb5 2024-04-23T23:38:37.450 INFO:teuthology.orchestra.run.smithi077.stdout:3820 writesame 0x484e455 thru 0x485d55c data_size 0x24(0xf108 bytes) 2024-04-23T23:38:37.459 INFO:teuthology.orchestra.run.smithi077.stdout:3821 trunc from 0x485d55d to 0xc100455 2024-04-23T23:38:37.465 INFO:teuthology.orchestra.run.smithi077.stdout:3823 write 0x1ce441a thru 0x1ce8160 (0x3d47 bytes) 2024-04-23T23:38:37.468 INFO:teuthology.orchestra.run.smithi077.stdout:3825 read 0xb2c909a thru 0xb2d1920 (0x8887 bytes) 2024-04-23T23:38:37.471 INFO:teuthology.orchestra.run.smithi077.stdout:3826 trunc from 0xc100455 to 0xa105f93 2024-04-23T23:38:37.477 INFO:teuthology.orchestra.run.smithi077.stdout:3832 read 0x42b508d thru 0x42c3d4d (0xecc1 bytes) 2024-04-23T23:38:37.477 INFO:teuthology.orchestra.run.smithi077.stdout:3833 write 0x204d878 thru 0x204ff48 (0x26d1 bytes) 2024-04-23T23:38:37.479 INFO:teuthology.orchestra.run.smithi077.stdout:3834 write 0x4edb43d thru 0x4ee6735 (0xb2f9 bytes) 2024-04-23T23:38:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:3835 read 0x9782016 thru 0x9786c25 (0x4c10 bytes) 2024-04-23T23:38:37.495 INFO:teuthology.orchestra.run.smithi077.stdout:3836 trunc from 0xa105f93 to 0x4e8219 2024-04-23T23:38:37.530 INFO:teuthology.orchestra.run.smithi077.stdout:3837 writesame 0xbe1303e thru 0xbe133b1 data_size 0x11(0x374 bytes) 2024-04-23T23:38:37.530 INFO:teuthology.orchestra.run.smithi077.stdout:3839 read 0x78e7837 thru 0x78eed86 (0x7550 bytes) 2024-04-23T23:38:37.530 INFO:teuthology.orchestra.run.smithi077.stdout:3840 punch from 0x7745ada to 0x774d07c, (0x75a2 bytes) 2024-04-23T23:38:37.530 INFO:teuthology.orchestra.run.smithi077.stdout:3841 read 0xbcc55b5 thru 0xbcd2e32 (0xd87e bytes) 2024-04-23T23:38:37.530 INFO:teuthology.orchestra.run.smithi077.stdout:3842 write 0x964566 thru 0x971c5d (0xd6f8 bytes) 2024-04-23T23:38:37.531 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:37.544+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:37.532 INFO:teuthology.orchestra.run.smithi077.stdout:3845 punch from 0x1ee7c9a to 0x1ef7bba, (0xff20 bytes) 2024-04-23T23:38:37.532 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.532 INFO:teuthology.orchestra.run.smithi077.stdout:3847 read 0x2842298 thru 0x2850a2a (0xe793 bytes) 2024-04-23T23:38:37.532 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.532 INFO:teuthology.orchestra.run.smithi077.stdout:3849 write 0xb5e3fba thru 0xb5eb6dc (0x7723 bytes) 2024-04-23T23:38:37.535 INFO:teuthology.orchestra.run.smithi077.stdout:3850 write 0xaf538ff thru 0xaf562ed (0x29ef bytes) 2024-04-23T23:38:37.536 INFO:teuthology.orchestra.run.smithi077.stdout:3851 read 0xa390bb2 thru 0xa396367 (0x57b6 bytes) 2024-04-23T23:38:37.539 INFO:teuthology.orchestra.run.smithi077.stdout:3852 trunc from 0xbe133b2 to 0xe284259 2024-04-23T23:38:37.544 INFO:teuthology.orchestra.run.smithi077.stdout:3853 write 0x9554ec3 thru 0x9564ce5 (0xfe23 bytes) 2024-04-23T23:38:37.549 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.549 INFO:teuthology.orchestra.run.smithi077.stdout:3855 write 0xc9937ce thru 0xc9a335b (0xfb8e bytes) 2024-04-23T23:38:37.552 INFO:teuthology.orchestra.run.smithi077.stdout:3856 write 0xa5b22f6 thru 0xa5bbbfd (0x9908 bytes) 2024-04-23T23:38:37.554 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:37.554 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:37.555 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:37.555 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:37.555 INFO:teuthology.orchestra.run.smithi077.stdout:3857 read 0x6a67d7d thru 0x6a6d992 (0x5c16 bytes) 2024-04-23T23:38:37.555 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.555 INFO:teuthology.orchestra.run.smithi077.stdout:3861 read 0xd02e242 thru 0xd033345 (0x5104 bytes) 2024-04-23T23:38:37.556 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.556 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.556 INFO:teuthology.orchestra.run.smithi077.stdout:3866 read 0x273c8e2 thru 0x273dca6 (0x13c5 bytes) 2024-04-23T23:38:37.556 INFO:teuthology.orchestra.run.smithi077.stdout:3867 write 0x50416fd thru 0x504679c (0x50a0 bytes) 2024-04-23T23:38:37.558 INFO:teuthology.orchestra.run.smithi077.stdout:3868 write 0x96a76da thru 0x96b54c4 (0xddeb bytes) 2024-04-23T23:38:37.560 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.560 INFO:teuthology.orchestra.run.smithi077.stdout:3870 writesame 0x6c597f4 thru 0x6c5c332 data_size 0x1(0x2b3f bytes) 2024-04-23T23:38:37.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:37.568 INFO:teuthology.orchestra.run.smithi077.stdout:3872 write 0x22f60b6 thru 0x22f8347 (0x2292 bytes) 2024-04-23T23:38:37.571 INFO:teuthology.orchestra.run.smithi077.stdout:3873 read 0xa7a608 thru 0xa84f00 (0xa8f9 bytes) 2024-04-23T23:38:37.571 INFO:teuthology.orchestra.run.smithi077.stdout:3874 write 0x8498668 thru 0x849e3cf (0x5d68 bytes) 2024-04-23T23:38:37.575 INFO:teuthology.orchestra.run.smithi077.stdout:3875 punch from 0x4b24f16 to 0x4b2a5e1, (0x56cb bytes) 2024-04-23T23:38:37.575 INFO:teuthology.orchestra.run.smithi077.stdout:3877 punch from 0x18e277c to 0x18f1740, (0xefc4 bytes) 2024-04-23T23:38:37.576 INFO:teuthology.orchestra.run.smithi077.stdout:3878 punch from 0x49a43d0 to 0x49abe9d, (0x7acd bytes) 2024-04-23T23:38:37.576 INFO:teuthology.orchestra.run.smithi077.stdout:3880 read 0x7fc02b2 thru 0x7fcd420 (0xd16f bytes) 2024-04-23T23:38:37.576 INFO:teuthology.orchestra.run.smithi077.stdout:3881 writesame 0x3da0286 thru 0x3da273c data_size 0x3(0x24b7 bytes) 2024-04-23T23:38:37.579 INFO:teuthology.orchestra.run.smithi077.stdout:3882 write 0x7a7d719 thru 0x7a7e891 (0x1179 bytes) 2024-04-23T23:38:37.593 INFO:teuthology.orchestra.run.smithi077.stdout:3884 trunc from 0xe284259 to 0x4ca3fce 2024-04-23T23:38:37.608 INFO:teuthology.orchestra.run.smithi077.stdout:3885 trunc from 0x4ca3fce to 0x634d97e 2024-04-23T23:38:37.624 INFO:teuthology.orchestra.run.smithi077.stdout:3887 writesame 0xb692aaf thru 0xb6a06d1 data_size 0xd(0xdc23 bytes) 2024-04-23T23:38:37.624 INFO:teuthology.orchestra.run.smithi077.stdout:3889 write 0xb4479da thru 0xb447b4a (0x171 bytes) 2024-04-23T23:38:37.627 INFO:teuthology.orchestra.run.smithi077.stdout:3891 write 0x8351474 thru 0x8356369 (0x4ef6 bytes) 2024-04-23T23:38:37.630 INFO:teuthology.orchestra.run.smithi077.stdout:3892 punch from 0x5cd9167 to 0x5ce51bc, (0xc055 bytes) 2024-04-23T23:38:37.632 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:37.644+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:37.638 INFO:teuthology.orchestra.run.smithi077.stdout:3893 trunc from 0xb6a06d2 to 0x4ea6f16 2024-04-23T23:38:37.649 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.663 INFO:teuthology.orchestra.run.smithi077.stdout:3897 write 0xc23e18f thru 0xc24919f (0xb011 bytes) 2024-04-23T23:38:37.668 INFO:teuthology.orchestra.run.smithi077.stdout:3898 writesame 0x9513b48 thru 0x9515282 data_size 0x1(0x173b bytes) 2024-04-23T23:38:37.672 INFO:teuthology.orchestra.run.smithi077.stdout:3899 writesame 0x8ac1ea8 thru 0x8aca4af data_size 0x4(0x8608 bytes) 2024-04-23T23:38:37.677 INFO:teuthology.orchestra.run.smithi077.stdout:3901 read 0x3eaf118 thru 0x3ebbd71 (0xcc5a bytes) 2024-04-23T23:38:37.685 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:37.685 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:37.687 INFO:teuthology.orchestra.run.smithi077.stdout:3903 trunc from 0xc2491a0 to 0x4096cfa 2024-04-23T23:38:37.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:37.699 INFO:teuthology.orchestra.run.smithi077.stdout:3905 write 0x1d3a3cb thru 0x1d4303f (0x8c75 bytes) 2024-04-23T23:38:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.702 INFO:teuthology.orchestra.run.smithi077.stdout:3907 write 0xdde9a4 thru 0xddfa43 (0x10a0 bytes) 2024-04-23T23:38:37.717 INFO:teuthology.orchestra.run.smithi077.stdout:3910 writesame 0xba65ae1 thru 0xba693fb data_size 0xb(0x391b bytes) 2024-04-23T23:38:37.729 INFO:teuthology.orchestra.run.smithi077.stdout:3911 trunc from 0xba693fc to 0x1a3dbfd 2024-04-23T23:38:37.733 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:37.746+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:37.743 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.752 INFO:teuthology.orchestra.run.smithi077.stdout:3913 write 0x5682953 thru 0x56854a8 (0x2b56 bytes) 2024-04-23T23:38:37.755 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.756 INFO:teuthology.orchestra.run.smithi077.stdout:3916 read 0x997691 thru 0x99f8f9 (0x8269 bytes) 2024-04-23T23:38:37.766 INFO:teuthology.orchestra.run.smithi077.stdout:3917 writesame 0x95dc191 thru 0x95e6392 data_size 0x2(0xa202 bytes) 2024-04-23T23:38:37.776 INFO:teuthology.orchestra.run.smithi077.stdout:3918 writesame 0xd0c1767 thru 0xd0cf5b0 data_size 0x25(0xde4a bytes) 2024-04-23T23:38:37.776 INFO:teuthology.orchestra.run.smithi077.stdout:3919 read 0xbf28691 thru 0xbf2ee87 (0x67f7 bytes) 2024-04-23T23:38:37.777 INFO:teuthology.orchestra.run.smithi077.stdout:3920 read 0x8a9f297 thru 0x8aa09bb (0x1725 bytes) 2024-04-23T23:38:37.777 INFO:teuthology.orchestra.run.smithi077.stdout:3921 read 0xc329f76 thru 0xc338699 (0xe724 bytes) 2024-04-23T23:38:37.784 INFO:teuthology.orchestra.run.smithi077.stdout:3922 write 0xea4eec5 thru 0xea53cf8 (0x4e34 bytes) 2024-04-23T23:38:37.787 INFO:teuthology.orchestra.run.smithi077.stdout:3923 write 0x66c04db thru 0x66c2c23 (0x2749 bytes) 2024-04-23T23:38:37.790 INFO:teuthology.orchestra.run.smithi077.stdout:3924 writesame 0x422f269 thru 0x4232c21 data_size 0x1(0x39b9 bytes) 2024-04-23T23:38:37.799 INFO:teuthology.orchestra.run.smithi077.stdout:3926 read 0x2722a4c thru 0x272d5da (0xab8f bytes) 2024-04-23T23:38:37.799 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.799 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.799 INFO:teuthology.orchestra.run.smithi077.stdout:3929 punch from 0x8f8a30c to 0x8f8c375, (0x2069 bytes) 2024-04-23T23:38:37.799 INFO:teuthology.orchestra.run.smithi077.stdout:3930 punch from 0x9924cc2 to 0x9929178, (0x44b6 bytes) 2024-04-23T23:38:37.800 INFO:teuthology.orchestra.run.smithi077.stdout:3931 trunc from 0xea53cf9 to 0xd8fc56d 2024-04-23T23:38:37.819 INFO:teuthology.orchestra.run.smithi077.stdout:3932 trunc from 0xd8fc56d to 0x5295922 2024-04-23T23:38:37.820 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 49.422955868000003, 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 40.423260014, 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.825 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:37.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:37.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:37.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.744002917, 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:38:37.829 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:38:37.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.833 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56709 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12713984~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269105+0000", 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5628863299999995, 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012223446000000001, 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56709 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269105+0000", 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269105+0000", 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269106+0000", 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:38:37.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269111+0000", 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.203e-06 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269117+0000", 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2210000000000002e-06 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269122+0000", 2024-04-23T23:38:37.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6439999999999999e-06 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281143+0000", 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012021263000000001 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281227+0000", 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4543999999999996e-05 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281329+0000", 2024-04-23T23:38:37.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101173 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56710 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15335424~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5628628970000005, 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012433191, 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56710 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269129+0000", 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269131+0000", 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269137+0000", 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.981e-06 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269142+0000", 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281371+0000", 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012229019000000001 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281460+0000", 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8807000000000005e-05 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281562+0000", 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010218 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56711 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 17956864~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5628429130000008, 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012636282, 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.842 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56711 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269149+0000", 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269151+0000", 2024-04-23T23:38:37.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9870000000000002e-06 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269157+0000", 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1990000000000003e-06 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269161+0000", 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1969999999999998e-06 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281604+0000", 2024-04-23T23:38:37.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01244255 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281683+0000", 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8776000000000006e-05 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281785+0000", 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000102168 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5628259720000006, 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.851 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5628156430000004, 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.852 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:38:37.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5628047249999995, 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:38:37.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:38:37.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5627765389999997, 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:38:37.860 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.864 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5627608340000005, 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:37.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:38:37.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5627498509999995, 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.869 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:37.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:38:37.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:38:37.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5627354800000006, 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.873 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.874 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:38:37.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:38:37.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5626981410000003, 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.877 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5626758219999992, 2024-04-23T23:38:37.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:37.885 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5626486079999999, 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:38:37.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5626285549999999, 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.890 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5626091780000007, 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.897 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 8.5625897539999993, 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:38:37.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:37.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.901 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.6512406049999999, 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:37.902 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:37.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:37.906 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:37.908 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:37.909 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.909 INFO:teuthology.orchestra.run.smithi077.stdout:3934 write 0xe68cc42 thru 0xe691fd3 (0x5392 bytes) 2024-04-23T23:38:37.909 INFO:teuthology.orchestra.run.smithi077.stdout:3935 write 0x12f384d thru 0x12fb242 (0x79f6 bytes) 2024-04-23T23:38:37.909 INFO:teuthology.orchestra.run.smithi077.stdout:3936 read 0x585ceae thru 0x586b047 (0xe19a bytes) 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:3939 write 0x725d32e thru 0x7262626 (0x52f9 bytes) 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:3940 trunc from 0xe691fd4 to 0xadf4b95 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:3942 write 0x57b1fb thru 0x57df5f (0x2d65 bytes) 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:3943 trunc from 0xadf4b95 to 0x4c490d3 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:3944 writesame 0xa8f74a4 thru 0xa906ee7 data_size 0x72(0xfa44 bytes) 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.910 INFO:teuthology.orchestra.run.smithi077.stdout:3948 punch from 0xa6d8a41 to 0xa6e6a10, (0xdfcf bytes) 2024-04-23T23:38:37.910 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:37.919+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:37.911 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.911 INFO:teuthology.orchestra.run.smithi077.stdout:3950 trunc from 0xa906ee8 to 0x95f7a62 2024-04-23T23:38:37.920 INFO:teuthology.orchestra.run.smithi077.stdout:3951 trunc from 0x95f7a62 to 0xe72e691 2024-04-23T23:38:37.925 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.925 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.925 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.925 INFO:teuthology.orchestra.run.smithi077.stdout:3957 read 0x80ada10 thru 0x80b1f75 (0x4566 bytes) 2024-04-23T23:38:37.925 INFO:teuthology.orchestra.run.smithi077.stdout:3958 punch from 0xdd4d3e2 to 0xdd5119b, (0x3db9 bytes) 2024-04-23T23:38:37.925 INFO:teuthology.orchestra.run.smithi077.stdout:3959 write 0x4f2d026 thru 0x4f3699d (0x9978 bytes) 2024-04-23T23:38:37.943 INFO:teuthology.orchestra.run.smithi077.stdout:3960 trunc from 0xe72e691 to 0x5140339 2024-04-23T23:38:37.949 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.950 INFO:teuthology.orchestra.run.smithi077.stdout:3963 read 0x3ca91b0 thru 0x3ca9576 (0x3c7 bytes) 2024-04-23T23:38:37.950 INFO:teuthology.orchestra.run.smithi077.stdout:3964 read 0x104a1fe thru 0x105244c (0x824f bytes) 2024-04-23T23:38:37.965 INFO:teuthology.orchestra.run.smithi077.stdout:3965 write 0xd56b33d thru 0xd5777ff (0xc4c3 bytes) 2024-04-23T23:38:37.969 INFO:teuthology.orchestra.run.smithi077.stdout:3966 read 0x69da6f5 thru 0x69e9e35 (0xf741 bytes) 2024-04-23T23:38:37.969 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.973 INFO:teuthology.orchestra.run.smithi077.stdout:3968 trunc from 0xd577800 to 0x993e32d 2024-04-23T23:38:37.985 INFO:teuthology.orchestra.run.smithi077.stdout:3970 writesame 0xa397cd thru 0xa40b25 data_size 0x33(0x7359 bytes) 2024-04-23T23:38:37.990 INFO:teuthology.orchestra.run.smithi077.stdout:3971 write 0x3e3eaac thru 0x3e45d6f (0x72c4 bytes) 2024-04-23T23:38:37.992 INFO:teuthology.orchestra.run.smithi077.stdout:3972 writesame 0x4ef675c thru 0x4f006fd data_size 0x8b(0x9fa2 bytes) 2024-04-23T23:38:37.997 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.997 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:37.997 INFO:teuthology.orchestra.run.smithi077.stdout:3976 read 0x70da202 thru 0x70ddae0 (0x38df bytes) 2024-04-23T23:38:37.997 INFO:teuthology.orchestra.run.smithi077.stdout:3978 writesame 0x4864e4 thru 0x48f328 data_size 0x4d(0x8e45 bytes) 2024-04-23T23:38:37.998 INFO:teuthology.orchestra.run.smithi077.stdout:3979 write 0x18a31e3 thru 0x18b021f (0xd03d bytes) 2024-04-23T23:38:38.001 INFO:teuthology.orchestra.run.smithi077.stdout:3980 read 0x24029a0 thru 0x24104c3 (0xdb24 bytes) 2024-04-23T23:38:38.005 INFO:teuthology.orchestra.run.smithi077.stdout:3982 trunc from 0x993e32d to 0xc9d8c3c 2024-04-23T23:38:38.008 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:38.020+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:38.010 INFO:teuthology.orchestra.run.smithi077.stdout:3983 read 0x54d4c78 thru 0x54dc5f1 (0x797a bytes) 2024-04-23T23:38:38.010 INFO:teuthology.orchestra.run.smithi077.stdout:3985 writesame 0x1e421e7 thru 0x1e48cd1 data_size 0x1(0x6aeb bytes) 2024-04-23T23:38:38.024 INFO:teuthology.orchestra.run.smithi077.stdout:3986 write 0x4653a77 thru 0x4654ccf (0x1259 bytes) 2024-04-23T23:38:38.025 INFO:teuthology.orchestra.run.smithi077.stdout:3987 read 0x13b4f16 thru 0x13b8d02 (0x3ded bytes) 2024-04-23T23:38:38.026 INFO:teuthology.orchestra.run.smithi077.stdout:3988 write 0x61413f3 thru 0x61441ad (0x2dbb bytes) 2024-04-23T23:38:38.029 INFO:teuthology.orchestra.run.smithi077.stdout:3989 writesame 0x73bc3cc thru 0x73c4e3e data_size 0x17(0x8a73 bytes) 2024-04-23T23:38:38.029 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:38.029 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:38.030 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:38.030 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:38.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:38.041 INFO:teuthology.orchestra.run.smithi077.stdout:3990 write 0xe6fc4d3 thru 0xe700372 (0x3ea0 bytes) 2024-04-23T23:38:38.044 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.044 INFO:teuthology.orchestra.run.smithi077.stdout:3993 write 0xbb9ca70 thru 0xbba48a7 (0x7e38 bytes) 2024-04-23T23:38:38.047 INFO:teuthology.orchestra.run.smithi077.stdout:3996 trunc from 0xe700373 to 0xe75da21 2024-04-23T23:38:38.052 INFO:teuthology.orchestra.run.smithi077.stdout:3997 punch from 0x23d2a9 to 0x2463df, (0x9136 bytes) 2024-04-23T23:38:38.052 INFO:teuthology.orchestra.run.smithi077.stdout:3999 read 0xa82f1db thru 0xa832ef7 (0x3d1d bytes) 2024-04-23T23:38:38.052 INFO:teuthology.orchestra.run.smithi077.stdout:4000 read 0x576ba7a thru 0x5772ce6 (0x726d bytes) 2024-04-23T23:38:38.052 INFO:teuthology.orchestra.run.smithi077.stdout:4001 read 0x79b2922 thru 0x79b6b57 (0x4236 bytes) 2024-04-23T23:38:38.052 INFO:teuthology.orchestra.run.smithi077.stdout:4002 writesame 0x2b355c7 thru 0x2b445df data_size 0x13(0xf019 bytes) 2024-04-23T23:38:38.059 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.059 INFO:teuthology.orchestra.run.smithi077.stdout:4004 write 0x3beddbb thru 0x3bf76c5 (0x990b bytes) 2024-04-23T23:38:38.061 INFO:teuthology.orchestra.run.smithi077.stdout:4005 punch from 0xc542306 to 0xc54474e, (0x2448 bytes) 2024-04-23T23:38:38.062 INFO:teuthology.orchestra.run.smithi077.stdout:4006 read 0x730cfd2 thru 0x7312931 (0x5960 bytes) 2024-04-23T23:38:38.062 INFO:teuthology.orchestra.run.smithi077.stdout:4008 write 0x60ab0a2 thru 0x60b5a7b (0xa9da bytes) 2024-04-23T23:38:38.065 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.065 INFO:teuthology.orchestra.run.smithi077.stdout:4016 read 0x311eb24 thru 0x312a5b9 (0xba96 bytes) 2024-04-23T23:38:38.065 INFO:teuthology.orchestra.run.smithi077.stdout:4017 clone 29 order 24 su 131072 sc 13 2024-04-23T23:38:38.102 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.6 to 1 (10000) 2024-04-23T23:38:38.108 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:38.120+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:38.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-23T23:38:38.156 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:38.156 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:38.156 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:38.156 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:38.156 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:38.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:38.210 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:38.222+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:38.310 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:38.323+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:38.327 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:38.327 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:38.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:38.327 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:38.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.327 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37869 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130164017999999, 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045333998, 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37869 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207482+0000", 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8299999999999995e-07 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207485+0000", 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9620000000000002e-06 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207488+0000", 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6800000000000002e-06 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252696+0000", 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045208527999999998 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252756+0000", 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9828999999999999e-05 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252815+0000", 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8900999999999997e-05 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37870 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1155072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130152466999998, 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045543751, 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37870 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207493+0000", 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8799999999999998e-07 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207501+0000", 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0269999999999995e-06 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207507+0000", 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207512+0000", 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6909999999999996e-06 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252853+0000", 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045341765999999999 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252932+0000", 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8846999999999999e-05 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253036+0000", 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103788 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37871 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130124761000001, 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045672261999999998, 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37871 2024-04-23T23:38:38.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207521+0000", 2024-04-23T23:38:38.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.44e-07 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207523+0000", 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207529+0000", 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2999999999999998e-06 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207533+0000", 2024-04-23T23:38:38.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5029999999999999e-06 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253082+0000", 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045548271000000001 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253139+0000", 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7237000000000001e-05 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253192+0000", 2024-04-23T23:38:38.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3470000000000001e-05 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37872 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1196032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130105409999999, 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806959000000001, 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37872 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207540+0000", 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207542+0000", 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7749999999999999e-06 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207546+0000", 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8239999999999999e-06 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207553+0000", 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253231+0000", 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045677698000000003 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253276+0000", 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5238000000000003e-05 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253346+0000", 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0234000000000006e-05 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37873 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130087621000001, 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046012472999999998, 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.344 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37873 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207558+0000", 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207559+0000", 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4610000000000001e-06 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207565+0000", 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0700000000000003e-06 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207569+0000", 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.189e-06 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253392+0000", 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045822300000000003 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253471+0000", 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9354e-05 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253570+0000", 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8748999999999999e-05 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37874 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1236992~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:38.348 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130068867999999, 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046114845000000002, 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37874 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.46e-07 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207578+0000", 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207584+0000", 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2249999999999997e-06 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207589+0000", 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253602+0000", 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046013314 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253641+0000", 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8980000000000003e-05 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253691+0000", 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9503999999999999e-05 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37875 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:38.352 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130049775, 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046215125000000003, 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37875 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207597+0000", 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.632e-06 2024-04-23T23:38:38.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207603+0000", 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207614+0000", 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1326e-05 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253723+0000", 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046108359000000002 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253761+0000", 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8124999999999998e-05 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253810+0000", 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9431000000000002e-05 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37876 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1277952~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:38.356 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.130024293000002, 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046358498999999997, 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37876 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207826+0000", 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00020521100000000001 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207829+0000", 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4259999999999999e-06 2024-04-23T23:38:38.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207839+0000", 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0229e-05 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207847+0000", 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253839+0000", 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991727000000003 2024-04-23T23:38:38.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253887+0000", 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8353999999999998e-05 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253979+0000", 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.187e-05 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.360 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37877 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.129787384, 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046312513999999999, 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37877 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208979+0000", 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011215649999999999 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208984+0000", 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208994+0000", 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0223e-05 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209001+0000", 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0570000000000004e-06 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254010+0000", 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045008632999999999 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254075+0000", 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5227000000000004e-05 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254170+0000", 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5038999999999996e-05 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.364 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37878 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1318912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.12863187, 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045355536000000002, 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37878 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.365 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209016+0000", 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209023+0000", 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8000000000000001e-06 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209028+0000", 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.575e-06 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254215+0000", 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045186357000000003 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254284+0000", 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9089000000000002e-05 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254368+0000", 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4845000000000005e-05 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37879 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.128609217000001, 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045494123999999997, 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.369 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37879 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209038+0000", 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8449999999999999e-06 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209045+0000", 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8009999999999998e-06 2024-04-23T23:38:38.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209050+0000", 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254409+0000", 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045358974000000003 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254462+0000", 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2913e-05 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254530+0000", 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7968999999999999e-05 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37880 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.128588271000002, 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045602333000000002, 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.373 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37880 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209059+0000", 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.792e-06 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209068+0000", 2024-04-23T23:38:38.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5559999999999996e-06 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209074+0000", 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5060000000000003e-06 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254562+0000", 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045488622999999999 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254606+0000", 2024-04-23T23:38:38.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3798999999999999e-05 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254659+0000", 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2626000000000001e-05 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37881 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.128564215000001, 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045722411999999997, 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37881 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:38.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209091+0000", 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4700000000000008e-06 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209099+0000", 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:38:38.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209104+0000", 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.541e-06 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254679+0000", 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045574605999999997 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254732+0000", 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3081000000000002e-05 2024-04-23T23:38:38.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254803+0000", 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0926999999999994e-05 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37882 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1400832~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.128516007999998, 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045814737000000001, 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.381 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37882 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209136+0000", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1380000000000004e-06 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209145+0000", 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0119999999999994e-06 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209150+0000", 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5759999999999996e-06 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254835+0000", 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045685022999999998 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254884+0000", 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8758999999999999e-05 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254944+0000", 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9620000000000002e-05 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37883 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.128485853000001, 2024-04-23T23:38:38.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991057000000002, 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37883 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:38.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2399999999999998e-07 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209168+0000", 2024-04-23T23:38:38.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5469999999999997e-06 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209175+0000", 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1910000000000003e-06 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209180+0000", 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9699999999999998e-06 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254987+0000", 2024-04-23T23:38:38.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806988 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255056+0000", 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8942000000000005e-05 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255150+0000", 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3894999999999995e-05 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37884 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1441792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.389 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.128453599, 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.04609659, 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37884 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:38.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210975+0000", 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017842330000000001 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210980+0000", 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1010000000000002e-06 2024-04-23T23:38:38.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210991+0000", 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1173e-05 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211005+0000", 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4579999999999999e-05 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255182+0000", 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.044176766999999999 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255231+0000", 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8928999999999999e-05 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255288+0000", 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6807e-05 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37944 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 53248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.126438409999999, 2024-04-23T23:38:38.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045325582000000003, 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37944 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211207+0000", 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211209+0000", 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:38.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211216+0000", 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211227+0000", 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1769e-05 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256438+0000", 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045210798000000003 2024-04-23T23:38:38.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256480+0000", 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1458000000000002e-05 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256532+0000", 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2441999999999997e-05 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37945 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.126410706000001, 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045467075000000003, 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37945 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:38.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212977+0000", 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017429780000000001 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212984+0000", 2024-04-23T23:38:38.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0999999999999998e-06 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212993+0000", 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212999+0000", 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.784e-06 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256567+0000", 2024-04-23T23:38:38.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043567620000000001 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256618+0000", 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1518999999999999e-05 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256701+0000", 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2922000000000003e-05 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37956 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 299008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.124407855000001, 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045237267999999997, 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37956 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214975+0000", 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001738131 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214980+0000", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4580000000000003e-06 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214988+0000", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4470000000000006e-06 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214993+0000", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258367+0000", 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043374366999999997 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258414+0000", 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6390000000000001e-05 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258474+0000", 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0609000000000002e-05 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37967 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 524288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.122502576999999, 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045227928000000001, 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37967 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.406 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216974+0000", 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018321850000000001 2024-04-23T23:38:38.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216978+0000", 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.208e-06 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216985+0000", 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2529999999999998e-06 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216990+0000", 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260276+0000", 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043285591999999998 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260319+0000", 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2654000000000002e-05 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260370+0000", 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1486999999999997e-05 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.409 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:38.410 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:38.410 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:38.411 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-04-23T23:38:38.412 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:38.412 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.412 INFO:teuthology.orchestra.run.smithi077.stdout:4019 write 0x1537529 thru 0x15432b3 (0xbd8b bytes) 2024-04-23T23:38:38.412 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.413 INFO:teuthology.orchestra.run.smithi077.stdout:4021 trunc from 0xe75da21 to 0x8b1ed73 2024-04-23T23:38:38.413 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:38.423+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:38.517 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:38.528+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:38.530 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:38.530 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:38.545 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:38.592 INFO:teuthology.orchestra.run.smithi077.stdout:4023 punch from 0x49a20a7 to 0x49a728b, (0x51e4 bytes) 2024-04-23T23:38:38.593 INFO:teuthology.orchestra.run.smithi077.stdout:4024 punch from 0x3f8ae1f to 0x3f99c71, (0xee52 bytes) 2024-04-23T23:38:38.598 INFO:teuthology.orchestra.run.smithi077.stdout:4025 trunc from 0x8b1ed73 to 0x38e6a35 2024-04-23T23:38:38.613 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:38.626+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:38.624 INFO:teuthology.orchestra.run.smithi077.stdout:4027 writesame 0xb11be5b thru 0xb12bade data_size 0x6(0xfc84 bytes) 2024-04-23T23:38:38.626 INFO:teuthology.orchestra.run.smithi077.stdout:4028 writesame 0x4769645 thru 0x476ce61 data_size 0x41(0x381d bytes) 2024-04-23T23:38:38.628 INFO:teuthology.orchestra.run.smithi077.stdout:4029 trunc from 0xb12badf to 0x9ceea88 2024-04-23T23:38:38.644 INFO:teuthology.orchestra.run.smithi077.stdout:4030 writesame 0xba2a769 thru 0xba30862 data_size 0x1(0x60fa bytes) 2024-04-23T23:38:38.645 INFO:teuthology.orchestra.run.smithi077.stdout:4031 write 0x46287f7 thru 0x4629f00 (0x170a bytes) 2024-04-23T23:38:38.647 INFO:teuthology.orchestra.run.smithi077.stdout:4032 read 0x50bc428 thru 0x50c56d9 (0x92b2 bytes) 2024-04-23T23:38:38.647 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.650 INFO:teuthology.orchestra.run.smithi077.stdout:4034 trunc from 0xba30863 to 0x907aec1 2024-04-23T23:38:38.658 INFO:teuthology.orchestra.run.smithi077.stdout:4036 punch from 0x7635736 to 0x763fe51, (0xa71b bytes) 2024-04-23T23:38:38.668 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:38.668 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:38.668 INFO:teuthology.orchestra.run.smithi077.stdout:4038 writesame 0xc1e7dcd thru 0xc1ec277 data_size 0x1(0x44ab bytes) 2024-04-23T23:38:38.669 INFO:teuthology.orchestra.run.smithi077.stdout:4039 read 0xafedde1 thru 0xaff8299 (0xa4b9 bytes) 2024-04-23T23:38:38.669 INFO:teuthology.orchestra.run.smithi077.stdout:4040 writesame 0x851c2bd thru 0x851e1b0 data_size 0x7(0x1ef4 bytes) 2024-04-23T23:38:38.677 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:38.678 INFO:teuthology.orchestra.run.smithi077.stdout:4041 write 0xc84781b thru 0xc84f36e (0x7b54 bytes) 2024-04-23T23:38:38.678 INFO:teuthology.orchestra.run.smithi077.stdout:4042 write 0x7fbc1cb thru 0x7fc8a44 (0xc87a bytes) 2024-04-23T23:38:38.680 INFO:teuthology.orchestra.run.smithi077.stdout:4043 write 0x2cf9281 thru 0x2cff711 (0x6491 bytes) 2024-04-23T23:38:38.681 INFO:teuthology.orchestra.run.smithi077.stdout:4044 read 0x548f04 thru 0x54f9aa (0x6aa7 bytes) 2024-04-23T23:38:38.688 INFO:teuthology.orchestra.run.smithi077.stdout:4045 trunc from 0xc84f36f to 0x76f2087 2024-04-23T23:38:38.701 INFO:teuthology.orchestra.run.smithi077.stdout:4047 write 0x7d6192a thru 0x7d68d6c (0x7443 bytes) 2024-04-23T23:38:38.702 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.702 INFO:teuthology.orchestra.run.smithi077.stdout:4049 punch from 0x5576b14 to 0x557d934, (0x6e20 bytes) 2024-04-23T23:38:38.703 INFO:teuthology.orchestra.run.smithi077.stdout:4051 punch from 0x4a7493d to 0x4a83b87, (0xf24a bytes) 2024-04-23T23:38:38.715 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:38.727+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:38.716 INFO:teuthology.orchestra.run.smithi077.stdout:4052 write 0xd79a69a thru 0xd79e26f (0x3bd6 bytes) 2024-04-23T23:38:38.718 INFO:teuthology.orchestra.run.smithi077.stdout:4053 punch from 0xcfd279d to 0xcfde78a, (0xbfed bytes) 2024-04-23T23:38:38.732 INFO:teuthology.orchestra.run.smithi077.stdout:4054 trunc from 0xd79e270 to 0x16df36b 2024-04-23T23:38:38.761 INFO:teuthology.orchestra.run.smithi077.stdout:4056 write 0x4036a4c thru 0x4045075 (0xe62a bytes) 2024-04-23T23:38:38.762 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:38.762 INFO:teuthology.orchestra.run.smithi077.stdout:4058 write 0x32c218a thru 0x32c606e (0x3ee5 bytes) 2024-04-23T23:38:38.763 INFO:teuthology.orchestra.run.smithi077.stdout:4060 write 0x2e711c6 thru 0x2e780a3 (0x6ede bytes) 2024-04-23T23:38:38.765 INFO:teuthology.orchestra.run.smithi077.stdout:4061 read 0x16b1f0a thru 0x16bc11e (0xa215 bytes) 2024-04-23T23:38:38.765 INFO:teuthology.orchestra.run.smithi077.stdout:4062 write 0x79ea7d thru 0x7a4d05 (0x6289 bytes) 2024-04-23T23:38:38.767 INFO:teuthology.orchestra.run.smithi077.stdout:4063 read 0x7cca1 thru 0x857db (0x8b3b bytes) 2024-04-23T23:38:38.784 INFO:teuthology.orchestra.run.smithi077.stdout:4065 writesame 0xaed1b84 thru 0xaed69b8 data_size 0x1(0x4e35 bytes) 2024-04-23T23:38:38.785 INFO:teuthology.orchestra.run.smithi077.stdout:4066 read 0x301e6ce thru 0x30273af (0x8ce2 bytes) 2024-04-23T23:38:38.785 INFO:teuthology.orchestra.run.smithi077.stdout:4067 write 0x1557f84 thru 0x15616d2 (0x974f bytes) 2024-04-23T23:38:38.787 INFO:teuthology.orchestra.run.smithi077.stdout:4068 punch from 0x119fa9d to 0x11a3b9d, (0x4100 bytes) 2024-04-23T23:38:38.787 INFO:teuthology.orchestra.run.smithi077.stdout:4069 read 0x20eab43 thru 0x20f6469 (0xb927 bytes) 2024-04-23T23:38:38.793 INFO:teuthology.orchestra.run.smithi077.stdout:4070 write 0xb8d61be thru 0xb8e1da3 (0xbbe6 bytes) 2024-04-23T23:38:38.795 INFO:teuthology.orchestra.run.smithi077.stdout:4071 read 0x2f02720 thru 0x2f0aac9 (0x83aa bytes) 2024-04-23T23:38:38.797 INFO:teuthology.orchestra.run.smithi077.stdout:4073 trunc from 0xb8e1da4 to 0xc96fe06 2024-04-23T23:38:38.802 INFO:teuthology.orchestra.run.smithi077.stdout:4074 writesame 0x7d3f798 thru 0x7d477ea data_size 0x5b(0x8053 bytes) 2024-04-23T23:38:38.804 INFO:teuthology.orchestra.run.smithi077.stdout:4075 punch from 0x724cfae to 0x7250da3, (0x3df5 bytes) 2024-04-23T23:38:38.804 INFO:teuthology.orchestra.run.smithi077.stdout:4078 read 0x6187b21 thru 0x618c354 (0x4834 bytes) 2024-04-23T23:38:38.804 INFO:teuthology.orchestra.run.smithi077.stdout:4079 read 0x1e9d2d0 thru 0x1ea3295 (0x5fc6 bytes) 2024-04-23T23:38:38.805 INFO:teuthology.orchestra.run.smithi077.stdout:4080 writesame 0x340fd39 thru 0x3416236 data_size 0x3e(0x64fe bytes) 2024-04-23T23:38:38.806 INFO:teuthology.orchestra.run.smithi077.stdout:4081 clone 30 order 24 su 1048576 sc 3 2024-04-23T23:38:38.816 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:38.828+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.850318780000002, 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:38.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33566 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12025856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.834 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593260748999999, 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047296019000000002, 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33566 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:38.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245971+0000", 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245973+0000", 2024-04-23T23:38:38.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245979+0000", 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245984+0000", 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293076+0000", 2024-04-23T23:38:38.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047091597999999998 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293164+0000", 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7928000000000002e-05 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293266+0000", 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102247 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593240025, 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:38:38.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:38:38.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:38:38.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593197693, 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593175092999999, 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.847 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:38:38.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:38:38.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593150005999998, 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.851 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:38.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:38:38.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:38.855 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593128668999999, 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:38.859 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.593107622000002, 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:38:38.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:38:38.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:38.863 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.592903166999999, 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:38:38.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:38:38.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.592569768000001, 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:38:38.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.592543872, 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:38:38.873 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.877 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.592146939999999, 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:38:38.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:38:38.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.592110613999999, 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:38:38.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.591722256000001, 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.886 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:38:38.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:38:38.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.591696854999999, 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.890 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:38:38.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.589536461000002, 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.894 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:38.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.589515856999999, 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.898 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.901 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.589495508999999, 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:38:38.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.905 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.589475829000001, 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:38:38.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:38:38.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:38:38.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.909 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.587472373000001, 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:38.910 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:38.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:38.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:38:38.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:38:38.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:38.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:38.914 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:38.915 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:38.916 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:38.929+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:38.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:39.017 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:39.030+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:39.060 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:39.060 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:39.060 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:39.060 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:39.069 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:39.085 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:39.086 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:39.102 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:39.102 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:39.110 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.7 to 1 (10000) 2024-04-23T23:38:39.118 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:39.130+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:39.122 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:39.123 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:39.126 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-23T23:38:39.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:38:39.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:38:39.141 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:39.141 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:39.162 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:39.174 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone29 from 0xc96fe06 (overlap 0x16df36b) to 0xdb920d 2024-04-23T23:38:39.184 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:39.185 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:39.218 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:39.219 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:39.219 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:39.231+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:39.224 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:39.224 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:39.234 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:39.243 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-04-23T23:38:39.251 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:39.251 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:39.320 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:39.332+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:39.378 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:39.379 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:39.387 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:39.421 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:39.433+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:39.463 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:38:39.464 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:38:39.476 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-04-23T23:38:39.124076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1126573290,"num_objects":1635,"num_object_clones":176,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1635,"num_whiteouts":915,"num_read":93694,"num_read_kb":581721,"num_write":12261,"num_write_kb":348113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1707,"num_bytes_recovered":75837578,"num_keys_recovered":247,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10437,"ondisk_log_size":10437,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":537396,"kb_used_data":297060,"kb_used_omap":12,"kb_used_meta":235251,"kb_avail":565693644,"statfs":{"total":579820584960,"available":579270291456,"internally_reserved":0,"allocated":304189440,"data_stored":362729886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12467,"internal_metadata":240897869},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":157099425,"num_objects":347,"num_object_clones":57,"num_object_copies":694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347,"num_whiteouts":248,"num_read":16469,"num_read_kb":187680,"num_write":1399,"num_write_kb":115524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028018"},"pg_stats":[{"pgid":"3.1f","version":"71'348","reported_seq":2824,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103521+0000","last_change":"2024-04-23T23:37:54.900909+0000","last_active":"2024-04-23T23:38:35.103521+0000","last_peered":"2024-04-23T23:38:35.103521+0000","last_clean":"2024-04-23T23:38:35.103521+0000","last_became_active":"2024-04-23T23:37:54.879740+0000","last_became_peered":"2024-04-23T23:37:54.879740+0000","last_unstale":"2024-04-23T23:38:35.103521+0000","last_undegraded":"2024-04-23T23:38:35.103521+0000","last_fullsized":"2024-04-23T23:38:35.103521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:10:05.919349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036166670000000001,"stat_sum":{"num_bytes":34193945,"num_objects":52,"num_object_clones":2,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":27,"num_read":3402,"num_read_kb":13404,"num_write":410,"num_write_kb":3978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":538661,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'246","reported_seq":2039,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.098053+0000","last_change":"2024-04-23T23:38:29.052716+0000","last_active":"2024-04-23T23:38:35.098053+0000","last_peered":"2024-04-23T23:38:35.098053+0000","last_clean":"2024-04-23T23:38:35.098053+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:38:35.098053+0000","last_undegraded":"2024-04-23T23:38:35.098053+0000","last_fullsized":"2024-04-23T23:38:35.098053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:33.086756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061879000000000003,"stat_sum":{"num_bytes":43151025,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":37,"num_read":1605,"num_read_kb":11339,"num_write":202,"num_write_kb":2563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'336","reported_seq":2640,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.817062+0000","last_change":"2024-04-23T23:38:26.043657+0000","last_active":"2024-04-23T23:38:37.817062+0000","last_peered":"2024-04-23T23:38:37.817062+0000","last_clean":"2024-04-23T23:38:37.817062+0000","last_became_active":"2024-04-23T23:38:26.042706+0000","last_became_peered":"2024-04-23T23:38:26.042706+0000","last_unstale":"2024-04-23T23:38:37.817062+0000","last_undegraded":"2024-04-23T23:38:37.817062+0000","last_fullsized":"2024-04-23T23:38:37.817062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:34.143878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013335580000000001,"stat_sum":{"num_bytes":24907825,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":30,"num_read":3658,"num_read_kb":18395,"num_write":339,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":540782,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"74'365","reported_seq":3120,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.588962+0000","last_change":"2024-04-23T23:38:26.047051+0000","last_active":"2024-04-23T23:38:37.588962+0000","last_peered":"2024-04-23T23:38:37.588962+0000","last_clean":"2024-04-23T23:38:37.588962+0000","last_became_active":"2024-04-23T23:38:26.046143+0000","last_became_peered":"2024-04-23T23:38:26.046143+0000","last_unstale":"2024-04-23T23:38:37.588962+0000","last_undegraded":"2024-04-23T23:38:37.588962+0000","last_fullsized":"2024-04-23T23:38:37.588962+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:59:13.547501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29756914,"num_objects":50,"num_object_clones":6,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":30,"num_read":5116,"num_read_kb":33768,"num_write":330,"num_write_kb":6967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":5093524,"num_keys_recovered":87,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'381","reported_seq":2073,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.220278+0000","last_change":"2024-04-23T23:38:26.044609+0000","last_active":"2024-04-23T23:38:35.220278+0000","last_peered":"2024-04-23T23:38:35.220278+0000","last_clean":"2024-04-23T23:38:35.220278+0000","last_became_active":"2024-04-23T23:38:26.043896+0000","last_became_peered":"2024-04-23T23:38:26.043896+0000","last_unstale":"2024-04-23T23:38:35.220278+0000","last_undegraded":"2024-04-23T23:38:35.220278+0000","last_fullsized":"2024-04-23T23:38:35.220278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:07.841377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048779100000000001,"stat_sum":{"num_bytes":24642399,"num_objects":50,"num_object_clones":5,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":30,"num_read":2832,"num_read_kb":15604,"num_write":541,"num_write_kb":23495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":4959576,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"73'381","reported_seq":2311,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.246640+0000","last_change":"2024-04-23T23:38:26.039065+0000","last_active":"2024-04-23T23:38:36.246640+0000","last_peered":"2024-04-23T23:38:36.246640+0000","last_clean":"2024-04-23T23:38:36.246640+0000","last_became_active":"2024-04-23T23:38:26.038182+0000","last_became_peered":"2024-04-23T23:38:26.038182+0000","last_unstale":"2024-04-23T23:38:36.246640+0000","last_undegraded":"2024-04-23T23:38:36.246640+0000","last_fullsized":"2024-04-23T23:38:36.246640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:13.638816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109447,"stat_sum":{"num_bytes":29105409,"num_objects":41,"num_object_clones":3,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":22,"num_read":3084,"num_read_kb":6126,"num_write":501,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":560910,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"73'292","reported_seq":1543,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.160810+0000","last_change":"2024-04-23T23:38:26.041615+0000","last_active":"2024-04-23T23:38:36.160810+0000","last_peered":"2024-04-23T23:38:36.160810+0000","last_clean":"2024-04-23T23:38:36.160810+0000","last_became_active":"2024-04-23T23:38:26.041023+0000","last_became_peered":"2024-04-23T23:38:26.041023+0000","last_unstale":"2024-04-23T23:38:36.160810+0000","last_undegraded":"2024-04-23T23:38:36.160810+0000","last_fullsized":"2024-04-23T23:38:36.160810+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:17:57.310925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044664900000000003,"stat_sum":{"num_bytes":114812162,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":36,"num_read":995,"num_read_kb":12391,"num_write":238,"num_write_kb":8419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":364940,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'244","reported_seq":1690,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103234+0000","last_change":"2024-04-23T23:38:19.812400+0000","last_active":"2024-04-23T23:38:35.103234+0000","last_peered":"2024-04-23T23:38:35.103234+0000","last_clean":"2024-04-23T23:38:35.103234+0000","last_became_active":"2024-04-23T23:38:19.811716+0000","last_became_peered":"2024-04-23T23:38:19.811716+0000","last_unstale":"2024-04-23T23:38:35.103234+0000","last_undegraded":"2024-04-23T23:38:35.103234+0000","last_fullsized":"2024-04-23T23:38:35.103234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:42.127482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091463299999999998,"stat_sum":{"num_bytes":29831907,"num_objects":44,"num_object_clones":6,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":26,"num_read":1558,"num_read_kb":22627,"num_write":290,"num_write_kb":12637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":4353222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"72'274","reported_seq":2797,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.117232+0000","last_change":"2024-04-23T23:37:55.069343+0000","last_active":"2024-04-23T23:38:35.117232+0000","last_peered":"2024-04-23T23:38:35.117232+0000","last_clean":"2024-04-23T23:38:35.117232+0000","last_became_active":"2024-04-23T23:37:54.879800+0000","last_became_peered":"2024-04-23T23:37:54.879800+0000","last_unstale":"2024-04-23T23:38:35.117232+0000","last_undegraded":"2024-04-23T23:38:35.117232+0000","last_fullsized":"2024-04-23T23:38:35.117232+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:07:14.432067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035554319999999999,"stat_sum":{"num_bytes":58877924,"num_objects":52,"num_object_clones":5,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":32,"num_read":3202,"num_read_kb":35020,"num_write":377,"num_write_kb":33490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":25197274,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'343","reported_seq":1410,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.294715+0000","last_change":"2024-04-23T23:37:54.921901+0000","last_active":"2024-04-23T23:38:37.294715+0000","last_peered":"2024-04-23T23:38:37.294715+0000","last_clean":"2024-04-23T23:38:37.294715+0000","last_became_active":"2024-04-23T23:37:54.878095+0000","last_became_peered":"2024-04-23T23:37:54.878095+0000","last_unstale":"2024-04-23T23:38:37.294715+0000","last_undegraded":"2024-04-23T23:38:37.294715+0000","last_fullsized":"2024-04-23T23:38:37.294715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:03.387703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012770870000000001,"stat_sum":{"num_bytes":32000827,"num_objects":45,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":26,"num_read":1769,"num_read_kb":13143,"num_write":426,"num_write_kb":14412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":115939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"71'235","reported_seq":1118,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101801+0000","last_change":"2024-04-23T23:38:26.046815+0000","last_active":"2024-04-23T23:38:35.101801+0000","last_peered":"2024-04-23T23:38:35.101801+0000","last_clean":"2024-04-23T23:38:35.101801+0000","last_became_active":"2024-04-23T23:38:26.045988+0000","last_became_peered":"2024-04-23T23:38:26.045988+0000","last_unstale":"2024-04-23T23:38:35.101801+0000","last_undegraded":"2024-04-23T23:38:35.101801+0000","last_fullsized":"2024-04-23T23:38:35.101801+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:46.276656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066396700000000001,"stat_sum":{"num_bytes":44030600,"num_objects":62,"num_object_clones":7,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":40,"num_read":534,"num_read_kb":6031,"num_write":194,"num_write_kb":6669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":1725786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"71'510","reported_seq":3063,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101742+0000","last_change":"2024-04-23T23:38:26.044435+0000","last_active":"2024-04-23T23:38:35.101742+0000","last_peered":"2024-04-23T23:38:35.101742+0000","last_clean":"2024-04-23T23:38:35.101742+0000","last_became_active":"2024-04-23T23:38:26.043571+0000","last_became_peered":"2024-04-23T23:38:26.043571+0000","last_unstale":"2024-04-23T23:38:35.101742+0000","last_undegraded":"2024-04-23T23:38:35.101742+0000","last_fullsized":"2024-04-23T23:38:35.101742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:40:39.851312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000411357,"stat_sum":{"num_bytes":16994765,"num_objects":52,"num_object_clones":4,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":26,"num_read":4828,"num_read_kb":10636,"num_write":688,"num_write_kb":4689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":1582215,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.097850+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:38:35.097850+0000","last_peered":"2024-04-23T23:38:35.097850+0000","last_clean":"2024-04-23T23:38:35.097850+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:38:35.097850+0000","last_undegraded":"2024-04-23T23:38:35.097850+0000","last_fullsized":"2024-04-23T23:38:35.097850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:15.878718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"71'196","reported_seq":2182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103320+0000","last_change":"2024-04-23T23:37:33.814364+0000","last_active":"2024-04-23T23:38:35.103320+0000","last_peered":"2024-04-23T23:38:35.103320+0000","last_clean":"2024-04-23T23:38:35.103320+0000","last_became_active":"2024-04-23T23:37:31.808177+0000","last_became_peered":"2024-04-23T23:37:31.808177+0000","last_unstale":"2024-04-23T23:38:35.103320+0000","last_undegraded":"2024-04-23T23:38:35.103320+0000","last_fullsized":"2024-04-23T23:38:35.103320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:17.983601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043457199999999999,"stat_sum":{"num_bytes":19435337,"num_objects":42,"num_object_clones":3,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":26,"num_read":2452,"num_read_kb":10390,"num_write":181,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.114068+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:38:36.114068+0000","last_peered":"2024-04-23T23:38:36.114068+0000","last_clean":"2024-04-23T23:38:36.114068+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:38:36.114068+0000","last_undegraded":"2024-04-23T23:38:36.114068+0000","last_fullsized":"2024-04-23T23:38:36.114068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"71'589","reported_seq":1875,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103474+0000","last_change":"2024-04-23T23:38:19.813142+0000","last_active":"2024-04-23T23:38:35.103474+0000","last_peered":"2024-04-23T23:38:35.103474+0000","last_clean":"2024-04-23T23:38:35.103474+0000","last_became_active":"2024-04-23T23:38:19.812199+0000","last_became_peered":"2024-04-23T23:38:19.812199+0000","last_unstale":"2024-04-23T23:38:35.103474+0000","last_undegraded":"2024-04-23T23:38:35.103474+0000","last_fullsized":"2024-04-23T23:38:35.103474+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:02.913036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000861358,"stat_sum":{"num_bytes":23403118,"num_objects":55,"num_object_clones":7,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":29,"num_read":3436,"num_read_kb":25782,"num_write":918,"num_write_kb":10501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":2762806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101927+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:38:35.101927+0000","last_peered":"2024-04-23T23:38:35.101927+0000","last_clean":"2024-04-23T23:38:35.101927+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:38:35.101927+0000","last_undegraded":"2024-04-23T23:38:35.101927+0000","last_fullsized":"2024-04-23T23:38:35.101927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:59:15.656083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"73'234","reported_seq":1103,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.229860+0000","last_change":"2024-04-23T23:37:33.804737+0000","last_active":"2024-04-23T23:38:36.229860+0000","last_peered":"2024-04-23T23:38:36.229860+0000","last_clean":"2024-04-23T23:38:36.229860+0000","last_became_active":"2024-04-23T23:37:31.799126+0000","last_became_peered":"2024-04-23T23:37:31.799126+0000","last_unstale":"2024-04-23T23:38:36.229860+0000","last_undegraded":"2024-04-23T23:38:36.229860+0000","last_fullsized":"2024-04-23T23:38:36.229860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:26.402356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000552153,"stat_sum":{"num_bytes":19654339,"num_objects":40,"num_object_clones":4,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":20,"num_read":1299,"num_read_kb":12327,"num_write":242,"num_write_kb":8769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.114018+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:38:36.114018+0000","last_peered":"2024-04-23T23:38:36.114018+0000","last_clean":"2024-04-23T23:38:36.114018+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:38:36.114018+0000","last_undegraded":"2024-04-23T23:38:36.114018+0000","last_fullsized":"2024-04-23T23:38:36.114018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'190","reported_seq":1169,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.803864+0000","last_change":"2024-04-23T23:38:19.815075+0000","last_active":"2024-04-23T23:38:37.803864+0000","last_peered":"2024-04-23T23:38:37.803864+0000","last_clean":"2024-04-23T23:38:37.803864+0000","last_became_active":"2024-04-23T23:38:19.813635+0000","last_became_peered":"2024-04-23T23:38:19.813635+0000","last_unstale":"2024-04-23T23:38:37.803864+0000","last_undegraded":"2024-04-23T23:38:37.803864+0000","last_fullsized":"2024-04-23T23:38:37.803864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:33:28.410564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014827079999999999,"stat_sum":{"num_bytes":24877446,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":37,"num_read":1750,"num_read_kb":25383,"num_write":199,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"71'269","reported_seq":2597,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103278+0000","last_change":"2024-04-23T23:38:26.044166+0000","last_active":"2024-04-23T23:38:35.103278+0000","last_peered":"2024-04-23T23:38:35.103278+0000","last_clean":"2024-04-23T23:38:35.103278+0000","last_became_active":"2024-04-23T23:38:26.043316+0000","last_became_peered":"2024-04-23T23:38:26.043316+0000","last_unstale":"2024-04-23T23:38:35.103278+0000","last_undegraded":"2024-04-23T23:38:35.103278+0000","last_fullsized":"2024-04-23T23:38:35.103278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:17.966592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400399999999997,"stat_sum":{"num_bytes":12074921,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":25,"num_read":2718,"num_read_kb":12833,"num_write":327,"num_write_kb":6045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":353948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.121858+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:38:37.121858+0000","last_peered":"2024-04-23T23:38:37.121858+0000","last_clean":"2024-04-23T23:38:37.121858+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:38:37.121858+0000","last_undegraded":"2024-04-23T23:38:37.121858+0000","last_fullsized":"2024-04-23T23:38:37.121858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"73'252","reported_seq":1129,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.113890+0000","last_change":"2024-04-23T23:37:33.804968+0000","last_active":"2024-04-23T23:38:36.113890+0000","last_peered":"2024-04-23T23:38:36.113890+0000","last_clean":"2024-04-23T23:38:36.113890+0000","last_became_active":"2024-04-23T23:37:31.799146+0000","last_became_peered":"2024-04-23T23:37:31.799146+0000","last_unstale":"2024-04-23T23:38:36.113890+0000","last_undegraded":"2024-04-23T23:38:36.113890+0000","last_fullsized":"2024-04-23T23:38:36.113890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:40:15.441842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055612800000000003,"stat_sum":{"num_bytes":47207744,"num_objects":56,"num_object_clones":5,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":29,"num_read":1255,"num_read_kb":25725,"num_write":399,"num_write_kb":59611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.098017+0000","last_change":"2024-04-23T23:38:16.993705+0000","last_active":"2024-04-23T23:38:35.098017+0000","last_peered":"2024-04-23T23:38:35.098017+0000","last_clean":"2024-04-23T23:38:35.098017+0000","last_became_active":"2024-04-23T23:38:16.993379+0000","last_became_peered":"2024-04-23T23:38:16.993379+0000","last_unstale":"2024-04-23T23:38:35.098017+0000","last_undegraded":"2024-04-23T23:38:35.098017+0000","last_fullsized":"2024-04-23T23:38:35.098017+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:01.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"71'476","reported_seq":2815,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103311+0000","last_change":"2024-04-23T23:38:26.042967+0000","last_active":"2024-04-23T23:38:35.103311+0000","last_peered":"2024-04-23T23:38:35.103311+0000","last_clean":"2024-04-23T23:38:35.103311+0000","last_became_active":"2024-04-23T23:38:26.042171+0000","last_became_peered":"2024-04-23T23:38:26.042171+0000","last_unstale":"2024-04-23T23:38:35.103311+0000","last_undegraded":"2024-04-23T23:38:35.103311+0000","last_fullsized":"2024-04-23T23:38:35.103311+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:57.412594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047655700000000001,"stat_sum":{"num_bytes":7834388,"num_objects":36,"num_object_clones":1,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":24,"num_read":4030,"num_read_kb":10239,"num_write":749,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":25578,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.113947+0000","last_change":"2024-04-23T23:38:05.927674+0000","last_active":"2024-04-23T23:38:36.113947+0000","last_peered":"2024-04-23T23:38:36.113947+0000","last_clean":"2024-04-23T23:38:36.113947+0000","last_became_active":"2024-04-23T23:38:05.927354+0000","last_became_peered":"2024-04-23T23:38:05.927354+0000","last_unstale":"2024-04-23T23:38:36.113947+0000","last_undegraded":"2024-04-23T23:38:36.113947+0000","last_fullsized":"2024-04-23T23:38:36.113947+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:23.526110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"74'461","reported_seq":1412,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.862833+0000","last_change":"2024-04-23T23:38:19.814491+0000","last_active":"2024-04-23T23:38:37.862833+0000","last_peered":"2024-04-23T23:38:37.862833+0000","last_clean":"2024-04-23T23:38:37.862833+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:38:37.862833+0000","last_undegraded":"2024-04-23T23:38:37.862833+0000","last_fullsized":"2024-04-23T23:38:37.862833+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:17:55.422130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000789393,"stat_sum":{"num_bytes":22847223,"num_objects":36,"num_object_clones":3,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":19,"num_read":2594,"num_read_kb":4572,"num_write":598,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":108,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.098016+0000","last_change":"2024-04-23T23:37:32.837969+0000","last_active":"2024-04-23T23:38:35.098016+0000","last_peered":"2024-04-23T23:38:35.098016+0000","last_clean":"2024-04-23T23:38:35.098016+0000","last_became_active":"2024-04-23T23:37:32.837752+0000","last_became_peered":"2024-04-23T23:37:32.837752+0000","last_unstale":"2024-04-23T23:38:35.098016+0000","last_undegraded":"2024-04-23T23:38:35.098016+0000","last_fullsized":"2024-04-23T23:38:35.098016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:24.064742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":272,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101859+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:38:35.101859+0000","last_peered":"2024-04-23T23:38:35.101859+0000","last_clean":"2024-04-23T23:38:35.101859+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:38:35.101859+0000","last_undegraded":"2024-04-23T23:38:35.101859+0000","last_fullsized":"2024-04-23T23:38:35.101859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"73'188","reported_seq":1323,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.219191+0000","last_change":"2024-04-23T23:38:19.809366+0000","last_active":"2024-04-23T23:38:36.219191+0000","last_peered":"2024-04-23T23:38:36.219191+0000","last_clean":"2024-04-23T23:38:36.219191+0000","last_became_active":"2024-04-23T23:38:19.808534+0000","last_became_peered":"2024-04-23T23:38:19.808534+0000","last_unstale":"2024-04-23T23:38:36.219191+0000","last_undegraded":"2024-04-23T23:38:36.219191+0000","last_fullsized":"2024-04-23T23:38:36.219191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:04.015896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701399999999997,"stat_sum":{"num_bytes":39813649,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":34,"num_read":965,"num_read_kb":17975,"num_write":168,"num_write_kb":12857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":5130309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'286","reported_seq":4226,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.179517+0000","last_change":"2024-04-23T23:38:26.042905+0000","last_active":"2024-04-23T23:38:35.179517+0000","last_peered":"2024-04-23T23:38:35.179517+0000","last_clean":"2024-04-23T23:38:35.179517+0000","last_became_active":"2024-04-23T23:38:26.042234+0000","last_became_peered":"2024-04-23T23:38:26.042234+0000","last_unstale":"2024-04-23T23:38:35.179517+0000","last_undegraded":"2024-04-23T23:38:35.179517+0000","last_fullsized":"2024-04-23T23:38:35.179517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:49:47.078576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078111900000000004,"stat_sum":{"num_bytes":43668924,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":38,"num_read":3976,"num_read_kb":21170,"num_write":257,"num_write_kb":5995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":688827,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"73'236","reported_seq":1453,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.169277+0000","last_change":"2024-04-23T23:38:29.052345+0000","last_active":"2024-04-23T23:38:36.169277+0000","last_peered":"2024-04-23T23:38:36.169277+0000","last_clean":"2024-04-23T23:38:36.169277+0000","last_became_active":"2024-04-23T23:38:29.051657+0000","last_became_peered":"2024-04-23T23:38:29.051657+0000","last_unstale":"2024-04-23T23:38:36.169277+0000","last_undegraded":"2024-04-23T23:38:36.169277+0000","last_fullsized":"2024-04-23T23:38:36.169277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:21.015699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036496,"stat_sum":{"num_bytes":12342281,"num_objects":44,"num_object_clones":2,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":23,"num_read":1559,"num_read_kb":11029,"num_write":221,"num_write_kb":2351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":240553,"num_keys_recovered":36,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'255","reported_seq":3509,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.220676+0000","last_change":"2024-04-23T23:38:26.043918+0000","last_active":"2024-04-23T23:38:35.220676+0000","last_peered":"2024-04-23T23:38:35.220676+0000","last_clean":"2024-04-23T23:38:35.220676+0000","last_became_active":"2024-04-23T23:38:26.043252+0000","last_became_peered":"2024-04-23T23:38:26.043252+0000","last_unstale":"2024-04-23T23:38:35.220676+0000","last_undegraded":"2024-04-23T23:38:35.220676+0000","last_fullsized":"2024-04-23T23:38:35.220676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:17.704543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070273799999999995,"stat_sum":{"num_bytes":40902334,"num_objects":54,"num_object_clones":9,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":25,"num_read":3539,"num_read_kb":23992,"num_write":219,"num_write_kb":5831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":363289,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"74'259","reported_seq":3299,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.751611+0000","last_change":"2024-04-23T23:38:19.814484+0000","last_active":"2024-04-23T23:38:37.751611+0000","last_peered":"2024-04-23T23:38:37.751611+0000","last_clean":"2024-04-23T23:38:37.751611+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:38:37.751611+0000","last_undegraded":"2024-04-23T23:38:37.751611+0000","last_fullsized":"2024-04-23T23:38:37.751611+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:28.381041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001080988,"stat_sum":{"num_bytes":78162259,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":3248,"num_read_kb":27645,"num_write":240,"num_write_kb":12699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"74'293","reported_seq":3020,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.816988+0000","last_change":"2024-04-23T23:38:05.930084+0000","last_active":"2024-04-23T23:38:37.816988+0000","last_peered":"2024-04-23T23:38:37.816988+0000","last_clean":"2024-04-23T23:38:37.816988+0000","last_became_active":"2024-04-23T23:38:05.929374+0000","last_became_peered":"2024-04-23T23:38:05.929374+0000","last_unstale":"2024-04-23T23:38:37.816988+0000","last_undegraded":"2024-04-23T23:38:37.816988+0000","last_fullsized":"2024-04-23T23:38:37.816988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:48.268961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090758899999999999,"stat_sum":{"num_bytes":16641113,"num_objects":53,"num_object_clones":6,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":30,"num_read":4154,"num_read_kb":27580,"num_write":268,"num_write_kb":5811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":22374,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"71'539","reported_seq":4032,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101974+0000","last_change":"2024-04-23T23:38:26.048120+0000","last_active":"2024-04-23T23:38:35.101974+0000","last_peered":"2024-04-23T23:38:35.101974+0000","last_clean":"2024-04-23T23:38:35.101974+0000","last_became_active":"2024-04-23T23:38:26.045945+0000","last_became_peered":"2024-04-23T23:38:26.045945+0000","last_unstale":"2024-04-23T23:38:35.101974+0000","last_undegraded":"2024-04-23T23:38:35.101974+0000","last_fullsized":"2024-04-23T23:38:35.101974+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:43:25.252567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727580000000001,"stat_sum":{"num_bytes":68078631,"num_objects":52,"num_object_clones":7,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":25,"num_read":5978,"num_read_kb":25171,"num_write":664,"num_write_kb":4925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":963058,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"72'444","reported_seq":2307,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.179939+0000","last_change":"2024-04-23T23:38:26.046827+0000","last_active":"2024-04-23T23:38:35.179939+0000","last_peered":"2024-04-23T23:38:35.179939+0000","last_clean":"2024-04-23T23:38:35.179939+0000","last_became_active":"2024-04-23T23:38:26.045988+0000","last_became_peered":"2024-04-23T23:38:26.045988+0000","last_unstale":"2024-04-23T23:38:35.179939+0000","last_undegraded":"2024-04-23T23:38:35.179939+0000","last_fullsized":"2024-04-23T23:38:35.179939+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:24.297807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001215793,"stat_sum":{"num_bytes":32140657,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":26,"num_read":3521,"num_read_kb":16619,"num_write":542,"num_write_kb":9498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":488922,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"71'227","reported_seq":1880,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.097540+0000","last_change":"2024-04-23T23:37:34.009681+0000","last_active":"2024-04-23T23:38:35.097540+0000","last_peered":"2024-04-23T23:38:35.097540+0000","last_clean":"2024-04-23T23:38:35.097540+0000","last_became_active":"2024-04-23T23:37:31.807784+0000","last_became_peered":"2024-04-23T23:37:31.807784+0000","last_unstale":"2024-04-23T23:38:35.097540+0000","last_undegraded":"2024-04-23T23:38:35.097540+0000","last_fullsized":"2024-04-23T23:38:35.097540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:05.126770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044726999999999999,"stat_sum":{"num_bytes":34335818,"num_objects":48,"num_object_clones":3,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":30,"num_read":1776,"num_read_kb":6535,"num_write":239,"num_write_kb":6795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"71'259","reported_seq":4487,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101961+0000","last_change":"2024-04-23T23:38:29.052602+0000","last_active":"2024-04-23T23:38:35.101961+0000","last_peered":"2024-04-23T23:38:35.101961+0000","last_clean":"2024-04-23T23:38:35.101961+0000","last_became_active":"2024-04-23T23:38:29.051325+0000","last_became_peered":"2024-04-23T23:38:29.051325+0000","last_unstale":"2024-04-23T23:38:35.101961+0000","last_undegraded":"2024-04-23T23:38:35.101961+0000","last_fullsized":"2024-04-23T23:38:35.101961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:51.021680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318700000000001,"stat_sum":{"num_bytes":59199837,"num_objects":55,"num_object_clones":9,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":26,"num_read":4817,"num_read_kb":52087,"num_write":222,"num_write_kb":10795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4166338,"num_keys_recovered":9,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"72'459","reported_seq":3565,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.236249+0000","last_change":"2024-04-23T23:37:33.814367+0000","last_active":"2024-04-23T23:38:35.236249+0000","last_peered":"2024-04-23T23:38:35.236249+0000","last_clean":"2024-04-23T23:38:35.236249+0000","last_became_active":"2024-04-23T23:37:31.808751+0000","last_became_peered":"2024-04-23T23:37:31.808751+0000","last_unstale":"2024-04-23T23:38:35.236249+0000","last_undegraded":"2024-04-23T23:38:35.236249+0000","last_fullsized":"2024-04-23T23:38:35.236249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:36.519412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064394099999999998,"stat_sum":{"num_bytes":18878141,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":27,"num_read":4677,"num_read_kb":16099,"num_write":702,"num_write_kb":20461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'253","reported_seq":2950,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101750+0000","last_change":"2024-04-23T23:38:26.045238+0000","last_active":"2024-04-23T23:38:35.101750+0000","last_peered":"2024-04-23T23:38:35.101750+0000","last_clean":"2024-04-23T23:38:35.101750+0000","last_became_active":"2024-04-23T23:38:26.043692+0000","last_became_peered":"2024-04-23T23:38:26.043692+0000","last_unstale":"2024-04-23T23:38:35.101750+0000","last_undegraded":"2024-04-23T23:38:35.101750+0000","last_fullsized":"2024-04-23T23:38:35.101750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:35:16.137603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045588699999999998,"stat_sum":{"num_bytes":22179060,"num_objects":46,"num_object_clones":2,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":27,"num_read":3251,"num_read_kb":9984,"num_write":211,"num_write_kb":939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":107414,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1125982922,"num_objects":1633,"num_object_clones":176,"num_object_copies":3266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1633,"num_whiteouts":915,"num_read":93578,"num_read_kb":581621,"num_write":12102,"num_write_kb":345697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1707,"num_bytes_recovered":75837578,"num_keys_recovered":247,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":357609472,"data_stored":436035088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":10320,"ondisk_log_size":10320,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98928,"kb_used_data":58624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94272912,"statfs":{"total":96636764160,"available":96535461888,"internally_reserved":0,"allocated":60030976,"data_stored":78024139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105672,"kb_used_data":56440,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94266168,"statfs":{"total":96636764160,"available":96528556032,"internally_reserved":0,"allocated":57794560,"data_stored":68174205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73544,"kb_used_data":34044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298296,"statfs":{"total":96636764160,"available":96561455104,"internally_reserved":0,"allocated":34861056,"data_stored":36583001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855370,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88560,"kb_used_data":52104,"kb_used_omap":4,"kb_used_meta":36411,"kb_avail":94283280,"statfs":{"total":96636764160,"available":96546078720,"internally_reserved":0,"allocated":53354496,"data_stored":64627593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":37285486},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574866,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72196,"kb_used_data":36848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94299644,"statfs":{"total":96636764160,"available":96562835456,"internally_reserved":0,"allocated":37732352,"data_stored":45409022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98496,"kb_used_data":59000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94273344,"statfs":{"total":96636764160,"available":96535904256,"internally_reserved":0,"allocated":60416000,"data_stored":69911926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62246912,"data_stored":72184536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59183104,"data_stored":78738895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38514688,"data_stored":46638580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21807104,"data_stored":26257006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51499008,"data_stored":63236201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34017280,"data_stored":36196486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61087744,"data_stored":71921758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:38:39.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:38:39.489 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:39.489 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:39.498 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:39.519 INFO:teuthology.orchestra.run.smithi077.stdout:4082 write 0x39e491 thru 0x39eba3 (0x713 bytes) 2024-04-23T23:38:39.560 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:39.571+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:39.564 INFO:teuthology.orchestra.run.smithi077.stdout:4083 write 0xc60159d thru 0xc604119 (0x2b7d bytes) 2024-04-23T23:38:39.568 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:39.568 INFO:teuthology.orchestra.run.smithi077.stdout:4086 read 0x7c43253 thru 0x7c4e0ff (0xaead bytes) 2024-04-23T23:38:39.569 INFO:teuthology.orchestra.run.smithi077.stdout:4087 read 0x8ffc88d thru 0x90054d2 (0x8c46 bytes) 2024-04-23T23:38:39.569 INFO:teuthology.orchestra.run.smithi077.stdout:4089 write 0x8fa887c thru 0x8fadcce (0x5453 bytes) 2024-04-23T23:38:39.578 INFO:teuthology.orchestra.run.smithi077.stdout:4090 read 0xacf0d2e thru 0xacfd47d (0xc750 bytes) 2024-04-23T23:38:39.578 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:39.578 INFO:teuthology.orchestra.run.smithi077.stdout:4093 write 0xa943575 thru 0xa94a3ab (0x6e37 bytes) 2024-04-23T23:38:39.586 INFO:teuthology.orchestra.run.smithi077.stdout:4094 write 0xc5f5492 thru 0xc60118e (0xbcfd bytes) 2024-04-23T23:38:39.591 INFO:teuthology.orchestra.run.smithi077.stdout:4095 read 0x31f3c35 thru 0x31f9330 (0x56fc bytes) 2024-04-23T23:38:39.591 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:39.591 INFO:teuthology.orchestra.run.smithi077.stdout:4097 write 0xb74f726 thru 0xb754540 (0x4e1b bytes) 2024-04-23T23:38:39.599 INFO:teuthology.orchestra.run.smithi077.stdout:4099 read 0x781eb3e thru 0x78234f9 (0x49bc bytes) 2024-04-23T23:38:39.599 INFO:teuthology.orchestra.run.smithi077.stdout:4100 read 0xbaf54ec thru 0xbb04f33 (0xfa48 bytes) 2024-04-23T23:38:39.599 INFO:teuthology.orchestra.run.smithi077.stdout:4101 punch from 0x5953f59 to 0x59597bc, (0x5863 bytes) 2024-04-23T23:38:39.612 INFO:teuthology.orchestra.run.smithi077.stdout:4103 trunc from 0xc96fe06 to 0x23b30bf 2024-04-23T23:38:39.614 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:39.614 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:39.623 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:39.634+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:39.627 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:39.683 INFO:teuthology.orchestra.run.smithi077.stdout:4104 write 0x6b88a97 thru 0x6b8ab79 (0x20e3 bytes) 2024-04-23T23:38:39.699 INFO:teuthology.orchestra.run.smithi077.stdout:4108 write 0xc2aa740 thru 0xc2aaa67 (0x328 bytes) 2024-04-23T23:38:39.702 INFO:teuthology.orchestra.run.smithi077.stdout:4111 writesame 0x3625859 thru 0x36348b4 data_size 0x2(0xf05c bytes) 2024-04-23T23:38:39.720 INFO:teuthology.orchestra.run.smithi077.stdout:4112 write 0x94302d1 thru 0x9436c9b (0x69cb bytes) 2024-04-23T23:38:39.723 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:39.723 INFO:teuthology.orchestra.run.smithi077.stdout:4114 read 0x9af4ce9 thru 0x9b004bf (0xb7d7 bytes) 2024-04-23T23:38:39.723 INFO:teuthology.orchestra.run.smithi077.stdout:4115 punch from 0xbb960e7 to 0xbb9d1ac, (0x70c5 bytes) 2024-04-23T23:38:39.724 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:39.736+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:39.736 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:39.736 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:39.736 INFO:teuthology.orchestra.run.smithi077.stdout:4117 trunc from 0xc2aaa68 to 0x1165b7a 2024-04-23T23:38:39.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:39.749 INFO:teuthology.orchestra.run.smithi077.stdout:4118 read 0x3b9c54 thru 0x3c6e3c (0xd1e9 bytes) 2024-04-23T23:38:39.749 INFO:teuthology.orchestra.run.smithi077.stdout:4122 read 0xe7199a thru 0xe8194b (0xffb2 bytes) 2024-04-23T23:38:39.751 INFO:teuthology.orchestra.run.smithi077.stdout:4123 trunc from 0x1165b7a to 0x1756a0 2024-04-23T23:38:39.772 INFO:teuthology.orchestra.run.smithi077.stdout:4124 trunc from 0x1756a0 to 0x7b6c382 2024-04-23T23:38:39.778 INFO:teuthology.orchestra.run.smithi077.stdout:4125 write 0x4097604 thru 0x409e7da (0x71d7 bytes) 2024-04-23T23:38:39.783 INFO:teuthology.orchestra.run.smithi077.stdout:4126 read 0x274b25b thru 0x2753c4c (0x89f2 bytes) 2024-04-23T23:38:39.783 INFO:teuthology.orchestra.run.smithi077.stdout:4127 read 0x31a2734 thru 0x31aae90 (0x875d bytes) 2024-04-23T23:38:39.784 INFO:teuthology.orchestra.run.smithi077.stdout:4128 punch from 0x5cb38d6 to 0x5cbb8cc, (0x7ff6 bytes) 2024-04-23T23:38:39.784 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:39.784 INFO:teuthology.orchestra.run.smithi077.stdout:4130 read 0x416cb3e thru 0x417315c (0x661f bytes) 2024-04-23T23:38:39.789 INFO:teuthology.orchestra.run.smithi077.stdout:4131 trunc from 0x7b6c382 to 0xc4e939e 2024-04-23T23:38:39.795 INFO:teuthology.orchestra.run.smithi077.stdout:4132 flatten 2024-04-23T23:38:39.814 INFO:teuthology.orchestra.run.smithi077.stdout:4133 trunc from 0xc4e939e to 0x13b1bee 2024-04-23T23:38:39.825 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:39.838+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:39.844 INFO:teuthology.orchestra.run.smithi077.stdout:4135 writesame 0xc0a27d5 thru 0xc0b0946 data_size 0x3(0xe172 bytes) 2024-04-23T23:38:39.844 INFO:teuthology.orchestra.run.smithi077.stdout:4136 write 0x5d615f0 thru 0x5d66aea (0x54fb bytes) 2024-04-23T23:38:39.845 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:38:39.845 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:38:39.847 INFO:teuthology.orchestra.run.smithi077.stdout:4138 read 0x2581a16 thru 0x258f81e (0xde09 bytes) 2024-04-23T23:38:39.847 INFO:teuthology.orchestra.run.smithi077.stdout:4139 read 0x543388e thru 0x5442d37 (0xf4aa bytes) 2024-04-23T23:38:39.847 INFO:teuthology.orchestra.run.smithi077.stdout:4140 punch from 0x98067d5 to 0x98095ba, (0x2de5 bytes) 2024-04-23T23:38:39.847 INFO:teuthology.orchestra.run.smithi077.stdout:4142 write 0x838258c thru 0x838cc50 (0xa6c5 bytes) 2024-04-23T23:38:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:4144 read 0x17e7779 thru 0x17ef492 (0x7d1a bytes) 2024-04-23T23:38:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:4145 read 0x20c9c9e thru 0x20d42b5 (0xa618 bytes) 2024-04-23T23:38:39.851 INFO:teuthology.orchestra.run.smithi077.stdout:4146 read 0x1fa571e thru 0x1faa665 (0x4f48 bytes) 2024-04-23T23:38:39.851 INFO:teuthology.orchestra.run.smithi077.stdout:4147 clone 31 order 23 su 262144 sc 3 2024-04-23T23:38:39.853 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:39.853 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:39.857 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-04-23T23:38:39.124076+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1126573290,"num_objects":1635,"num_object_clones":176,"num_object_copies":3270,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1635,"num_whiteouts":915,"num_read":93694,"num_read_kb":581721,"num_write":12261,"num_write_kb":348113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1707,"num_bytes_recovered":75837578,"num_keys_recovered":247,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10437,"ondisk_log_size":10437,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":537396,"kb_used_data":297060,"kb_used_omap":12,"kb_used_meta":235251,"kb_avail":565693644,"statfs":{"total":579820584960,"available":579270291456,"internally_reserved":0,"allocated":304189440,"data_stored":362729886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12467,"internal_metadata":240897869},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":157099425,"num_objects":347,"num_object_clones":57,"num_object_copies":694,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":347,"num_whiteouts":248,"num_read":16469,"num_read_kb":187680,"num_write":1399,"num_write_kb":115524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028018"},"pg_stats":[{"pgid":"3.1f","version":"71'348","reported_seq":2824,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103521+0000","last_change":"2024-04-23T23:37:54.900909+0000","last_active":"2024-04-23T23:38:35.103521+0000","last_peered":"2024-04-23T23:38:35.103521+0000","last_clean":"2024-04-23T23:38:35.103521+0000","last_became_active":"2024-04-23T23:37:54.879740+0000","last_became_peered":"2024-04-23T23:37:54.879740+0000","last_unstale":"2024-04-23T23:38:35.103521+0000","last_undegraded":"2024-04-23T23:38:35.103521+0000","last_fullsized":"2024-04-23T23:38:35.103521+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:10:05.919349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036166670000000001,"stat_sum":{"num_bytes":34193945,"num_objects":52,"num_object_clones":2,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":27,"num_read":3402,"num_read_kb":13404,"num_write":410,"num_write_kb":3978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":538661,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"71'246","reported_seq":2039,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.098053+0000","last_change":"2024-04-23T23:38:29.052716+0000","last_active":"2024-04-23T23:38:35.098053+0000","last_peered":"2024-04-23T23:38:35.098053+0000","last_clean":"2024-04-23T23:38:35.098053+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:38:35.098053+0000","last_undegraded":"2024-04-23T23:38:35.098053+0000","last_fullsized":"2024-04-23T23:38:35.098053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:38:33.086756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061879000000000003,"stat_sum":{"num_bytes":43151025,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":37,"num_read":1605,"num_read_kb":11339,"num_write":202,"num_write_kb":2563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"74'336","reported_seq":2640,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.817062+0000","last_change":"2024-04-23T23:38:26.043657+0000","last_active":"2024-04-23T23:38:37.817062+0000","last_peered":"2024-04-23T23:38:37.817062+0000","last_clean":"2024-04-23T23:38:37.817062+0000","last_became_active":"2024-04-23T23:38:26.042706+0000","last_became_peered":"2024-04-23T23:38:26.042706+0000","last_unstale":"2024-04-23T23:38:37.817062+0000","last_undegraded":"2024-04-23T23:38:37.817062+0000","last_fullsized":"2024-04-23T23:38:37.817062+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":336,"log_dups_size":0,"ondisk_log_size":336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:34.143878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013335580000000001,"stat_sum":{"num_bytes":24907825,"num_objects":56,"num_object_clones":7,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":30,"num_read":3658,"num_read_kb":18395,"num_write":339,"num_write_kb":8505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":540782,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"74'365","reported_seq":3120,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.588962+0000","last_change":"2024-04-23T23:38:26.047051+0000","last_active":"2024-04-23T23:38:37.588962+0000","last_peered":"2024-04-23T23:38:37.588962+0000","last_clean":"2024-04-23T23:38:37.588962+0000","last_became_active":"2024-04-23T23:38:26.046143+0000","last_became_peered":"2024-04-23T23:38:26.046143+0000","last_unstale":"2024-04-23T23:38:37.588962+0000","last_undegraded":"2024-04-23T23:38:37.588962+0000","last_fullsized":"2024-04-23T23:38:37.588962+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:59:13.547501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29756914,"num_objects":50,"num_object_clones":6,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":30,"num_read":5116,"num_read_kb":33768,"num_write":330,"num_write_kb":6967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":73,"num_bytes_recovered":5093524,"num_keys_recovered":87,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"72'381","reported_seq":2073,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.220278+0000","last_change":"2024-04-23T23:38:26.044609+0000","last_active":"2024-04-23T23:38:35.220278+0000","last_peered":"2024-04-23T23:38:35.220278+0000","last_clean":"2024-04-23T23:38:35.220278+0000","last_became_active":"2024-04-23T23:38:26.043896+0000","last_became_peered":"2024-04-23T23:38:26.043896+0000","last_unstale":"2024-04-23T23:38:35.220278+0000","last_undegraded":"2024-04-23T23:38:35.220278+0000","last_fullsized":"2024-04-23T23:38:35.220278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:07.841377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048779100000000001,"stat_sum":{"num_bytes":24642399,"num_objects":50,"num_object_clones":5,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":30,"num_read":2832,"num_read_kb":15604,"num_write":541,"num_write_kb":23495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":4959576,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"73'381","reported_seq":2311,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.246640+0000","last_change":"2024-04-23T23:38:26.039065+0000","last_active":"2024-04-23T23:38:36.246640+0000","last_peered":"2024-04-23T23:38:36.246640+0000","last_clean":"2024-04-23T23:38:36.246640+0000","last_became_active":"2024-04-23T23:38:26.038182+0000","last_became_peered":"2024-04-23T23:38:26.038182+0000","last_unstale":"2024-04-23T23:38:36.246640+0000","last_undegraded":"2024-04-23T23:38:36.246640+0000","last_fullsized":"2024-04-23T23:38:36.246640+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:13.638816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109447,"stat_sum":{"num_bytes":29105409,"num_objects":41,"num_object_clones":3,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":22,"num_read":3084,"num_read_kb":6126,"num_write":501,"num_write_kb":8718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":560910,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"73'292","reported_seq":1543,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.160810+0000","last_change":"2024-04-23T23:38:26.041615+0000","last_active":"2024-04-23T23:38:36.160810+0000","last_peered":"2024-04-23T23:38:36.160810+0000","last_clean":"2024-04-23T23:38:36.160810+0000","last_became_active":"2024-04-23T23:38:26.041023+0000","last_became_peered":"2024-04-23T23:38:26.041023+0000","last_unstale":"2024-04-23T23:38:36.160810+0000","last_undegraded":"2024-04-23T23:38:36.160810+0000","last_fullsized":"2024-04-23T23:38:36.160810+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:17:57.310925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044664900000000003,"stat_sum":{"num_bytes":114812162,"num_objects":63,"num_object_clones":9,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":36,"num_read":995,"num_read_kb":12391,"num_write":238,"num_write_kb":8419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":127,"num_bytes_recovered":364940,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"71'244","reported_seq":1690,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103234+0000","last_change":"2024-04-23T23:38:19.812400+0000","last_active":"2024-04-23T23:38:35.103234+0000","last_peered":"2024-04-23T23:38:35.103234+0000","last_clean":"2024-04-23T23:38:35.103234+0000","last_became_active":"2024-04-23T23:38:19.811716+0000","last_became_peered":"2024-04-23T23:38:19.811716+0000","last_unstale":"2024-04-23T23:38:35.103234+0000","last_undegraded":"2024-04-23T23:38:35.103234+0000","last_fullsized":"2024-04-23T23:38:35.103234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:42.127482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091463299999999998,"stat_sum":{"num_bytes":29831907,"num_objects":44,"num_object_clones":6,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":26,"num_read":1558,"num_read_kb":22627,"num_write":290,"num_write_kb":12637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":4353222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"72'274","reported_seq":2797,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.117232+0000","last_change":"2024-04-23T23:37:55.069343+0000","last_active":"2024-04-23T23:38:35.117232+0000","last_peered":"2024-04-23T23:38:35.117232+0000","last_clean":"2024-04-23T23:38:35.117232+0000","last_became_active":"2024-04-23T23:37:54.879800+0000","last_became_peered":"2024-04-23T23:37:54.879800+0000","last_unstale":"2024-04-23T23:38:35.117232+0000","last_undegraded":"2024-04-23T23:38:35.117232+0000","last_fullsized":"2024-04-23T23:38:35.117232+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:07:14.432067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035554319999999999,"stat_sum":{"num_bytes":58877924,"num_objects":52,"num_object_clones":5,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":32,"num_read":3202,"num_read_kb":35020,"num_write":377,"num_write_kb":33490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":25197274,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"74'343","reported_seq":1410,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.294715+0000","last_change":"2024-04-23T23:37:54.921901+0000","last_active":"2024-04-23T23:38:37.294715+0000","last_peered":"2024-04-23T23:38:37.294715+0000","last_clean":"2024-04-23T23:38:37.294715+0000","last_became_active":"2024-04-23T23:37:54.878095+0000","last_became_peered":"2024-04-23T23:37:54.878095+0000","last_unstale":"2024-04-23T23:38:37.294715+0000","last_undegraded":"2024-04-23T23:38:37.294715+0000","last_fullsized":"2024-04-23T23:38:37.294715+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:03.387703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012770870000000001,"stat_sum":{"num_bytes":32000827,"num_objects":45,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":26,"num_read":1769,"num_read_kb":13143,"num_write":426,"num_write_kb":14412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":115939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"71'235","reported_seq":1118,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101801+0000","last_change":"2024-04-23T23:38:26.046815+0000","last_active":"2024-04-23T23:38:35.101801+0000","last_peered":"2024-04-23T23:38:35.101801+0000","last_clean":"2024-04-23T23:38:35.101801+0000","last_became_active":"2024-04-23T23:38:26.045988+0000","last_became_peered":"2024-04-23T23:38:26.045988+0000","last_unstale":"2024-04-23T23:38:35.101801+0000","last_undegraded":"2024-04-23T23:38:35.101801+0000","last_fullsized":"2024-04-23T23:38:35.101801+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:33:46.276656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066396700000000001,"stat_sum":{"num_bytes":44030600,"num_objects":62,"num_object_clones":7,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":40,"num_read":534,"num_read_kb":6031,"num_write":194,"num_write_kb":6669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":1725786,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"71'510","reported_seq":3063,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101742+0000","last_change":"2024-04-23T23:38:26.044435+0000","last_active":"2024-04-23T23:38:35.101742+0000","last_peered":"2024-04-23T23:38:35.101742+0000","last_clean":"2024-04-23T23:38:35.101742+0000","last_became_active":"2024-04-23T23:38:26.043571+0000","last_became_peered":"2024-04-23T23:38:26.043571+0000","last_unstale":"2024-04-23T23:38:35.101742+0000","last_undegraded":"2024-04-23T23:38:35.101742+0000","last_fullsized":"2024-04-23T23:38:35.101742+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:40:39.851312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000411357,"stat_sum":{"num_bytes":16994765,"num_objects":52,"num_object_clones":4,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":26,"num_read":4828,"num_read_kb":10636,"num_write":688,"num_write_kb":4689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":1582215,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":115,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.097850+0000","last_change":"2024-04-23T23:37:23.756663+0000","last_active":"2024-04-23T23:38:35.097850+0000","last_peered":"2024-04-23T23:38:35.097850+0000","last_clean":"2024-04-23T23:38:35.097850+0000","last_became_active":"2024-04-23T23:37:23.756167+0000","last_became_peered":"2024-04-23T23:37:23.756167+0000","last_unstale":"2024-04-23T23:38:35.097850+0000","last_undegraded":"2024-04-23T23:38:35.097850+0000","last_fullsized":"2024-04-23T23:38:35.097850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:15.878718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"71'196","reported_seq":2182,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103320+0000","last_change":"2024-04-23T23:37:33.814364+0000","last_active":"2024-04-23T23:38:35.103320+0000","last_peered":"2024-04-23T23:38:35.103320+0000","last_clean":"2024-04-23T23:38:35.103320+0000","last_became_active":"2024-04-23T23:37:31.808177+0000","last_became_peered":"2024-04-23T23:37:31.808177+0000","last_unstale":"2024-04-23T23:38:35.103320+0000","last_undegraded":"2024-04-23T23:38:35.103320+0000","last_fullsized":"2024-04-23T23:38:35.103320+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:00:17.983601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043457199999999999,"stat_sum":{"num_bytes":19435337,"num_objects":42,"num_object_clones":3,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":26,"num_read":2452,"num_read_kb":10390,"num_write":181,"num_write_kb":930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":118,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.114068+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:38:36.114068+0000","last_peered":"2024-04-23T23:38:36.114068+0000","last_clean":"2024-04-23T23:38:36.114068+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:38:36.114068+0000","last_undegraded":"2024-04-23T23:38:36.114068+0000","last_fullsized":"2024-04-23T23:38:36.114068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"71'589","reported_seq":1875,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103474+0000","last_change":"2024-04-23T23:38:19.813142+0000","last_active":"2024-04-23T23:38:35.103474+0000","last_peered":"2024-04-23T23:38:35.103474+0000","last_clean":"2024-04-23T23:38:35.103474+0000","last_became_active":"2024-04-23T23:38:19.812199+0000","last_became_peered":"2024-04-23T23:38:19.812199+0000","last_unstale":"2024-04-23T23:38:35.103474+0000","last_undegraded":"2024-04-23T23:38:35.103474+0000","last_fullsized":"2024-04-23T23:38:35.103474+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":589,"log_dups_size":0,"ondisk_log_size":589,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:19:02.913036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000861358,"stat_sum":{"num_bytes":23403118,"num_objects":55,"num_object_clones":7,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":29,"num_read":3436,"num_read_kb":25782,"num_write":918,"num_write_kb":10501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":2762806,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":116,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101927+0000","last_change":"2024-04-23T23:37:24.109419+0000","last_active":"2024-04-23T23:38:35.101927+0000","last_peered":"2024-04-23T23:38:35.101927+0000","last_clean":"2024-04-23T23:38:35.101927+0000","last_became_active":"2024-04-23T23:37:24.109131+0000","last_became_peered":"2024-04-23T23:37:24.109131+0000","last_unstale":"2024-04-23T23:38:35.101927+0000","last_undegraded":"2024-04-23T23:38:35.101927+0000","last_fullsized":"2024-04-23T23:38:35.101927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:59:15.656083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"73'234","reported_seq":1103,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.229860+0000","last_change":"2024-04-23T23:37:33.804737+0000","last_active":"2024-04-23T23:38:36.229860+0000","last_peered":"2024-04-23T23:38:36.229860+0000","last_clean":"2024-04-23T23:38:36.229860+0000","last_became_active":"2024-04-23T23:37:31.799126+0000","last_became_peered":"2024-04-23T23:37:31.799126+0000","last_unstale":"2024-04-23T23:38:36.229860+0000","last_undegraded":"2024-04-23T23:38:36.229860+0000","last_fullsized":"2024-04-23T23:38:36.229860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:03:26.402356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000552153,"stat_sum":{"num_bytes":19654339,"num_objects":40,"num_object_clones":4,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":20,"num_read":1299,"num_read_kb":12327,"num_write":242,"num_write_kb":8769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":118,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.114018+0000","last_change":"2024-04-23T23:37:24.109448+0000","last_active":"2024-04-23T23:38:36.114018+0000","last_peered":"2024-04-23T23:38:36.114018+0000","last_clean":"2024-04-23T23:38:36.114018+0000","last_became_active":"2024-04-23T23:37:24.109122+0000","last_became_peered":"2024-04-23T23:37:24.109122+0000","last_unstale":"2024-04-23T23:38:36.114018+0000","last_undegraded":"2024-04-23T23:38:36.114018+0000","last_fullsized":"2024-04-23T23:38:36.114018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:17:07.569487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"74'190","reported_seq":1169,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.803864+0000","last_change":"2024-04-23T23:38:19.815075+0000","last_active":"2024-04-23T23:38:37.803864+0000","last_peered":"2024-04-23T23:38:37.803864+0000","last_clean":"2024-04-23T23:38:37.803864+0000","last_became_active":"2024-04-23T23:38:19.813635+0000","last_became_peered":"2024-04-23T23:38:19.813635+0000","last_unstale":"2024-04-23T23:38:37.803864+0000","last_undegraded":"2024-04-23T23:38:37.803864+0000","last_fullsized":"2024-04-23T23:38:37.803864+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:33:28.410564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014827079999999999,"stat_sum":{"num_bytes":24877446,"num_objects":57,"num_object_clones":9,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":37,"num_read":1750,"num_read_kb":25383,"num_write":199,"num_write_kb":21868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"71'269","reported_seq":2597,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103278+0000","last_change":"2024-04-23T23:38:26.044166+0000","last_active":"2024-04-23T23:38:35.103278+0000","last_peered":"2024-04-23T23:38:35.103278+0000","last_clean":"2024-04-23T23:38:35.103278+0000","last_became_active":"2024-04-23T23:38:26.043316+0000","last_became_peered":"2024-04-23T23:38:26.043316+0000","last_unstale":"2024-04-23T23:38:35.103278+0000","last_undegraded":"2024-04-23T23:38:35.103278+0000","last_fullsized":"2024-04-23T23:38:35.103278+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":269,"log_dups_size":0,"ondisk_log_size":269,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:17.966592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400399999999997,"stat_sum":{"num_bytes":12074921,"num_objects":44,"num_object_clones":7,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":25,"num_read":2718,"num_read_kb":12833,"num_write":327,"num_write_kb":6045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":353948,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":96,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.121858+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:38:37.121858+0000","last_peered":"2024-04-23T23:38:37.121858+0000","last_clean":"2024-04-23T23:38:37.121858+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:38:37.121858+0000","last_undegraded":"2024-04-23T23:38:37.121858+0000","last_fullsized":"2024-04-23T23:38:37.121858+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"73'252","reported_seq":1129,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.113890+0000","last_change":"2024-04-23T23:37:33.804968+0000","last_active":"2024-04-23T23:38:36.113890+0000","last_peered":"2024-04-23T23:38:36.113890+0000","last_clean":"2024-04-23T23:38:36.113890+0000","last_became_active":"2024-04-23T23:37:31.799146+0000","last_became_peered":"2024-04-23T23:37:31.799146+0000","last_unstale":"2024-04-23T23:38:36.113890+0000","last_undegraded":"2024-04-23T23:38:36.113890+0000","last_fullsized":"2024-04-23T23:38:36.113890+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:40:15.441842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055612800000000003,"stat_sum":{"num_bytes":47207744,"num_objects":56,"num_object_clones":5,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":29,"num_read":1255,"num_read_kb":25725,"num_write":399,"num_write_kb":59611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":120,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.098017+0000","last_change":"2024-04-23T23:38:16.993705+0000","last_active":"2024-04-23T23:38:35.098017+0000","last_peered":"2024-04-23T23:38:35.098017+0000","last_clean":"2024-04-23T23:38:35.098017+0000","last_became_active":"2024-04-23T23:38:16.993379+0000","last_became_peered":"2024-04-23T23:38:16.993379+0000","last_unstale":"2024-04-23T23:38:35.098017+0000","last_undegraded":"2024-04-23T23:38:35.098017+0000","last_fullsized":"2024-04-23T23:38:35.098017+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:01.045213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"71'476","reported_seq":2815,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.103311+0000","last_change":"2024-04-23T23:38:26.042967+0000","last_active":"2024-04-23T23:38:35.103311+0000","last_peered":"2024-04-23T23:38:35.103311+0000","last_clean":"2024-04-23T23:38:35.103311+0000","last_became_active":"2024-04-23T23:38:26.042171+0000","last_became_peered":"2024-04-23T23:38:26.042171+0000","last_unstale":"2024-04-23T23:38:35.103311+0000","last_undegraded":"2024-04-23T23:38:35.103311+0000","last_fullsized":"2024-04-23T23:38:35.103311+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:14:57.412594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047655700000000001,"stat_sum":{"num_bytes":7834388,"num_objects":36,"num_object_clones":1,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":24,"num_read":4030,"num_read_kb":10239,"num_write":749,"num_write_kb":2143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":25578,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":69,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.113947+0000","last_change":"2024-04-23T23:38:05.927674+0000","last_active":"2024-04-23T23:38:36.113947+0000","last_peered":"2024-04-23T23:38:36.113947+0000","last_clean":"2024-04-23T23:38:36.113947+0000","last_became_active":"2024-04-23T23:38:05.927354+0000","last_became_peered":"2024-04-23T23:38:05.927354+0000","last_unstale":"2024-04-23T23:38:36.113947+0000","last_undegraded":"2024-04-23T23:38:36.113947+0000","last_fullsized":"2024-04-23T23:38:36.113947+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:38:23.526110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"74'461","reported_seq":1412,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.862833+0000","last_change":"2024-04-23T23:38:19.814491+0000","last_active":"2024-04-23T23:38:37.862833+0000","last_peered":"2024-04-23T23:38:37.862833+0000","last_clean":"2024-04-23T23:38:37.862833+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:38:37.862833+0000","last_undegraded":"2024-04-23T23:38:37.862833+0000","last_fullsized":"2024-04-23T23:38:37.862833+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:17:55.422130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000789393,"stat_sum":{"num_bytes":22847223,"num_objects":36,"num_object_clones":3,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":19,"num_read":2594,"num_read_kb":4572,"num_write":598,"num_write_kb":2331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":108,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.098016+0000","last_change":"2024-04-23T23:37:32.837969+0000","last_active":"2024-04-23T23:38:35.098016+0000","last_peered":"2024-04-23T23:38:35.098016+0000","last_clean":"2024-04-23T23:38:35.098016+0000","last_became_active":"2024-04-23T23:37:32.837752+0000","last_became_peered":"2024-04-23T23:37:32.837752+0000","last_unstale":"2024-04-23T23:38:35.098016+0000","last_undegraded":"2024-04-23T23:38:35.098016+0000","last_fullsized":"2024-04-23T23:38:35.098016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:24.064742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":272,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101859+0000","last_change":"2024-04-23T23:37:18.219021+0000","last_active":"2024-04-23T23:38:35.101859+0000","last_peered":"2024-04-23T23:38:35.101859+0000","last_clean":"2024-04-23T23:38:35.101859+0000","last_became_active":"2024-04-23T23:37:18.217977+0000","last_became_peered":"2024-04-23T23:37:18.217977+0000","last_unstale":"2024-04-23T23:38:35.101859+0000","last_undegraded":"2024-04-23T23:38:35.101859+0000","last_fullsized":"2024-04-23T23:38:35.101859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:30.181373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"73'188","reported_seq":1323,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.219191+0000","last_change":"2024-04-23T23:38:19.809366+0000","last_active":"2024-04-23T23:38:36.219191+0000","last_peered":"2024-04-23T23:38:36.219191+0000","last_clean":"2024-04-23T23:38:36.219191+0000","last_became_active":"2024-04-23T23:38:19.808534+0000","last_became_peered":"2024-04-23T23:38:19.808534+0000","last_unstale":"2024-04-23T23:38:36.219191+0000","last_undegraded":"2024-04-23T23:38:36.219191+0000","last_fullsized":"2024-04-23T23:38:36.219191+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:33:04.015896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701399999999997,"stat_sum":{"num_bytes":39813649,"num_objects":54,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":34,"num_read":965,"num_read_kb":17975,"num_write":168,"num_write_kb":12857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":5130309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"72'286","reported_seq":4226,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.179517+0000","last_change":"2024-04-23T23:38:26.042905+0000","last_active":"2024-04-23T23:38:35.179517+0000","last_peered":"2024-04-23T23:38:35.179517+0000","last_clean":"2024-04-23T23:38:35.179517+0000","last_became_active":"2024-04-23T23:38:26.042234+0000","last_became_peered":"2024-04-23T23:38:26.042234+0000","last_unstale":"2024-04-23T23:38:35.179517+0000","last_undegraded":"2024-04-23T23:38:35.179517+0000","last_fullsized":"2024-04-23T23:38:35.179517+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:49:47.078576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078111900000000004,"stat_sum":{"num_bytes":43668924,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":38,"num_read":3976,"num_read_kb":21170,"num_write":257,"num_write_kb":5995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":70,"num_bytes_recovered":688827,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"73'236","reported_seq":1453,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-23T23:38:36.169277+0000","last_change":"2024-04-23T23:38:29.052345+0000","last_active":"2024-04-23T23:38:36.169277+0000","last_peered":"2024-04-23T23:38:36.169277+0000","last_clean":"2024-04-23T23:38:36.169277+0000","last_became_active":"2024-04-23T23:38:29.051657+0000","last_became_peered":"2024-04-23T23:38:29.051657+0000","last_unstale":"2024-04-23T23:38:36.169277+0000","last_undegraded":"2024-04-23T23:38:36.169277+0000","last_fullsized":"2024-04-23T23:38:36.169277+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":236,"log_dups_size":0,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:02:21.015699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036496,"stat_sum":{"num_bytes":12342281,"num_objects":44,"num_object_clones":2,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":23,"num_read":1559,"num_read_kb":11029,"num_write":221,"num_write_kb":2351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":240553,"num_keys_recovered":36,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"72'255","reported_seq":3509,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.220676+0000","last_change":"2024-04-23T23:38:26.043918+0000","last_active":"2024-04-23T23:38:35.220676+0000","last_peered":"2024-04-23T23:38:35.220676+0000","last_clean":"2024-04-23T23:38:35.220676+0000","last_became_active":"2024-04-23T23:38:26.043252+0000","last_became_peered":"2024-04-23T23:38:26.043252+0000","last_unstale":"2024-04-23T23:38:35.220676+0000","last_undegraded":"2024-04-23T23:38:35.220676+0000","last_fullsized":"2024-04-23T23:38:35.220676+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":255,"log_dups_size":0,"ondisk_log_size":255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:17.704543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070273799999999995,"stat_sum":{"num_bytes":40902334,"num_objects":54,"num_object_clones":9,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":25,"num_read":3539,"num_read_kb":23992,"num_write":219,"num_write_kb":5831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":363289,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"74'259","reported_seq":3299,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.751611+0000","last_change":"2024-04-23T23:38:19.814484+0000","last_active":"2024-04-23T23:38:37.751611+0000","last_peered":"2024-04-23T23:38:37.751611+0000","last_clean":"2024-04-23T23:38:37.751611+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:38:37.751611+0000","last_undegraded":"2024-04-23T23:38:37.751611+0000","last_fullsized":"2024-04-23T23:38:37.751611+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:15:28.381041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001080988,"stat_sum":{"num_bytes":78162259,"num_objects":66,"num_object_clones":9,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":3248,"num_read_kb":27645,"num_write":240,"num_write_kb":12699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"74'293","reported_seq":3020,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-04-23T23:38:37.816988+0000","last_change":"2024-04-23T23:38:05.930084+0000","last_active":"2024-04-23T23:38:37.816988+0000","last_peered":"2024-04-23T23:38:37.816988+0000","last_clean":"2024-04-23T23:38:37.816988+0000","last_became_active":"2024-04-23T23:38:05.929374+0000","last_became_peered":"2024-04-23T23:38:05.929374+0000","last_unstale":"2024-04-23T23:38:37.816988+0000","last_undegraded":"2024-04-23T23:38:37.816988+0000","last_fullsized":"2024-04-23T23:38:37.816988+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:48.268961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090758899999999999,"stat_sum":{"num_bytes":16641113,"num_objects":53,"num_object_clones":6,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":30,"num_read":4154,"num_read_kb":27580,"num_write":268,"num_write_kb":5811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":22374,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"71'539","reported_seq":4032,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101974+0000","last_change":"2024-04-23T23:38:26.048120+0000","last_active":"2024-04-23T23:38:35.101974+0000","last_peered":"2024-04-23T23:38:35.101974+0000","last_clean":"2024-04-23T23:38:35.101974+0000","last_became_active":"2024-04-23T23:38:26.045945+0000","last_became_peered":"2024-04-23T23:38:26.045945+0000","last_unstale":"2024-04-23T23:38:35.101974+0000","last_undegraded":"2024-04-23T23:38:35.101974+0000","last_fullsized":"2024-04-23T23:38:35.101974+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:43:25.252567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727580000000001,"stat_sum":{"num_bytes":68078631,"num_objects":52,"num_object_clones":7,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":25,"num_read":5978,"num_read_kb":25171,"num_write":664,"num_write_kb":4925,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":65,"num_bytes_recovered":963058,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"72'444","reported_seq":2307,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.179939+0000","last_change":"2024-04-23T23:38:26.046827+0000","last_active":"2024-04-23T23:38:35.179939+0000","last_peered":"2024-04-23T23:38:35.179939+0000","last_clean":"2024-04-23T23:38:35.179939+0000","last_became_active":"2024-04-23T23:38:26.045988+0000","last_became_peered":"2024-04-23T23:38:26.045988+0000","last_unstale":"2024-04-23T23:38:35.179939+0000","last_undegraded":"2024-04-23T23:38:35.179939+0000","last_fullsized":"2024-04-23T23:38:35.179939+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:40:24.297807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001215793,"stat_sum":{"num_bytes":32140657,"num_objects":51,"num_object_clones":8,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":26,"num_read":3521,"num_read_kb":16619,"num_write":542,"num_write_kb":9498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":488922,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"71'227","reported_seq":1880,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.097540+0000","last_change":"2024-04-23T23:37:34.009681+0000","last_active":"2024-04-23T23:38:35.097540+0000","last_peered":"2024-04-23T23:38:35.097540+0000","last_clean":"2024-04-23T23:38:35.097540+0000","last_became_active":"2024-04-23T23:37:31.807784+0000","last_became_peered":"2024-04-23T23:37:31.807784+0000","last_unstale":"2024-04-23T23:38:35.097540+0000","last_undegraded":"2024-04-23T23:38:35.097540+0000","last_fullsized":"2024-04-23T23:38:35.097540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:08:05.126770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044726999999999999,"stat_sum":{"num_bytes":34335818,"num_objects":48,"num_object_clones":3,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":30,"num_read":1776,"num_read_kb":6535,"num_write":239,"num_write_kb":6795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"71'259","reported_seq":4487,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101961+0000","last_change":"2024-04-23T23:38:29.052602+0000","last_active":"2024-04-23T23:38:35.101961+0000","last_peered":"2024-04-23T23:38:35.101961+0000","last_clean":"2024-04-23T23:38:35.101961+0000","last_became_active":"2024-04-23T23:38:29.051325+0000","last_became_peered":"2024-04-23T23:38:29.051325+0000","last_unstale":"2024-04-23T23:38:35.101961+0000","last_undegraded":"2024-04-23T23:38:35.101961+0000","last_fullsized":"2024-04-23T23:38:35.101961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":259,"log_dups_size":0,"ondisk_log_size":259,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:21:51.021680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318700000000001,"stat_sum":{"num_bytes":59199837,"num_objects":55,"num_object_clones":9,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":26,"num_read":4817,"num_read_kb":52087,"num_write":222,"num_write_kb":10795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":67,"num_bytes_recovered":4166338,"num_keys_recovered":9,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"72'459","reported_seq":3565,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.236249+0000","last_change":"2024-04-23T23:37:33.814367+0000","last_active":"2024-04-23T23:38:35.236249+0000","last_peered":"2024-04-23T23:38:35.236249+0000","last_clean":"2024-04-23T23:38:35.236249+0000","last_became_active":"2024-04-23T23:37:31.808751+0000","last_became_peered":"2024-04-23T23:37:31.808751+0000","last_unstale":"2024-04-23T23:38:35.236249+0000","last_undegraded":"2024-04-23T23:38:35.236249+0000","last_fullsized":"2024-04-23T23:38:35.236249+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:10:36.519412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064394099999999998,"stat_sum":{"num_bytes":18878141,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":27,"num_read":4677,"num_read_kb":16099,"num_write":702,"num_write_kb":20461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"71'253","reported_seq":2950,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-23T23:38:35.101750+0000","last_change":"2024-04-23T23:38:26.045238+0000","last_active":"2024-04-23T23:38:35.101750+0000","last_peered":"2024-04-23T23:38:35.101750+0000","last_clean":"2024-04-23T23:38:35.101750+0000","last_became_active":"2024-04-23T23:38:26.043692+0000","last_became_peered":"2024-04-23T23:38:26.043692+0000","last_unstale":"2024-04-23T23:38:35.101750+0000","last_undegraded":"2024-04-23T23:38:35.101750+0000","last_fullsized":"2024-04-23T23:38:35.101750+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:35:16.137603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045588699999999998,"stat_sum":{"num_bytes":22179060,"num_objects":46,"num_object_clones":2,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":27,"num_read":3251,"num_read_kb":9984,"num_write":211,"num_write_kb":939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":64,"num_bytes_recovered":107414,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1125982922,"num_objects":1633,"num_object_clones":176,"num_object_copies":3266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1633,"num_whiteouts":915,"num_read":93578,"num_read_kb":581621,"num_write":12102,"num_write_kb":345697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1707,"num_bytes_recovered":75837578,"num_keys_recovered":247,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":357609472,"data_stored":436035088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":10320,"ondisk_log_size":10320,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98928,"kb_used_data":58624,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94272912,"statfs":{"total":96636764160,"available":96535461888,"internally_reserved":0,"allocated":60030976,"data_stored":78024139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":105672,"kb_used_data":56440,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94266168,"statfs":{"total":96636764160,"available":96528556032,"internally_reserved":0,"allocated":57794560,"data_stored":68174205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":73544,"kb_used_data":34044,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94298296,"statfs":{"total":96636764160,"available":96561455104,"internally_reserved":0,"allocated":34861056,"data_stored":36583001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855370,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88560,"kb_used_data":52104,"kb_used_omap":4,"kb_used_meta":36411,"kb_avail":94283280,"statfs":{"total":96636764160,"available":96546078720,"internally_reserved":0,"allocated":53354496,"data_stored":64627593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":37285486},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574866,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72196,"kb_used_data":36848,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94299644,"statfs":{"total":96636764160,"available":96562835456,"internally_reserved":0,"allocated":37732352,"data_stored":45409022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98496,"kb_used_data":59000,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94273344,"statfs":{"total":96636764160,"available":96535904256,"internally_reserved":0,"allocated":60416000,"data_stored":69911926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":62246912,"data_stored":72184536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":59183104,"data_stored":78738895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":38514688,"data_stored":46638580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":21807104,"data_stored":26257006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":51499008,"data_stored":63236201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34017280,"data_stored":36196486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61087744,"data_stored":71921758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:38:39.859 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-23T23:38:39.859 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:39.859 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 1, 2, 5, 6, 7] 2024-04-23T23:38:39.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-04-23T23:38:39.863 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:39.942 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:39.954+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:40.004 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.004 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.013 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:40.026 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:40.038+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:40.115 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.116 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:40.126 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:38:40.127 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:40.140+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:40.204 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:38:40.215+0000 7f7374a68640 -1 mon.a@0(leader).osd e77 definitely_dead 0 2024-04-23T23:38:40.228 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:40.239+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:40.238 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.239 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:40.313 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-04-23T23:38:40.329 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:40.342+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:40.337 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:40.337 INFO:teuthology.orchestra.run.smithi077.stdout:4151 write 0x5612da7 thru 0x561b242 (0x849c bytes) 2024-04-23T23:38:40.345 INFO:teuthology.orchestra.run.smithi077.stdout:4152 write 0x49162b7 thru 0x491e0ae (0x7df8 bytes) 2024-04-23T23:38:40.350 INFO:teuthology.orchestra.run.smithi077.stdout:4153 read 0x89aa1e1 thru 0x89abab5 (0x18d5 bytes) 2024-04-23T23:38:40.357 INFO:teuthology.orchestra.run.smithi077.stdout:4154 writesame 0xcf6e935 thru 0xcf6f928 data_size 0x2(0xff4 bytes) 2024-04-23T23:38:40.360 INFO:teuthology.orchestra.run.smithi077.stdout:4155 read 0x8e5409e thru 0x8e5a692 (0x65f5 bytes) 2024-04-23T23:38:40.365 INFO:teuthology.orchestra.run.smithi077.stdout:4156 trunc from 0xcf6f929 to 0x8dc99ce 2024-04-23T23:38:40.380 INFO:teuthology.orchestra.run.smithi077.stdout:4158 punch from 0x6b00346 to 0x6b0de28, (0xdae2 bytes) 2024-04-23T23:38:40.380 INFO:teuthology.orchestra.run.smithi077.stdout:4160 write 0x75bdc3 thru 0x763952 (0x7b90 bytes) 2024-04-23T23:38:40.385 INFO:teuthology.orchestra.run.smithi077.stdout:4162 write 0x13dac1d thru 0x13e028e (0x5672 bytes) 2024-04-23T23:38:40.392 INFO:teuthology.orchestra.run.smithi077.stdout:4163 read 0x8a6985c thru 0x8a74ea7 (0xb64c bytes) 2024-04-23T23:38:40.393 INFO:teuthology.orchestra.run.smithi077.stdout:4165 punch from 0x23dfd32 to 0x23ed3e6, (0xd6b4 bytes) 2024-04-23T23:38:40.393 INFO:teuthology.orchestra.run.smithi077.stdout:4166 read 0x22e054f thru 0x22ee72d (0xe1df bytes) 2024-04-23T23:38:40.393 INFO:teuthology.orchestra.run.smithi077.stdout:4167 read 0x6ed883e thru 0x6ee7aea (0xf2ad bytes) 2024-04-23T23:38:40.398 INFO:teuthology.orchestra.run.smithi077.stdout:4168 write 0x9506ea3 thru 0x9509a86 (0x2be4 bytes) 2024-04-23T23:38:40.402 INFO:teuthology.orchestra.run.smithi077.stdout:4170 read 0x91a38b4 thru 0x91aa4bc (0x6c09 bytes) 2024-04-23T23:38:40.402 INFO:teuthology.orchestra.run.smithi077.stdout:4171 read 0x20125e5 thru 0x2021a09 (0xf425 bytes) 2024-04-23T23:38:40.402 INFO:teuthology.orchestra.run.smithi077.stdout:4172 write 0x6dd62e6 thru 0x6dd847e (0x2199 bytes) 2024-04-23T23:38:40.404 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.404 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.405 INFO:teuthology.orchestra.run.smithi077.stdout:4173 read 0x8fd57dc thru 0x8fdc70a (0x6f2f bytes) 2024-04-23T23:38:40.406 INFO:teuthology.orchestra.run.smithi077.stdout:4175 write 0xc00678 thru 0xc08b5c (0x84e5 bytes) 2024-04-23T23:38:40.411 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:40.411 INFO:teuthology.orchestra.run.smithi077.stdout:4177 read 0x86b0ae8 thru 0x86bc7fd (0xbd16 bytes) 2024-04-23T23:38:40.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:40.420 INFO:teuthology.orchestra.run.smithi077.stdout:4178 write 0xc6cbe51 thru 0xc6d46f8 (0x88a8 bytes) 2024-04-23T23:38:40.423 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:40.423 INFO:teuthology.orchestra.run.smithi077.stdout:4180 writesame 0x185b34c thru 0x1860045 data_size 0x3b(0x4cfa bytes) 2024-04-23T23:38:40.428 INFO:teuthology.orchestra.run.smithi077.stdout:4183 punch from 0x8a2e721 to 0x8a35e7b, (0x775a bytes) 2024-04-23T23:38:40.430 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:40.443+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:40.431 INFO:teuthology.orchestra.run.smithi077.stdout:4184 trunc from 0xc6d46f9 to 0x97afd78 2024-04-23T23:38:40.441 INFO:teuthology.orchestra.run.smithi077.stdout:4185 read 0x3aea1fd thru 0x3af25cc (0x83d0 bytes) 2024-04-23T23:38:40.450 INFO:teuthology.orchestra.run.smithi077.stdout:4186 write 0xc6ddf6d thru 0xc6ddfb2 (0x46 bytes) 2024-04-23T23:38:40.452 INFO:teuthology.orchestra.run.smithi077.stdout:4187 write 0x6e613d9 thru 0x6e661d9 (0x4e01 bytes) 2024-04-23T23:38:40.456 INFO:teuthology.orchestra.run.smithi077.stdout:4188 clone 32 order 23 su 4194304 sc 3 2024-04-23T23:38:40.525 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.526 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.531 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:40.543+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:40.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:40.631 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:40.643+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:40.677 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.677 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:40.770 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:40.781+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:40.828 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.829 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.834 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:40.847+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:40.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:40.934 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:40.947+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:40.979 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:40.980 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:40.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:41.035 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:41.048+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:41.090 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:41.090 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:41.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:41.131 INFO:teuthology.orchestra.run.smithi077.stderr:marked out osd.0. 2024-04-23T23:38:41.136 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:41.148+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:41.206 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:41.206 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:41.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:41.259 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:41.271+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:41.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:41.320 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:41.320 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:41.330 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:41.374 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:41.386+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:41.394 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:41.395 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:41.412 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:41.412 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:41.430 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:41.431 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:41.436 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:41.437 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:41.439 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:41.452+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:41.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:41.447 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:41.448 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:41.467 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:41.467 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:41.485 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:41.485 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:41.502 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:41.503 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:41.520 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:41.520 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:41.540 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:41.553+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:41.552 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:41.552 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:41.552 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:41.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:41.645 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:41.657+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37869 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1134592~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508888822999999, 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045333998, 2024-04-23T23:38:41.705 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37869 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207481+0000", 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207482+0000", 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8299999999999995e-07 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207485+0000", 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9620000000000002e-06 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207488+0000", 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6800000000000002e-06 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252696+0000", 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045208527999999998 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252756+0000", 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9828999999999999e-05 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252815+0000", 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8900999999999997e-05 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37870 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1155072~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.709 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508877271999999, 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045543751, 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37870 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207492+0000", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207493+0000", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8799999999999998e-07 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207501+0000", 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0269999999999995e-06 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207507+0000", 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207512+0000", 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6909999999999996e-06 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252853+0000", 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045341765999999999 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.252932+0000", 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8846999999999999e-05 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253036+0000", 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103788 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37871 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1175552~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508849565999999, 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045672261999999998, 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37871 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.714 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207520+0000", 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207521+0000", 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.44e-07 2024-04-23T23:38:41.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207523+0000", 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207529+0000", 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2999999999999998e-06 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207533+0000", 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5029999999999999e-06 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253082+0000", 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045548271000000001 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253139+0000", 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7237000000000001e-05 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253192+0000", 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3470000000000001e-05 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37872 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1196032~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508830215, 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806959000000001, 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.718 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37872 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207539+0000", 2024-04-23T23:38:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207540+0000", 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207542+0000", 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7749999999999999e-06 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207546+0000", 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8239999999999999e-06 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207553+0000", 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253231+0000", 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045677698000000003 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253276+0000", 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5238000000000003e-05 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253346+0000", 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0234000000000006e-05 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37873 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1216512~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508812425999999, 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046012472999999998, 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37873 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207557+0000", 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207558+0000", 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207559+0000", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4610000000000001e-06 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207565+0000", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0700000000000003e-06 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207569+0000", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.189e-06 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253392+0000", 2024-04-23T23:38:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045822300000000003 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253471+0000", 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9354e-05 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253570+0000", 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8748999999999999e-05 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37874 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1236992~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508793673, 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046114845000000002, 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37874 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207576+0000", 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.46e-07 2024-04-23T23:38:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207578+0000", 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207584+0000", 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2249999999999997e-06 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207589+0000", 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:38:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253602+0000", 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046013314 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253641+0000", 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8980000000000003e-05 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253691+0000", 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9503999999999999e-05 2024-04-23T23:38:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37875 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1257472~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508774580000001, 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046215125000000003, 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37875 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207595+0000", 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207597+0000", 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.632e-06 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207603+0000", 2024-04-23T23:38:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207614+0000", 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1326e-05 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253723+0000", 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046108359000000002 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253761+0000", 2024-04-23T23:38:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8124999999999998e-05 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253810+0000", 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9431000000000002e-05 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37876 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1277952~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508749097999999, 2024-04-23T23:38:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046358498999999997, 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37876 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207621+0000", 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207826+0000", 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00020521100000000001 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207829+0000", 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4259999999999999e-06 2024-04-23T23:38:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207839+0000", 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0229e-05 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207847+0000", 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253839+0000", 2024-04-23T23:38:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991727000000003 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253887+0000", 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8353999999999998e-05 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.253979+0000", 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.187e-05 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37877 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1298432~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.508512189000001, 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.046312513999999999, 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37877 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.207857+0000", 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208979+0000", 2024-04-23T23:38:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0011215649999999999 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208984+0000", 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.208994+0000", 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0223e-05 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209001+0000", 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0570000000000004e-06 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254010+0000", 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045008632999999999 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254075+0000", 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5227000000000004e-05 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254170+0000", 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5038999999999996e-05 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37878 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1318912~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507356675, 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045355536000000002, 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37878 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209013+0000", 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209016+0000", 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209023+0000", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8000000000000001e-06 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209028+0000", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.575e-06 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254215+0000", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045186357000000003 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254284+0000", 2024-04-23T23:38:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9089000000000002e-05 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254368+0000", 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4845000000000005e-05 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37879 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1339392~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507334021999998, 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045494123999999997, 2024-04-23T23:38:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37879 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209036+0000", 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209038+0000", 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8449999999999999e-06 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209045+0000", 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8009999999999998e-06 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209050+0000", 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1900000000000003e-06 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254409+0000", 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045358974000000003 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254462+0000", 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2913e-05 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254530+0000", 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7968999999999999e-05 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37880 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1359872~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507313075999999, 2024-04-23T23:38:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045602333000000002, 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37880 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209057+0000", 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209059+0000", 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.792e-06 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209068+0000", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5559999999999996e-06 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209074+0000", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5060000000000003e-06 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254562+0000", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045488622999999999 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254606+0000", 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3798999999999999e-05 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254659+0000", 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2626000000000001e-05 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37881 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1380352~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507289020000002, 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045722411999999997, 2024-04-23T23:38:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37881 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209081+0000", 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209091+0000", 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4700000000000008e-06 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209099+0000", 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3629999999999994e-06 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209104+0000", 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.541e-06 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254679+0000", 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045574605999999997 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254732+0000", 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3081000000000002e-05 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254803+0000", 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0926999999999994e-05 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37882 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1400832~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507240812999999, 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045814737000000001, 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37882 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209129+0000", 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-07 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209136+0000", 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1380000000000004e-06 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209145+0000", 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0119999999999994e-06 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209150+0000", 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5759999999999996e-06 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254835+0000", 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045685022999999998 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254884+0000", 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8758999999999999e-05 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254944+0000", 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9620000000000002e-05 2024-04-23T23:38:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37883 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1421312~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507210657999998, 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045991057000000002, 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37883 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209159+0000", 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2399999999999998e-07 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209168+0000", 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5469999999999997e-06 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209175+0000", 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1910000000000003e-06 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209180+0000", 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9699999999999998e-06 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.254987+0000", 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045806988 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255056+0000", 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8942000000000005e-05 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255150+0000", 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3894999999999995e-05 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37884 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 1441792~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.507178404000001, 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.04609659, 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37884 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.209191+0000", 2024-04-23T23:38:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210975+0000", 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017842330000000001 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210980+0000", 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1010000000000002e-06 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.210991+0000", 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1173e-05 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211005+0000", 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4579999999999999e-05 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255182+0000", 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.044176766999999999 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255231+0000", 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8928999999999999e-05 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.255288+0000", 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6807e-05 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37944 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 53248~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.505163215, 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045325582000000003, 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37944 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211206+0000", 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211207+0000", 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211209+0000", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211216+0000", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211227+0000", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1769e-05 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256438+0000", 2024-04-23T23:38:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045210798000000003 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256480+0000", 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1458000000000002e-05 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256532+0000", 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2441999999999997e-05 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37945 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 73728~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.505135510999999, 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045467075000000003, 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37945 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.211234+0000", 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212977+0000", 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017429780000000001 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212984+0000", 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0999999999999998e-06 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212993+0000", 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.212999+0000", 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.784e-06 2024-04-23T23:38:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256567+0000", 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043567620000000001 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256618+0000", 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1518999999999999e-05 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.256701+0000", 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2922000000000003e-05 2024-04-23T23:38:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37956 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 299008~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.503132659999999, 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045237267999999997, 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37956 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.213237+0000", 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214975+0000", 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001738131 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214980+0000", 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4580000000000003e-06 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214988+0000", 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4470000000000006e-06 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.214993+0000", 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258367+0000", 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043374366999999997 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258414+0000", 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6390000000000001e-05 2024-04-23T23:38:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.258474+0000", 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0609000000000002e-05 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:37967 3.18 3:1af9d5b7:::rbd_data.1194396e905d.0000000000000003:13 [read 524288~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52)", 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.501227382, 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.045227928000000001, 2024-04-23T23:38:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 37967 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.215142+0000", 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216974+0000", 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0018321850000000001 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216978+0000", 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.208e-06 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216985+0000", 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2529999999999998e-06 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.216990+0000", 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260276+0000", 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.043285591999999998 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260319+0000", 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2654000000000002e-05 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:14.260370+0000", 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1486999999999997e-05 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:41.790 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:41.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:41.792 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:41.804+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:41.892 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:41.905+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:41.906 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:41.906 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:41.906 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:41.906 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:41.915 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:41.993 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:42.005+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:42.059 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:42.059 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:42.059 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:42.068 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:42.094 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:42.107+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:42.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:38:42.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.198653737000001, 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:42.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:38:42.182 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33566 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12025856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941595706000001, 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047296019000000002, 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.183 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33566 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245971+0000", 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245973+0000", 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245979+0000", 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245984+0000", 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293076+0000", 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047091597999999998 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293164+0000", 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7928000000000002e-05 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293266+0000", 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102247 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941574981999999, 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.187 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.191 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941532649999999, 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:38:42.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:38:42.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.195 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941510050000002, 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:38:42.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.199 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941484963000001, 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:42.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:38:42.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:38:42.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941463626000001, 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941442579, 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:38:42.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:38:42.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:42.212 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.941238124000002, 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:42.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.216 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.940904724999999, 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.217 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.940878828999999, 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.221 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:42.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.940481897000002, 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.226 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:38:42.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.230 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.940445571000001, 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.231 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:38:42.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.940057212999999, 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:38:42.235 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:42.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:38:42.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:38:42.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:42.239 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.940031812000001, 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:38:42.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.243 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.937871418, 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:38:42.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:42.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.937850814000001, 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:42.252 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.937830466000001, 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:42.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.937810786, 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:38:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 31.935807329999999, 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.265 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:42.267 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:42.268 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:42.279+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:42.368 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:42.380+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:42.371 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:42.371 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:42.371 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:42.371 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:42.380 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:42.469 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:42.481+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:42.523 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:42.523 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:42.523 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:42.523 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:42.523 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:42.531 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:42.576 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:42.589+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:42.635 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.635 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.736296508000002, 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.639 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.736262306999997, 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:42.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:42.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.736228717000003, 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:42.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.736191181999999, 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:42.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:42.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.652 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.736167645999998, 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:42.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734778429999999, 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.657 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734750042999998, 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.661 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734727734000003, 2024-04-23T23:38:42.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:42.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:42.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.669 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734559511, 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:42.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734510784999998, 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734415589999998, 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734383639999997, 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.73436134, 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734331144000002, 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:42.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:42.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:42.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734171379000003, 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:42.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734135760000001, 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:42.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734036478999997, 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:42.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:42.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.734006913000002, 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:42.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:42.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:42.711 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 49.733984489000001, 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:42.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:42.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.1039668249999997, 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.716 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:38:42.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:42.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:38:42.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:42.721 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:42.723 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:42.723 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:42.735+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:42.823 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:42.836+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:42.868 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:42.868 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:42.868 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:42.877 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:42.924 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:42.936+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:43.020 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:43.020 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:43.020 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:43.020 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:43.020 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:43.025 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:43.037+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:43.028 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:43.126 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:43.138+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 85.415439355999993, 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.132 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:38:43.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:38:43.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:38:43.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681606958000003, 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.142 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681594167999997, 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.143 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681584016000002, 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.150 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681568259000002, 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681549662999998, 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.155 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:43.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681529931, 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:38:43.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:38:43.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681509998999999, 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:38:43.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681478071999997, 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.167 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:38:43.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681449772000001, 2024-04-23T23:38:43.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:38:43.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:38:43.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681423741000003, 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:38:43.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.681403103999997, 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:43.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:38:43.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:38:43.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.089586346999999, 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:38:43.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61791 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 7454720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.355664983, 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035239131, 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61791 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3399999999999999e-07 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787736+0000", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.509e-06 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787742+0000", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.438e-06 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787747+0000", 2024-04-23T23:38:43.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.822800+0000", 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035052153000000003 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.822883+0000", 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2928000000000003e-05 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.822972+0000", 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9258999999999994e-05 2024-04-23T23:38:43.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61792 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 7503872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.787755+0000", 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.355642623, 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035343959000000001, 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61792 2024-04-23T23:38:43.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787755+0000", 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787755+0000", 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788474+0000", 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00071897699999999998 2024-04-23T23:38:43.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788478+0000", 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6669999999999998e-06 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788485+0000", 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2110000000000001e-06 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788491+0000", 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1299999999999998e-06 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823001+0000", 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034509896999999998 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823044+0000", 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3359999999999998e-05 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823099+0000", 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4716999999999998e-05 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61797 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 8142848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.35481991, 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035388929, 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61797 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5100000000000001e-07 2024-04-23T23:38:43.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788586+0000", 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0190000000000006e-06 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788592+0000", 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2400000000000004e-06 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788598+0000", 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7969999999999997e-06 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823795+0000", 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035196471999999999 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823877+0000", 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1967999999999999e-05 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823967+0000", 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0081999999999996e-05 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61798 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 8192000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.354792746999999, 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035476981999999997, 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61798 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.202 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:43.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788607+0000", 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.182e-06 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788613+0000", 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5999999999999997e-06 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788619+0000", 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5570000000000003e-06 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823992+0000", 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035373660000000001 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824034+0000", 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1872000000000002e-05 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824082+0000", 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7704999999999998e-05 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61799 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 8372224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 10.35477113, 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035630739000000002, 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61799 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8599999999999998e-07 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788629+0000", 2024-04-23T23:38:43.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8899999999999999e-06 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788635+0000", 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7749999999999998e-06 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788640+0000", 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824105+0000", 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464674000000002 2024-04-23T23:38:43.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824186+0000", 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1390999999999994e-05 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824257+0000", 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1082999999999997e-05 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:43.209 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.5906133100000002, 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77895 3.13 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11141120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:43.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.563857+0000", 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.5795405369999997, 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035851547999999997, 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77895 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563857+0000", 2024-04-23T23:38:43.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563857+0000", 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563858+0000", 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5300000000000004e-07 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573277+0000", 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0094190109999999997 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573304+0000", 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6920999999999999e-05 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573320+0000", 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6188000000000002e-05 2024-04-23T23:38:43.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573420+0000", 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100368 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573609+0000", 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018845600000000001 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:43.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.574662+0000", 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010529879999999999 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586633+0000", 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011970972999999999 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599648+0000", 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013015380999999999 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599684+0000", 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6183999999999998e-05 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599709+0000", 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4425000000000001e-05 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.221 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:43.223 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:38:43.223 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:43.234 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone31 from 0xc6ddfb3 (overlap 0x8dc99ce) to 0x716e171 2024-04-23T23:38:43.235 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:43.247+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:43.327 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:43.339+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:43.353 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:43.353 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:43.353 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:43.353 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:43.363 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-04-23T23:38:43.364 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:43.449 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:43.462+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:43.529 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:43.541+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:43.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:43.538 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:43.539 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:43.539 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:43.539 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:43.539 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:43.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:43.591 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.591 INFO:teuthology.orchestra.run.smithi077.stdout:4191 write 0x37f3e16 thru 0x37fb0b8 (0x72a3 bytes) 2024-04-23T23:38:43.605 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.605 INFO:teuthology.orchestra.run.smithi077.stdout:4193 write 0x68b5907 thru 0x68c40cc (0xe7c6 bytes) 2024-04-23T23:38:43.612 INFO:teuthology.orchestra.run.smithi077.stdout:4195 write 0x318638c thru 0x3195ca3 (0xf918 bytes) 2024-04-23T23:38:43.621 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.621 INFO:teuthology.orchestra.run.smithi077.stdout:4198 read 0x5c06e56 thru 0x5c0964d (0x27f8 bytes) 2024-04-23T23:38:43.622 INFO:teuthology.orchestra.run.smithi077.stdout:4200 write 0x63b9a85 thru 0x63c2ce9 (0x9265 bytes) 2024-04-23T23:38:43.634 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:43.647+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:43.641 INFO:teuthology.orchestra.run.smithi077.stdout:4201 writesame 0xc88ddb3 thru 0xc89a6c1 data_size 0x85(0xc90f bytes) 2024-04-23T23:38:43.641 INFO:teuthology.orchestra.run.smithi077.stdout:4203 writesame 0x2d06e97 thru 0x2d1089a data_size 0x2(0x9a04 bytes) 2024-04-23T23:38:43.656 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.656 INFO:teuthology.orchestra.run.smithi077.stdout:4205 read 0x435da19 thru 0x436af82 (0xd56a bytes) 2024-04-23T23:38:43.657 INFO:teuthology.orchestra.run.smithi077.stdout:4206 read 0xbab4d8b thru 0xbab6417 (0x168d bytes) 2024-04-23T23:38:43.657 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.658 INFO:teuthology.orchestra.run.smithi077.stdout:4209 read 0xb5a6f5d thru 0xb5b15e2 (0xa686 bytes) 2024-04-23T23:38:43.658 INFO:teuthology.orchestra.run.smithi077.stdout:4212 punch from 0xafd8338 to 0xafdb33b, (0x3003 bytes) 2024-04-23T23:38:43.658 INFO:teuthology.orchestra.run.smithi077.stdout:4214 write 0x5ab6f82 thru 0x5ac6a97 (0xfb16 bytes) 2024-04-23T23:38:43.662 INFO:teuthology.orchestra.run.smithi077.stdout:4215 writesame 0x99e4ab3 thru 0x99e9126 data_size 0x12(0x4674 bytes) 2024-04-23T23:38:43.670 INFO:teuthology.orchestra.run.smithi077.stdout:4216 punch from 0x4f7bba8 to 0x4f801bc, (0x4614 bytes) 2024-04-23T23:38:43.670 INFO:teuthology.orchestra.run.smithi077.stdout:4217 writesame 0x23dd23f thru 0x23ebfec data_size 0x3(0xedae bytes) 2024-04-23T23:38:43.676 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:43.677 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:43.681 INFO:teuthology.orchestra.run.smithi077.stdout:4218 read 0xa51f58e thru 0xa52c840 (0xd2b3 bytes) 2024-04-23T23:38:43.682 INFO:teuthology.orchestra.run.smithi077.stdout:4219 trunc from 0xc89a6c2 to 0xd2fa3e5 2024-04-23T23:38:43.687 INFO:teuthology.orchestra.run.smithi077.stdout:4220 write 0xbd1bda1 thru 0xbd2b2d1 (0xf531 bytes) 2024-04-23T23:38:43.690 INFO:teuthology.orchestra.run.smithi077.stdout:4221 writesame 0x61074eb thru 0x610ab9f data_size 0x1(0x36b5 bytes) 2024-04-23T23:38:43.698 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:43.698 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:43.698 INFO:teuthology.orchestra.run.smithi077.stdout:4222 read 0x546bb5d thru 0x5477b6f (0xc013 bytes) 2024-04-23T23:38:43.699 INFO:teuthology.orchestra.run.smithi077.stdout:4224 write 0xb491367 thru 0xb4a10b4 (0xfd4e bytes) 2024-04-23T23:38:43.703 INFO:teuthology.orchestra.run.smithi077.stdout:4226 read 0x336ec37 thru 0x3370ef7 (0x22c1 bytes) 2024-04-23T23:38:43.703 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.705 INFO:teuthology.orchestra.run.smithi077.stdout:4229 trunc from 0xd2fa3e5 to 0xc130d2d 2024-04-23T23:38:43.714 INFO:teuthology.orchestra.run.smithi077.stdout:4230 read 0x649c9e6 thru 0x649f01d (0x2638 bytes) 2024-04-23T23:38:43.715 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.715 INFO:teuthology.orchestra.run.smithi077.stdout:4232 punch from 0x4829779 to 0x482e3e8, (0x4c6f bytes) 2024-04-23T23:38:43.715 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.716 INFO:teuthology.orchestra.run.smithi077.stdout:4234 trunc from 0xc130d2d to 0xdbc9d7d 2024-04-23T23:38:43.721 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:43.721 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:43.722 INFO:teuthology.orchestra.run.smithi077.stdout:4235 write 0x93f907e thru 0x940648b (0xd40e bytes) 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488207920999997, 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488185487999999, 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488164384000001, 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488144101000003, 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488122533000002, 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488104935000003, 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488084360999999, 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488055222, 2024-04-23T23:38:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488034546999998, 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.488011747000002, 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.486995325999999, 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.486975671000003, 2024-04-23T23:38:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.486936575999998, 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.486916784999998, 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.486898185999998, 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:43.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:43.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:43.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.486861857999997, 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:43.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:43.793 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.484679896000003, 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:43.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:43.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:43.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.797 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.484669801999999, 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.801 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.484654030000002, 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:43.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.484643886000001, 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:43.806 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:43.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:43.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:43.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:43.810 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:4237 write 0xe2f960d thru 0xe30854e (0xef42 bytes) 2024-04-23T23:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:4241 punch from 0xe1a042f to 0xe1a8741, (0x8312 bytes) 2024-04-23T23:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:4242 read 0x9558c62 thru 0x95651c8 (0xc567 bytes) 2024-04-23T23:38:43.812 INFO:teuthology.orchestra.run.smithi077.stdout:4243 trunc from 0xe30854f to 0xc23e315 2024-04-23T23:38:43.813 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:43.813 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:43.824+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:43.813 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:43.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:43.814 INFO:teuthology.orchestra.run.smithi077.stdout:4245 read 0x569efb4 thru 0x56a40bd (0x510a bytes) 2024-04-23T23:38:43.814 INFO:teuthology.orchestra.run.smithi077.stdout:4246 write 0x16ec2a1 thru 0x16f8093 (0xbdf3 bytes) 2024-04-23T23:38:43.815 INFO:teuthology.orchestra.run.smithi077.stdout:4247 writesame 0x18a33ff thru 0x18abdcd data_size 0x1(0x89cf bytes) 2024-04-23T23:38:43.815 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:43.815 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:43.815 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:43.816 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:43.816 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:43.816 INFO:teuthology.orchestra.run.smithi077.stdout:4249 trunc from 0xc23e315 to 0xc7e52a0 2024-04-23T23:38:43.816 INFO:teuthology.orchestra.run.smithi077.stdout:4250 write 0x2cdae47 thru 0x2cdcaf3 (0x1cad bytes) 2024-04-23T23:38:43.817 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:43.817 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:43.831 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:43.832 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:43.912 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:43.925+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:43.922 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:43.923 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:43.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:44.013 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:44.026+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:44.033 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.033 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:44.114 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:44.127+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:44.144 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.144 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:44.215 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:44.227+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:44.257 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.257 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:44.316 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:44.329+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:44.407 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.407 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:44.417 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:44.430+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:44.518 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.518 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.518 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:44.530+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:44.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:44.620 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:44.633+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:44.670 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.670 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:44.723 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:44.735+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:44.781 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.781 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:44.805 INFO:teuthology.orchestra.run.smithi077.stdout:4254 writesame 0x5dfbe16 thru 0x5e02cb2 data_size 0x1(0x6e9d bytes) 2024-04-23T23:38:44.834 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:44.835 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:44.847+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:44.847 INFO:teuthology.orchestra.run.smithi077.stdout:4257 trunc from 0xc7e52a0 to 0x1d801ae 2024-04-23T23:38:44.918 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:44.918 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:44.922 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:44.935+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:44.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:38:45.024 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:45.036+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:45.070 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.070 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:38:45.162 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:45.174+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:45.221 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.221 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:38:45.225 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:45.238+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:45.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:38:45.327 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:45.339+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:45.400 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.400 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.410 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:45.427 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:45.439+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:45.523 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.524 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.528 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:45.540+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:45.532 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:45.629 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:45.641+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:45.676 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.676 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.685 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:45.730 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:45.742+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:45.786 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.786 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.795 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:45.797 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:38:45.816 INFO:teuthology.orchestra.run.smithi077.stdout:4258 read 0x1275540 thru 0x127b420 (0x5ee1 bytes) 2024-04-23T23:38:45.818 INFO:teuthology.orchestra.run.smithi077.stdout:4259 trunc from 0x1d801ae to 0x3a08b0 2024-04-23T23:38:45.835 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:45.839 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:45.852+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:45.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:45.853 INFO:teuthology.orchestra.run.smithi077.stdout:4262 write 0x8a1ebe2 thru 0x8a2711e (0x853d bytes) 2024-04-23T23:38:45.857 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:45.867 INFO:teuthology.orchestra.run.smithi077.stdout:4266 writesame 0xb7a7833 thru 0xb7b5dfb data_size 0x41(0xe5c9 bytes) 2024-04-23T23:38:45.867 INFO:teuthology.orchestra.run.smithi077.stdout:4268 read 0x3d36513 thru 0x3d39cd3 (0x37c1 bytes) 2024-04-23T23:38:45.876 INFO:teuthology.orchestra.run.smithi077.stdout:4269 write 0xe0da5fb thru 0xe0e692e (0xc334 bytes) 2024-04-23T23:38:45.879 INFO:teuthology.orchestra.run.smithi077.stdout:4270 punch from 0x53cfb0f to 0x53d430a, (0x47fb bytes) 2024-04-23T23:38:45.879 INFO:teuthology.orchestra.run.smithi077.stdout:4272 clone 33 order 18 su 1024 sc 7 2024-04-23T23:38:45.903 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:45.903 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:45.911 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:45.932 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:38:45.944+0000 7efcc59af640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 32310) UID: 0 2024-04-23T23:38:45.966 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:45.966 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:45.983 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:45.983 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:45.999 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:46.000 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:46.016 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:38:46.016 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:38:46.033 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:46.045+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:46.033 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:46.034 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:46.050 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:46.051 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:46.055 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:46.055 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:46.064 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:46.067 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:46.068 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:46.084 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:46.085 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:46.137 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:46.149+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:46.151 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 7] out_osds: [3, 4, 0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:46.151 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:46.151 INFO:tasks.thrashosds.thrasher:Killing osd 3, live_osds are [0, 1, 2, 3, 4, 6, 7, 5] 2024-04-23T23:38:46.152 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T23:38:46.152 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:38:46.167 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:46.167 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.268623206000001, 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.168 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:46.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:46.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:46.171 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.268589005000003, 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.172 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.268555415000002, 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:46.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:46.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.268517879999997, 2024-04-23T23:38:46.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:46.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:46.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.268494343999997, 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.267105127999997, 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:46.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.267076740999997, 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:46.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.267054432000002, 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:46.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:46.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:46.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266886208999999, 2024-04-23T23:38:46.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:46.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266837483000003, 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:46.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266742288000003, 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.211 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266710338000003, 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:46.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:46.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266688037999998, 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.220 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:46.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266657842000001, 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:46.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266498077000001, 2024-04-23T23:38:46.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:46.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266462457999999, 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.235 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:46.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.239 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266363177000002, 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:46.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:46.243 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266333611, 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.244 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 53.266311186999999, 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:46.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.636293523, 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:38:46.252 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:38:46.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:46.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.258 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:46.260 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:46.271+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:46.260 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:46.360 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:46.373+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:46.364 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:46.364 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:46.364 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:46.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:46.461 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:46.474+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:46.514 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:46.514 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:46.523 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:46.564 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:46.577+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:46.662 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:46.674+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:46.667 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432632339000001, 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:46.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:46.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432609906000003, 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:46.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:46.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432588801999998, 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:46.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:46.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432568519, 2024-04-23T23:38:46.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:46.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.684 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432546950999999, 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:46.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432529353, 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432508779000003, 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.693 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432479639999997, 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.697 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:46.701 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432458965000002, 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:46.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.432436164999999, 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.431419744000003, 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.710 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:46.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:46.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.431400089, 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:46.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:46.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.431360994000002, 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.718 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:46.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.722 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.431341203000002, 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.726 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.431322604000002, 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.727 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:46.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:46.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.431286276000002, 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:46.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:46.735 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.429104314, 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:46.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.429094220000003, 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.740 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:46.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:46.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.429078447999999, 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:46.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:46.748 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.429068303999998, 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:46.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:46.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:46.753 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:46.753 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:46.754 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:46.798 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:46.810+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:46.863 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:46.876+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:46.867 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:46.867 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:46.867 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:46.867 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:46.877 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:46.880 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone32 2024-04-23T23:38:46.965 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:46.978+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:46.989 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:46.989 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:46.989 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:46.989 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:46.989 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:46.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:47.039 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-04-23T23:38:47.066 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:47.079+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:47.113 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015174126999995, 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:47.117 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015160481999999, 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.118 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:47.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015147432000006, 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.122 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:47.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:47.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:47.126 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015136412999993, 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.130 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015127337999999, 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:47.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015115394000006, 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:47.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.015106282999994, 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.139 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:47.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.013460910999996, 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.143 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.013448662000002, 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.147 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:47.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:47.151 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009270068999996, 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.155 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009258286999994, 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:47.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009248217999996, 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:47.159 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:47.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009236559000001, 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:47.163 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009227238999998, 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:47.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009216726999995, 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:47.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009207286999995, 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.175 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.009012193999993, 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:47.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.182 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.008991160999997, 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:47.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 66.008977271000006, 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.186 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:47.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 54.405820765999998, 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.194 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:47.196 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:47.208+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:47.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:47.197 INFO:teuthology.orchestra.run.smithi077.stdout:4273 punch from 0xc89170c to 0xc89e6a2, (0xcf96 bytes) 2024-04-23T23:38:47.197 INFO:teuthology.orchestra.run.smithi077.stdout:4274 read 0x95bf3d9 thru 0x95cf18b (0xfdb3 bytes) 2024-04-23T23:38:47.197 INFO:teuthology.orchestra.run.smithi077.stdout:4275 read 0xe154a4 thru 0xe1b79c (0x62f9 bytes) 2024-04-23T23:38:47.197 INFO:teuthology.orchestra.run.smithi077.stdout:4276 write 0x418e22b thru 0x418ee35 (0xc0b bytes) 2024-04-23T23:38:47.198 INFO:teuthology.orchestra.run.smithi077.stdout:4278 write 0xe4c9850 thru 0xe4d0621 (0x6dd2 bytes) 2024-04-23T23:38:47.199 INFO:teuthology.orchestra.run.smithi077.stdout:4280 writesame 0x6bd35fc thru 0x6bde24e data_size 0x55(0xac53 bytes) 2024-04-23T23:38:47.217 INFO:teuthology.orchestra.run.smithi077.stdout:4281 trunc from 0xe4d0622 to 0x6853fcf 2024-04-23T23:38:47.237 INFO:teuthology.orchestra.run.smithi077.stdout:4282 read 0x3f4eee0 thru 0x3f5e91c (0xfa3d bytes) 2024-04-23T23:38:47.246 INFO:teuthology.orchestra.run.smithi077.stdout:4283 write 0x9975ebd thru 0x9977f10 (0x2054 bytes) 2024-04-23T23:38:47.258 INFO:teuthology.orchestra.run.smithi077.stdout:4284 write 0x4812589 thru 0x4818232 (0x5caa bytes) 2024-04-23T23:38:47.272 INFO:teuthology.orchestra.run.smithi077.stdout:4285 writesame 0x2057e4b thru 0x20678c1 data_size 0x57(0xfa77 bytes) 2024-04-23T23:38:47.287 INFO:teuthology.orchestra.run.smithi077.stdout:4286 trunc from 0x9977f11 to 0x4833794 2024-04-23T23:38:47.296 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:47.309+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:47.307 INFO:teuthology.orchestra.run.smithi077.stdout:4287 writesame 0x5eb8fcb thru 0x5ec85ac data_size 0x4e(0xf5e2 bytes) 2024-04-23T23:38:47.307 INFO:teuthology.orchestra.run.smithi077.stdout:4289 read 0x35b6353 thru 0x35c56d1 (0xf37f bytes) 2024-04-23T23:38:47.316 INFO:teuthology.orchestra.run.smithi077.stdout:4291 write 0x85c95d6 thru 0x85d9093 (0xfabe bytes) 2024-04-23T23:38:47.321 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:47.321 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:80747 3.19 3:9ce1ab88:::rbd_data.1194f3ed7b42.0000000000000215:head [set-alloc-hint object_size 262144 write_size 262144,write 117760~9216 in=9216b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.332854+0000", 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0015506669999999999, 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015768469999999999, 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 80747 2024-04-23T23:38:47.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332854+0000", 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332854+0000", 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332854+0000", 2024-04-23T23:38:47.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332882+0000", 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7543999999999999e-05 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332892+0000", 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0404000000000001e-05 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332898+0000", 2024-04-23T23:38:47.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5369999999999997e-06 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.332951+0000", 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3108e-05 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333086+0000", 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013473099999999999 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333170+0000", 2024-04-23T23:38:47.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4568999999999996e-05 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333853+0000", 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00068307899999999996 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334342+0000", 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00048898400000000003 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334395+0000", 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2219000000000003e-05 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334434+0000", 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9366000000000002e-05 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:80748 3.3 3:c4e88c76:::rbd_data.1194f3ed7b42.0000000000000216:head [set-alloc-hint object_size 262144 write_size 262144,write 117760~9216 in=9216b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.333028+0000", 2024-04-23T23:38:47.327 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0013763169999999999, 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014959909999999999, 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 80748 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333028+0000", 2024-04-23T23:38:47.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333028+0000", 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333029+0000", 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7700000000000004e-07 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333048+0000", 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9678999999999999e-05 2024-04-23T23:38:47.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333057+0000", 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7539999999999995e-06 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333062+0000", 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333114+0000", 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2148000000000003e-05 2024-04-23T23:38:47.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333244+0000", 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000129744 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.333389+0000", 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000144945 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop_reply(client.4500.0:80748 3.3 e84/81 ondisk, result = 0)", 2024-04-23T23:38:47.331 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.334475+0000", 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4294967295.9999299, 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011293700000000001, 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334475+0000", 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334475+0000", 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334475+0000", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334479+0000", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3420000000000001e-06 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334489+0000", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8169999999999994e-06 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334496+0000", 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334560+0000", 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4456999999999996e-05 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.334569+0000", 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1670000000000005e-06 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:38:47.335 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 3 2024-04-23T23:38:47.335 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:47.335 INFO:teuthology.orchestra.run.smithi077.stdout:4292 trunc from 0x85d9094 to 0xf14910 2024-04-23T23:38:47.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:47.397 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:47.410+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:47.497 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-23T23:38:47.498 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:47.511+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:47.517 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:47.517 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:47.517 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:47.517 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:47.517 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:47.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:47.599 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:47.611+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:47.605 INFO:teuthology.orchestra.run.smithi077.stdout:4294 writesame 0x840cc8e thru 0x840dca9 data_size 0x2(0x101c bytes) 2024-04-23T23:38:47.605 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:47.605 INFO:teuthology.orchestra.run.smithi077.stdout:4297 write 0x6bc3474 thru 0x6bcc60e (0x919b bytes) 2024-04-23T23:38:47.615 INFO:teuthology.orchestra.run.smithi077.stdout:4299 trunc from 0x840dcaa to 0xa7256f4 2024-04-23T23:38:47.624 INFO:teuthology.orchestra.run.smithi077.stdout:4301 trunc from 0xa7256f4 to 0x7a0bb0c 2024-04-23T23:38:47.630 INFO:teuthology.orchestra.run.smithi077.stdout:4302 read 0x599882e thru 0x59992f6 (0xac9 bytes) 2024-04-23T23:38:47.630 INFO:teuthology.orchestra.run.smithi077.stdout:4303 read 0x144b54e thru 0x1451820 (0x62d3 bytes) 2024-04-23T23:38:47.640 INFO:teuthology.orchestra.run.smithi077.stdout:4304 write 0xb72d273 thru 0xb72eaa4 (0x1832 bytes) 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.260584012999999, 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:47.643 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:47.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:47.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:47.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:47.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 50.261933384999999, 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.649 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:47.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:47.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 28.822279972, 2024-04-23T23:38:47.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:38:47.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77891 3.e e75/62 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head v 75'571, mlcod=75'569)", 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.565761+0000", 2024-04-23T23:38:47.660 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.0886664190000008, 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033868958999999997, 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.565761+0000", 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.565761+0000", 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.565762+0000", 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3909999999999999e-06 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.571961+0000", 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0061990709999999996 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.571995+0000", 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3246e-05 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.572011+0000", 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.664e-05 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.572118+0000", 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000106959 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.572151+0000", 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2478999999999999e-05 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599571+0000", 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027420568999999999 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599630+0000", 2024-04-23T23:38:47.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8604000000000003e-05 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81073 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6557696~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.665 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.359740+0000", 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29468751199999998, 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033671526, 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81073 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359740+0000", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359740+0000", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359740+0000", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359741+0000", 2024-04-23T23:38:47.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.063e-06 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359744+0000", 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.129e-06 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359747+0000", 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4940000000000002e-06 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393257+0000", 2024-04-23T23:38:47.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033510151000000002 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393334+0000", 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7169000000000006e-05 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393411+0000", 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7285000000000003e-05 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81074 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6564864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.359750+0000", 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29467757300000003, 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033784680999999997, 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81074 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.670 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359750+0000", 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359750+0000", 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359881+0000", 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000131013 2024-04-23T23:38:47.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359883+0000", 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.232e-06 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359889+0000", 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359895+0000", 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6670000000000001e-06 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393449+0000", 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033554110999999998 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393494+0000", 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5349999999999998e-05 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393534+0000", 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0287000000000002e-05 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81075 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6572032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.359903+0000", 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29452413399999999, 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033818934000000002, 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81075 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.674 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359903+0000", 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.359903+0000", 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360397+0000", 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00049401700000000002 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360406+0000", 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5329999999999994e-06 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360411+0000", 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3940000000000004e-06 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360415+0000", 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.963e-06 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393569+0000", 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033154309 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393645+0000", 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5420000000000006e-05 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393722+0000", 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7298000000000004e-05 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.677 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81078 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6593536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.360444+0000", 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29398343700000001, 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033642261, 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81078 2024-04-23T23:38:47.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360444+0000", 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360444+0000", 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360544+0000", 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9678000000000003e-05 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360547+0000", 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1530000000000001e-06 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360555+0000", 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0090000000000007e-06 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360561+0000", 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8449999999999999e-06 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.393994+0000", 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033433171999999997 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394044+0000", 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0272999999999998e-05 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394086+0000", 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2131e-05 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81079 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6600704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.360569+0000", 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29385873200000001, 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033721177999999997, 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81079 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360569+0000", 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360569+0000", 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360716+0000", 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014760899999999999 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360719+0000", 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7989999999999998e-06 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360724+0000", 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6700000000000002e-06 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360728+0000", 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394122+0000", 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033394144000000001 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394212+0000", 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0098000000000004e-05 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394290+0000", 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7972999999999994e-05 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81080 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6607872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.360735+0000", 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29369202, 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033690063999999999, 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.686 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81080 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360735+0000", 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360735+0000", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360885+0000", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015001200000000001 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360888+0000", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360896+0000", 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.225e-06 2024-04-23T23:38:47.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360902+0000", 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394327+0000", 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033425114999999998 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394370+0000", 2024-04-23T23:38:47.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3086e-05 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394425+0000", 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5328999999999998e-05 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81081 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6615040~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.360910+0000", 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29351754299999999, 2024-04-23T23:38:47.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033705827000000001, 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81081 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360910+0000", 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.360910+0000", 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361061+0000", 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00015163399999999999 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361064+0000", 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6979999999999998e-06 2024-04-23T23:38:47.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361068+0000", 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4129999999999999e-06 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361072+0000", 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9380000000000002e-06 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394462+0000", 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033389351999999997 2024-04-23T23:38:47.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394540+0000", 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8654999999999998e-05 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394616+0000", 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5136999999999996e-05 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81082 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6622208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.361080+0000", 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29334765699999998, 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033664619, 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81082 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.695 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361080+0000", 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361080+0000", 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361244+0000", 2024-04-23T23:38:47.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000164055 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361247+0000", 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4010000000000001e-06 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361255+0000", 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4100000000000008e-06 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361261+0000", 2024-04-23T23:38:47.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5559999999999998e-06 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394652+0000", 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033390809 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394702+0000", 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0627000000000002e-05 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394744+0000", 2024-04-23T23:38:47.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1761000000000002e-05 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81083 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6629376~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.361269+0000", 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29315792899999998, 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033656416000000001, 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81083 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361269+0000", 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361269+0000", 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361414+0000", 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000144263 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361416+0000", 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.762e-06 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361421+0000", 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6009999999999997e-06 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361425+0000", 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9149999999999998e-06 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394780+0000", 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033355031 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394854+0000", 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3771999999999998e-05 2024-04-23T23:38:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394926+0000", 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2071999999999997e-05 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81084 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6636544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.361432+0000", 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.29299536100000001, 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033626834000000001, 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.703 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81084 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361432+0000", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361432+0000", 2024-04-23T23:38:47.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361592+0000", 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016025600000000001 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361594+0000", 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.916e-06 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361599+0000", 2024-04-23T23:38:47.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-06 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361604+0000", 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1610000000000002e-06 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.394962+0000", 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033358166000000002 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.395018+0000", 2024-04-23T23:38:47.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5797000000000001e-05 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.395059+0000", 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1028000000000001e-05 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81085 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6643712~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.361612+0000", 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.292815516, 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033586037999999999, 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.707 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81085 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361612+0000", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361612+0000", 2024-04-23T23:38:47.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361737+0000", 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012547400000000001 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361741+0000", 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4240000000000002e-06 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361746+0000", 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6879999999999996e-06 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.361750+0000", 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8369999999999999e-06 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.395089+0000", 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.03333887 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.395144+0000", 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4525999999999999e-05 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.395198+0000", 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4218999999999997e-05 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81110 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6822912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.365663+0000", 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.28876410200000002, 2024-04-23T23:38:47.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033586962999999997, 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81110 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365663+0000", 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365663+0000", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365766+0000", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000102951 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365769+0000", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2780000000000002e-06 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365777+0000", 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8630000000000008e-06 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365783+0000", 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7490000000000004e-06 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.399097+0000", 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033313957999999998 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.399171+0000", 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4328999999999999e-05 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.399250+0000", 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8835e-05 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81111 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6830080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.365793+0000", 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.28863436199999998, 2024-04-23T23:38:47.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033589051000000002, 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81111 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365793+0000", 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365793+0000", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365893+0000", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100523 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365902+0000", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1999999999999994e-06 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365907+0000", 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.365910+0000", 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7809999999999999e-06 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.399285+0000", 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033374666999999997 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.399325+0000", 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0465e-05 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.399382+0000", 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6495e-05 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:81119 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 6887424~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.366959+0000", 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.28746850899999998, 2024-04-23T23:38:47.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033579699999999997, 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 81119 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.366959+0000", 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.366959+0000", 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.367093+0000", 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000133802 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.367095+0000", 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8059999999999999e-06 2024-04-23T23:38:47.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.367100+0000", 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9259999999999999e-06 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.367104+0000", 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8739999999999997e-06 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.400388+0000", 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033284250000000001 2024-04-23T23:38:47.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.400463+0000", 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4667999999999997e-05 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.400538+0000", 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5374e-05 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.723 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:82561 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 8039424~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.561413+0000", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.093013818999999998, 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033599058000000001, 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 82561 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.561413+0000", 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.561413+0000", 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.562975+0000", 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0015613599999999999 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.562979+0000", 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1810000000000003e-06 2024-04-23T23:38:47.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.562989+0000", 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0039e-05 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.562998+0000", 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5339999999999999e-06 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.594927+0000", 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031929013999999999 2024-04-23T23:38:47.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.594965+0000", 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8853999999999998e-05 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.595013+0000", 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7076000000000001e-05 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:82581 3.18 3:1c852909:::rbd_data.1194f3ed7b42.000000000000003c:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144,truncate 161792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e84)", 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:47.563588+0000", 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.090838904999999998, 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.033802551, 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 82581 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:47.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.563588+0000", 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.563588+0000", 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.563589+0000", 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6300000000000005e-07 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.563593+0000", 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3329999999999998e-06 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.563602+0000", 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5059999999999995e-06 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.563608+0000", 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3820000000000001e-06 2024-04-23T23:38:47.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.596252+0000", 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.032643815999999999 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.596344+0000", 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1598e-05 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.596480+0000", 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013636 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.597033+0000", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00055296200000000005 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.597337+0000", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00030421400000000003 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.597369+0000", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1448000000000001e-05 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:47.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:47.597391+0000", 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2269e-05 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:47.733 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:47.734 INFO:teuthology.orchestra.run.smithi077.stdout:4305 write 0x8357b thru 0x909c2 (0xd448 bytes) 2024-04-23T23:38:47.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:47.735 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:47.747+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:47.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:38:47.863 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:47.875+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:47.921 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:47.922 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:47.922 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:47.922 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:47.932 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:47.974 INFO:teuthology.orchestra.run.smithi077.stdout:4307 trunc from 0xb72eaa5 to 0x40227cd 2024-04-23T23:38:47.974 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:47.986+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:47.986 INFO:teuthology.orchestra.run.smithi077.stdout:4308 read 0x93bde3 thru 0x94296c (0x6b8a bytes) 2024-04-23T23:38:47.986 INFO:teuthology.orchestra.run.smithi077.stdout:4309 read 0x32ba2e9 thru 0x32c17d9 (0x74f1 bytes) 2024-04-23T23:38:48.001 INFO:teuthology.orchestra.run.smithi077.stdout:4310 write 0xbaaff6e thru 0xbab3e9f (0x3f32 bytes) 2024-04-23T23:38:48.008 INFO:teuthology.orchestra.run.smithi077.stdout:4311 writesame 0x4aa0be4 thru 0x4aa262c data_size 0x1(0x1a49 bytes) 2024-04-23T23:38:48.016 INFO:teuthology.orchestra.run.smithi077.stdout:4314 read 0x929dcbe thru 0x92ac62f (0xe972 bytes) 2024-04-23T23:38:48.022 INFO:teuthology.orchestra.run.smithi077.stdout:4315 write 0xc1f8879 thru 0xc202dc2 (0xa54a bytes) 2024-04-23T23:38:48.031 INFO:teuthology.orchestra.run.smithi077.stdout:4316 trunc from 0xc202dc3 to 0xb3d8139 2024-04-23T23:38:48.036 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:48.049+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:48.052 INFO:teuthology.orchestra.run.smithi077.stdout:4319 write 0xe542240 thru 0xe549267 (0x7028 bytes) 2024-04-23T23:38:48.064 INFO:teuthology.orchestra.run.smithi077.stdout:4320 punch from 0x811a60d to 0x8121999, (0x738c bytes) 2024-04-23T23:38:48.064 INFO:teuthology.orchestra.run.smithi077.stdout:4321 read 0xb2e9131 thru 0xb2f4125 (0xaff5 bytes) 2024-04-23T23:38:48.064 INFO:teuthology.orchestra.run.smithi077.stdout:4322 writesame 0x8215fbf thru 0x821ce66 data_size 0x2(0x6ea8 bytes) 2024-04-23T23:38:48.074 INFO:teuthology.orchestra.run.smithi077.stdout:4323 punch from 0x4c75c1f to 0x4c83026, (0xd407 bytes) 2024-04-23T23:38:48.075 INFO:teuthology.orchestra.run.smithi077.stdout:4326 write 0x1d030f6 thru 0x1d05fc3 (0x2ece bytes) 2024-04-23T23:38:48.086 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:48.086 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:48.086 INFO:teuthology.orchestra.run.smithi077.stdout:4329 writesame 0x67c0e58 thru 0x67c30c1 data_size 0x5(0x226a bytes) 2024-04-23T23:38:48.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:48.099 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:48.099 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:48.099 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:48.099 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:48.099 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:48.109 INFO:teuthology.orchestra.run.smithi077.stdout:4331 trunc from 0xe549268 to 0x6e5a850 2024-04-23T23:38:48.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:48.131 INFO:teuthology.orchestra.run.smithi077.stdout:4332 write 0x83f7260 thru 0x83fd421 (0x61c2 bytes) 2024-04-23T23:38:48.153 INFO:teuthology.orchestra.run.smithi077.stdout:4333 write 0xdde339c thru 0xdde7a73 (0x46d8 bytes) 2024-04-23T23:38:48.153 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:48.165+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:48.161 INFO:teuthology.orchestra.run.smithi077.stdout:4334 read 0x316f24e thru 0x317a4d4 (0xb287 bytes) 2024-04-23T23:38:48.161 INFO:teuthology.orchestra.run.smithi077.stdout:4336 read 0x770447f thru 0x7709d91 (0x5913 bytes) 2024-04-23T23:38:48.161 INFO:teuthology.orchestra.run.smithi077.stdout:4337 write 0x2fc2538 thru 0x2fc9bd4 (0x769d bytes) 2024-04-23T23:38:48.173 INFO:teuthology.orchestra.run.smithi077.stdout:4339 write 0x7190948 thru 0x719f9e7 (0xf0a0 bytes) 2024-04-23T23:38:48.183 INFO:teuthology.orchestra.run.smithi077.stdout:4340 write 0xdd00024 thru 0xdd02baf (0x2b8c bytes) 2024-04-23T23:38:48.185 INFO:teuthology.orchestra.run.smithi077.stdout:4342 read 0xa9407c7 thru 0xa94cad1 (0xc30b bytes) 2024-04-23T23:38:48.185 INFO:teuthology.orchestra.run.smithi077.stdout:4343 write 0xd6b540a thru 0xd6c3333 (0xdf2a bytes) 2024-04-23T23:38:48.194 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:48.200 INFO:teuthology.orchestra.run.smithi077.stdout:4345 write 0xe568fc6 thru 0xe574411 (0xb44c bytes) 2024-04-23T23:38:48.213 INFO:teuthology.orchestra.run.smithi077.stdout:4346 write 0x81e6a9f thru 0x81ec353 (0x58b5 bytes) 2024-04-23T23:38:48.222 INFO:teuthology.orchestra.run.smithi077.stdout:4348 clone 34 order 23 su 4194304 sc 7 2024-04-23T23:38:48.238 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:48.238 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:48.238 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:48.250+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:48.253 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.855415874999998, 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.258 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 50.855720021000003, 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:48.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:48.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:48.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.176462923999999, 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:48.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995285978999998, 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.267 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.99527565, 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:38:48.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995264731999999, 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:38:48.275 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:48.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:38:48.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:38:48.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995236546000001, 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:38:48.279 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:48.283 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995220840999998, 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.287 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.288 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995209857999999, 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:38:48.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995195487, 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.293 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:38:48.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995158148000002, 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:38:48.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995135828999999, 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.301 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:38:48.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:38:48.304 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995108614999999, 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:38:48.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:48.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:38:48.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:38:48.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995088561999999, 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.309 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995069184999998, 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.313 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:48.317 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.995049761000001, 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:48.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:38:48.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.083700611999999, 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:38:48.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.8758583840000007, 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.330 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.7078593650000009, 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:38:48.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.6892911339999994, 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:38:48.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:38:48.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:38:48.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:48.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:48.339 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:48.340 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:48.340 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:48.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:48.342 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:48.342 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:38:48.343 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:48.343 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:48.343 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:48.343 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:48.344 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:48.344 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:48.344 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:48.352+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:48.345 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:48.345 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:38:48.345 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:48.346 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:38:48.441 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:48.453+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:48.448 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:48.448 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:48.457 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:48.542 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:48.555+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:48.559 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:48.559 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:48.568 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:48.652 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:48.665+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:48.711 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:48.711 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:48.719 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:48.744 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:48.756+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:48.816 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:38:48.849 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:48.858+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:48.868 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:48.869 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:48.874 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone33 intact 2024-04-23T23:38:48.878 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:48.963 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:48.976+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:49.022 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.022 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.024 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-04-23T23:38:49.032 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:49.072 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:49.085+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:49.147 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:49.160+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:49.173 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.173 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.182 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:49.265 INFO:teuthology.orchestra.run.smithi077.stdout:4349 read 0xd8f90d2 thru 0xd8fffd3 (0x6f02 bytes) 2024-04-23T23:38:49.266 INFO:teuthology.orchestra.run.smithi077.stdout:4350 read 0x5193239 thru 0x519b532 (0x82fa bytes) 2024-04-23T23:38:49.266 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:49.279+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:49.267 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:49.267 INFO:teuthology.orchestra.run.smithi077.stdout:4353 read 0x6164388 thru 0x616a859 (0x64d2 bytes) 2024-04-23T23:38:49.267 INFO:teuthology.orchestra.run.smithi077.stdout:4354 punch from 0xe3a54c7 to 0xe3b3b9a, (0xe6d3 bytes) 2024-04-23T23:38:49.270 INFO:teuthology.orchestra.run.smithi077.stdout:4355 read 0x476b01f thru 0x47767ac (0xb78e bytes) 2024-04-23T23:38:49.271 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:49.271 INFO:teuthology.orchestra.run.smithi077.stdout:4357 read 0xc6973a5 thru 0xc69a66e (0x32ca bytes) 2024-04-23T23:38:49.271 INFO:teuthology.orchestra.run.smithi077.stdout:4358 write 0xc1e666f thru 0xc1f60e8 (0xfa7a bytes) 2024-04-23T23:38:49.276 INFO:teuthology.orchestra.run.smithi077.stdout:4359 read 0x5c6a71d thru 0x5c6b95b (0x123f bytes) 2024-04-23T23:38:49.276 INFO:teuthology.orchestra.run.smithi077.stdout:4360 read 0xa3102c thru 0xa3426e (0x3243 bytes) 2024-04-23T23:38:49.276 INFO:teuthology.orchestra.run.smithi077.stdout:4361 writesame 0x648d179 thru 0x64915d3 data_size 0x13(0x445b bytes) 2024-04-23T23:38:49.282 INFO:teuthology.orchestra.run.smithi077.stdout:4362 clone 35 order 18 su 16384 sc 12 2024-04-23T23:38:49.327 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.327 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.335 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:49.376 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:49.389+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:49.449 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:49.461+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:49.478 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.478 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.486 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:49.550 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:49.562+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:49.589 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.589 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.598 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:49.681 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:49.694+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:49.739 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.739 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.748 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:49.751 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:49.764+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:49.852 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:49.865+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:49.890 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone34 from 0xe574412 (overlap 0xe574412) to 0x0 2024-04-23T23:38:49.901 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:49.901 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:49.910 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:49.953 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:49.966+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:50.012 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:50.012 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:50.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:50.055 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:50.067+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:50.155 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:50.167+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:50.159 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:50.159 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:50.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:50.257 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:50.270+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:50.337 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:50.338 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:50.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:50.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:50.390 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:50.402+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:50.458 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:50.471+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:50.509 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:50.509 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:50.534 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:50.534 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:50.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:50.534 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:50.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436355065000001, 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.535 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:38:50.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.539 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436341420000005, 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:38:50.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:38:50.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436328369999998, 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.544 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436317351, 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:50.552 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436308276000005, 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.556 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436296331999998, 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:38:50.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:38:50.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.436287221000001, 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.561 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:50.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.434641849000002, 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.566 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:38:50.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:38:50.569 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.434629599999994, 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.570 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:38:50.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:38:50.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430451007000002, 2024-04-23T23:38:50.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430439225000001, 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:38:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:38:50.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:38:50.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430429156000002, 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:38:50.582 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.586 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430417496999993, 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:50.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:38:50.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.590 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430408177000004, 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.594 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430397665000001, 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:50.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:38:50.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:50.598 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430388225000002, 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:38:50.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:38:50.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430193131999999, 2024-04-23T23:38:50.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:38:50.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430172099000004, 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:38:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:38:50.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.430158208999998, 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.611 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:38:50.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:38:50.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 57.827001703999997, 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:50.615 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:38:50.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:50.620 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:50.621 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:50.621 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:50.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:50.623 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:50.623 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:50.623 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:38:50.623 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:50.624 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:50.624 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:50.624 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:50.625 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:50.634+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:50.647 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:50.647 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:50.672 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:50.672 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:50.676 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:38:50.676 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:38:50.723 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:50.735+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:50.763 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:50.763 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:50.763 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:50.763 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:50.772 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:50.824 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:50.836+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:50.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:38:50.863 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-04-23T23:38:50.924 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:50.924 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:50.924 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:50.924 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:50.924 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:50.925 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:50.937+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:50.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:51.026 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:51.038+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:51.123 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.740462438999998, 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:38:51.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:38:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:51.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.129 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 53.741811810999998, 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.130 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:51.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:51.135 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.302158398000003, 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:51.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:38:51.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:38:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:38:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90590 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3441664~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.13262484299999999, 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051386827000000003, 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90590 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001684+0000", 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001690+0000", 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1480000000000003e-06 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001694+0000", 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:38:51.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052909+0000", 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051214519 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052978+0000", 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8738000000000005e-05 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.053068+0000", 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0068000000000006e-05 2024-04-23T23:38:51.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90592 3.0 3:06d5799c:::rbd_data.1194f3ed7b42.0000000000000194:head [sparse-read 0~262144] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001738+0000", 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.13256749400000001, 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051259080999999998, 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.149 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90592 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001738+0000", 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001738+0000", 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001739+0000", 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001741+0000", 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2170000000000001e-06 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001748+0000", 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9789999999999996e-06 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001753+0000", 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9350000000000002e-06 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052904+0000", 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051151230999999998 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052997+0000", 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3257000000000005e-05 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.152 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90651 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3556352~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.128742201, 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051409877, 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90651 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.153 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:38:51.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005566+0000", 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9489999999999999e-06 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005572+0000", 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1179999999999997e-06 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005577+0000", 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7060000000000003e-06 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056808+0000", 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051230879999999999 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056879+0000", 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1261999999999996e-05 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056973+0000", 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4569999999999997e-05 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.156 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90653 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3563520~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12872307999999999, 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051620653000000002, 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90653 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.157 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005585+0000", 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.883e-06 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005591+0000", 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005596+0000", 2024-04-23T23:38:51.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057017+0000", 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051421175999999999 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057094+0000", 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7040999999999996e-05 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057203+0000", 2024-04-23T23:38:51.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010935 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90655 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3570688~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12870443000000001, 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051736068000000003, 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.161 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90655 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005602+0000", 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005603+0000", 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005609+0000", 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:38:51.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005614+0000", 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6190000000000002e-06 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057238+0000", 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051623872000000001 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057281+0000", 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3259e-05 2024-04-23T23:38:51.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057337+0000", 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6298999999999997e-05 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90662 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3613696~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12712024399999999, 2024-04-23T23:38:51.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051308223, 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90662 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007186+0000", 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007188+0000", 2024-04-23T23:38:51.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.945e-06 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007195+0000", 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007200+0000", 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058336+0000", 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051136231999999997 2024-04-23T23:38:51.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058404+0000", 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8613000000000002e-05 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058494+0000", 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9314999999999994e-05 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90663 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3620864~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.169 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12709906900000001, 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051524557999999998, 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90663 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007209+0000", 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.813e-06 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007215+0000", 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3899999999999998e-06 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007220+0000", 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8189999999999999e-06 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058536+0000", 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051315847999999997 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058621+0000", 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5453999999999999e-05 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058731+0000", 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010982800000000001 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90664 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3628032~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12707985199999999, 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051704831, 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90664 2024-04-23T23:38:51.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007228+0000", 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.829e-06 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007233+0000", 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007238+0000", 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5159999999999996e-06 2024-04-23T23:38:51.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058770+0000", 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051532124999999998 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058839+0000", 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9356999999999993e-05 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058931+0000", 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1230000000000006e-05 2024-04-23T23:38:51.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90665 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3635200~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.127061959, 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051935859000000001, 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90665 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008976+0000", 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017323939999999999 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008980+0000", 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0910000000000003e-06 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008987+0000", 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.131e-06 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008992+0000", 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6670000000000004e-06 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058981+0000", 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049988772000000001 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059068+0000", 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7640999999999997e-05 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059180+0000", 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011116300000000001 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90673 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4476928~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009163+0000", 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12514225800000001, 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051258210999999998, 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.182 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90673 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009163+0000", 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009163+0000", 2024-04-23T23:38:51.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009164+0000", 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009166+0000", 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.08e-06 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009172+0000", 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8409999999999996e-06 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009178+0000", 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.84e-06 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060280+0000", 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051102183000000002 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060349+0000", 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8873000000000003e-05 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060422+0000", 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3034000000000006e-05 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90674 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4484096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.186 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12512225799999999, 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051442084999999999, 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90674 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:38:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009184+0000", 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009186+0000", 2024-04-23T23:38:51.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009192+0000", 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009198+0000", 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060463+0000", 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051264788999999998 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060543+0000", 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0344000000000002e-05 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060626+0000", 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2576000000000004e-05 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90675 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4491264~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12510149500000001, 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051599027999999998, 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90675 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009205+0000", 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009207+0000", 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009212+0000", 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7479999999999999e-06 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009218+0000", 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1919999999999996e-06 2024-04-23T23:38:51.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060663+0000", 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051445554999999997 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060732+0000", 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9041000000000005e-05 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060803+0000", 2024-04-23T23:38:51.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1135000000000002e-05 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90676 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4498432~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.125082517, 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051792194999999999, 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90676 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009224+0000", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009225+0000", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009232+0000", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5089999999999999e-06 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009238+0000", 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060845+0000", 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051607346999999998 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060927+0000", 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1644999999999995e-05 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061015+0000", 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8642999999999998e-05 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90677 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4505600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12506193099999999, 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051967037000000001, 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90677 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010979+0000", 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017348070000000001 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010985+0000", 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010995+0000", 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0370000000000001e-05 2024-04-23T23:38:51.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011002+0000", 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2960000000000001e-06 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061051+0000", 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.050048603999999997 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061134+0000", 2024-04-23T23:38:51.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3219000000000004e-05 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061211+0000", 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6724999999999995e-05 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90686 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4562944~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12305321299999999, 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051380604000000003, 2024-04-23T23:38:51.203 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90686 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011253+0000", 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.34e-07 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011254+0000", 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011258+0000", 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7050000000000001e-06 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011261+0000", 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9349999999999999e-06 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062492+0000", 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051231454000000003 2024-04-23T23:38:51.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062563+0000", 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0461000000000002e-05 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062633+0000", 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0548000000000003e-05 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.207 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90687 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4570112~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.123042068, 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051576652000000001, 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90687 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9299999999999999e-07 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011265+0000", 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2109999999999999e-06 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011268+0000", 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1470000000000001e-06 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011271+0000", 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6309999999999999e-06 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062678+0000", 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051406962 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062759+0000", 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0803000000000005e-05 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062840+0000", 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1605000000000002e-05 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.211 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90688 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4577280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.12303193900000001, 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051748664999999999, 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90688 2024-04-23T23:38:51.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012977+0000", 2024-04-23T23:38:51.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017037109999999999 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012982+0000", 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5979999999999999e-06 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013006+0000", 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4300000000000001e-05 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013015+0000", 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4649999999999994e-06 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062879+0000", 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049864420999999999 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062949+0000", 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9728999999999996e-05 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.063022+0000", 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3441000000000004e-05 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.216 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:51.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:51.218 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:51.230+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:51.318 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:51.331+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:51.396 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:51.396 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:51.396 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:51.396 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:51.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:51.420 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:51.432+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:51.520 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:51.532+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:51.582 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:51.582 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:51.582 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:51.582 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:51.582 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:51.593 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:51.636 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:51.648+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:51.722 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:51.734+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.350445694000001, 2024-04-23T23:38:51.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:38:51.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.752 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 54.350749839999999, 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:38:51.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:38:51.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.671492743000002, 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:38:51.757 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:38:51.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:38:51.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490315798000001, 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.762 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:38:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:38:51.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490305468999999, 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.766 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:51.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:38:51.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:51.770 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490294551000002, 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:51.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:38:51.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.774 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490266365, 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:38:51.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490250660000001, 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:38:51.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490239677000002, 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:38:51.783 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:51.787 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490225305999999, 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:51.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.791 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490187967000001, 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.792 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:38:51.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490165648000001, 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.796 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:38:51.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490138433999999, 2024-04-23T23:38:51.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:38:51.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:38:51.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490118380999998, 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:38:51.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:38:51.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.490099004000001, 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:38:51.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:38:51.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.49007958, 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:38:51.813 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:51.817 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 18.578730431, 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:38:51.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:38:51.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:38:51.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.370888203, 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:38:51.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:38:51.825 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.202889184, 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.184320953, 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:51.830 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:38:51.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:38:51.834 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:51.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:51.836 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:51.847+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:51.841 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:38:51.880 INFO:teuthology.orchestra.run.smithi077.stdout:4363 read 0x82ad2a3 thru 0x82b1148 (0x3ea6 bytes) 2024-04-23T23:38:51.883 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.883 INFO:teuthology.orchestra.run.smithi077.stdout:4365 punch from 0x5e6174 to 0x5f381e, (0xd6aa bytes) 2024-04-23T23:38:51.891 INFO:teuthology.orchestra.run.smithi077.stdout:4368 punch from 0xe54eaf6 to 0xe55db6a, (0xf074 bytes) 2024-04-23T23:38:51.891 INFO:teuthology.orchestra.run.smithi077.stdout:4369 writesame 0x4edcab6 thru 0x4eec18b data_size 0x8e(0xf6d6 bytes) 2024-04-23T23:38:51.899 INFO:teuthology.orchestra.run.smithi077.stdout:4370 write 0x86405f8 thru 0x8647a99 (0x74a2 bytes) 2024-04-23T23:38:51.907 INFO:teuthology.orchestra.run.smithi077.stdout:4371 read 0xde2ff8c thru 0xde39324 (0x9399 bytes) 2024-04-23T23:38:51.908 INFO:teuthology.orchestra.run.smithi077.stdout:4372 write 0x5fe63c4 thru 0x5fe7488 (0x10c5 bytes) 2024-04-23T23:38:51.911 INFO:teuthology.orchestra.run.smithi077.stdout:4373 read 0xed151 thru 0xf7df4 (0xaca4 bytes) 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:4374 read 0x7c30e1e thru 0x7c32977 (0x1b5a bytes) 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:4375 read 0x269b84f thru 0x26a2370 (0x6b22 bytes) 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:4379 punch from 0xb3b10dd to 0xb3b1b0e, (0xa31 bytes) 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:4381 punch from 0xaa37856 to 0xaa38c5f, (0x1409 bytes) 2024-04-23T23:38:51.913 INFO:teuthology.orchestra.run.smithi077.stdout:4383 write 0x4465c4a thru 0x447090a (0xacc1 bytes) 2024-04-23T23:38:51.920 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.920 INFO:teuthology.orchestra.run.smithi077.stdout:4386 write 0x725eefc thru 0x72657f5 (0x68fa bytes) 2024-04-23T23:38:51.928 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.928 INFO:teuthology.orchestra.run.smithi077.stdout:4388 read 0x2cf9cd thru 0x2d2e14 (0x3448 bytes) 2024-04-23T23:38:51.928 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.928 INFO:teuthology.orchestra.run.smithi077.stdout:4391 write 0x27e53ed thru 0x27f412d (0xed41 bytes) 2024-04-23T23:38:51.935 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:51.947+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:51.937 INFO:teuthology.orchestra.run.smithi077.stdout:4393 punch from 0x6edd519 to 0x6ee3d8d, (0x6874 bytes) 2024-04-23T23:38:51.937 INFO:teuthology.orchestra.run.smithi077.stdout:4394 read 0x9fcf3fe thru 0x9fd05b3 (0x11b6 bytes) 2024-04-23T23:38:51.947 INFO:teuthology.orchestra.run.smithi077.stdout:4395 trunc from 0xe574412 to 0x62faa1f 2024-04-23T23:38:51.953 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:51.953 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:51.954 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:51.954 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:51.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:51.979 INFO:teuthology.orchestra.run.smithi077.stdout:4396 writesame 0xe387d71 thru 0xe39587d data_size 0x1(0xdb0d bytes) 2024-04-23T23:38:51.979 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:51.979 INFO:teuthology.orchestra.run.smithi077.stdout:4398 read 0x290f078 thru 0x2918478 (0x9401 bytes) 2024-04-23T23:38:51.979 INFO:teuthology.orchestra.run.smithi077.stdout:4399 write 0x7a5554f thru 0x7a57da3 (0x2855 bytes) 2024-04-23T23:38:51.982 INFO:teuthology.orchestra.run.smithi077.stdout:4400 punch from 0x4923944 to 0x4928a38, (0x50f4 bytes) 2024-04-23T23:38:51.991 INFO:teuthology.orchestra.run.smithi077.stdout:4404 trunc from 0xe39587e to 0x64b15cb 2024-04-23T23:38:52.003 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.003 INFO:teuthology.orchestra.run.smithi077.stdout:4406 write 0x4751a44 thru 0x4751abc (0x79 bytes) 2024-04-23T23:38:52.018 INFO:teuthology.orchestra.run.smithi077.stdout:4407 write 0xac59126 thru 0xac5ecc9 (0x5ba4 bytes) 2024-04-23T23:38:52.022 INFO:teuthology.orchestra.run.smithi077.stdout:4409 write 0x71bab52 thru 0x71bee37 (0x42e6 bytes) 2024-04-23T23:38:52.025 INFO:teuthology.orchestra.run.smithi077.stdout:4410 writesame 0x79b6924 thru 0x79c09be data_size 0x5(0xa09b bytes) 2024-04-23T23:38:52.036 INFO:teuthology.orchestra.run.smithi077.stdout:4412 write 0x32fe123 thru 0x32fe1a9 (0x87 bytes) 2024-04-23T23:38:52.047 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:52.059+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:52.051 INFO:teuthology.orchestra.run.smithi077.stdout:4415 trunc from 0xac5ecca to 0x12df2bf 2024-04-23T23:38:52.100 INFO:teuthology.orchestra.run.smithi077.stdout:4416 read 0x4906fa thru 0x49c5b8 (0xbebf bytes) 2024-04-23T23:38:52.116 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:52.116 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:52.116 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:52.116 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:52.116 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:52.117 INFO:teuthology.orchestra.run.smithi077.stdout:4417 writesame 0x8fadb50 thru 0x8fb350e data_size 0x5(0x59bf bytes) 2024-04-23T23:38:52.117 INFO:teuthology.orchestra.run.smithi077.stdout:4418 write 0x7f15c68 thru 0x7f20dc7 (0xb160 bytes) 2024-04-23T23:38:52.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:52.128 INFO:teuthology.orchestra.run.smithi077.stdout:4420 trunc from 0x8fb350f to 0x4e74ad6 2024-04-23T23:38:52.137 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:52.149+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:52.138 INFO:teuthology.orchestra.run.smithi077.stdout:4422 trunc from 0x4e74ad6 to 0x575fed2 2024-04-23T23:38:52.143 INFO:teuthology.orchestra.run.smithi077.stdout:4423 read 0x404f39 thru 0x4051b2 (0x27a bytes) 2024-04-23T23:38:52.143 INFO:teuthology.orchestra.run.smithi077.stdout:4424 read 0x4ddac5d thru 0x4ddfa8c (0x4e30 bytes) 2024-04-23T23:38:52.143 INFO:teuthology.orchestra.run.smithi077.stdout:4425 write 0x101aac8 thru 0x1022493 (0x79cc bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4426 writesame 0xc3f9c63 thru 0xc409427 data_size 0x1(0xf7c5 bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4427 punch from 0x3c8d2b7 to 0x3c95df6, (0x8b3f bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4429 punch from 0x5582a60 to 0x558e466, (0xba06 bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4430 read 0x77a3956 thru 0x77b11d8 (0xd883 bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4431 read 0x21ad3c2 thru 0x21b24a8 (0x50e7 bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4433 punch from 0x300579f to 0x300d7a7, (0x8008 bytes) 2024-04-23T23:38:52.171 INFO:teuthology.orchestra.run.smithi077.stdout:4434 write 0x746d659 thru 0x747cb5d (0xf505 bytes) 2024-04-23T23:38:52.179 INFO:teuthology.orchestra.run.smithi077.stdout:4435 punch from 0x2bfd3fb to 0x2c01edd, (0x4ae2 bytes) 2024-04-23T23:38:52.179 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.179 INFO:teuthology.orchestra.run.smithi077.stdout:4439 write 0x5609122 thru 0x560d9be (0x489d bytes) 2024-04-23T23:38:52.185 INFO:teuthology.orchestra.run.smithi077.stdout:4441 read 0x354791e thru 0x3549abb (0x219e bytes) 2024-04-23T23:38:52.185 INFO:teuthology.orchestra.run.smithi077.stdout:4442 writesame 0x6ac40a4 thru 0x6ad275e data_size 0x3(0xe6bb bytes) 2024-04-23T23:38:52.198 INFO:teuthology.orchestra.run.smithi077.stdout:4444 read 0x3c116a7 thru 0x3c1c33d (0xac97 bytes) 2024-04-23T23:38:52.198 INFO:teuthology.orchestra.run.smithi077.stdout:4447 read 0x81db0fe thru 0x81db6a0 (0x5a3 bytes) 2024-04-23T23:38:52.198 INFO:teuthology.orchestra.run.smithi077.stdout:4448 read 0x86ece80 thru 0x86ed041 (0x1c2 bytes) 2024-04-23T23:38:52.198 INFO:teuthology.orchestra.run.smithi077.stdout:4449 read 0x707cecb thru 0x7080531 (0x3667 bytes) 2024-04-23T23:38:52.202 INFO:teuthology.orchestra.run.smithi077.stdout:4450 trunc from 0xc409428 to 0x8c283a5 2024-04-23T23:38:52.209 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.217 INFO:teuthology.orchestra.run.smithi077.stdout:4452 trunc from 0x8c283a5 to 0x1a3e8bc 2024-04-23T23:38:52.228 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.229 INFO:teuthology.orchestra.run.smithi077.stdout:4454 read 0x17aed5 thru 0x18ad5b (0xfe87 bytes) 2024-04-23T23:38:52.229 INFO:teuthology.orchestra.run.smithi077.stdout:4456 punch from 0x1385478 to 0x138a0e2, (0x4c6a bytes) 2024-04-23T23:38:52.236 INFO:teuthology.orchestra.run.smithi077.stdout:4457 writesame 0x24d5a53 thru 0x24dce90 data_size 0x1(0x743e bytes) 2024-04-23T23:38:52.236 INFO:teuthology.orchestra.run.smithi077.stdout:4458 punch from 0x175b922 to 0x1767930, (0xc00e bytes) 2024-04-23T23:38:52.237 INFO:teuthology.orchestra.run.smithi077.stdout:4459 read 0x22a6e6e thru 0x22b4267 (0xd3fa bytes) 2024-04-23T23:38:52.237 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:52.249+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:52.257 INFO:teuthology.orchestra.run.smithi077.stdout:4460 write 0xe4c1da4 thru 0xe4cda7c (0xbcd9 bytes) 2024-04-23T23:38:52.260 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T23:38:52.260 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.3 2024-04-23T23:38:52.260 INFO:tasks.thrashosds.thrasher:remote for osd 3 is ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:38:52.260 DEBUG:teuthology.orchestra.run.smithi077:> type ceph-objectstore-tool 2024-04-23T23:38:52.263 INFO:teuthology.orchestra.run.smithi077.stdout:4463 write 0x3143a04 thru 0x314bf6e (0x856b bytes) 2024-04-23T23:38:52.267 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.277 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-23T23:38:52.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-objectstore-tool --err-to-stderr --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-3 --journal-path /var/lib/ceph/osd/ceph-3/journal --op list-pgs 2024-04-23T23:38:52.281 INFO:teuthology.orchestra.run.smithi077.stdout:4466 trunc from 0xe4cda7d to 0x2f8a77f 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 47.311166962999998, 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:38:52.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:38:52.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:52.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33566 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12025856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:52.295 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.054108931999998, 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047296019000000002, 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33566 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245971+0000", 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245973+0000", 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245979+0000", 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245984+0000", 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293076+0000", 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047091597999999998 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293164+0000", 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7928000000000002e-05 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293266+0000", 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102247 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:52.299 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.054088208000003, 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:38:52.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.303 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.054045876000004, 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:38:52.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.307 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.054023276000002, 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.308 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:38:52.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.311 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.053998188999998, 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.312 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:38:52.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.053976851999998, 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:38:52.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:38:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:38:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:38:52.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:38:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.053955805000001, 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:38:52.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:38:52.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:38:52.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.053751349999999, 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.326 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:38:52.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.053417951, 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:38:52.330 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:38:52.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.053392055000003, 2024-04-23T23:38:52.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.052995123000002, 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.339 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:38:52.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:38:52.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.052958797000002, 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:38:52.343 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:38:52.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.052570439, 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.348 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:52.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:38:52.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:38:52.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.052545037999998, 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.352 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.050384643999998, 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.356 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:52.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:38:52.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.050364039999998, 2024-04-23T23:38:52.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:38:52.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:38:52.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.050343691999998, 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.368 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.050324011999997, 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.369 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.048320556, 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.373 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.377 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:52.380 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:52.380 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:52.390+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:4468 writesame 0x36bbaf1 thru 0x36bf47b data_size 0x1(0x398b bytes) 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:4469 writesame 0xaf63db0 thru 0xaf6dffe data_size 0x1(0xa24f bytes) 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:4472 writesame 0xa6ab4f thru 0xa6f604 data_size 0x2(0x4ab6 bytes) 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:4473 read 0x4cec31f thru 0x4cee896 (0x2578 bytes) 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.382 INFO:teuthology.orchestra.run.smithi077.stdout:4476 read 0x22c991e thru 0x22d72a9 (0xd98c bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4478 write 0x7461a69 thru 0x7468883 (0x6e1b bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4479 writesame 0xad2331 thru 0xadc4f2 data_size 0xa(0xa1c2 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4480 punch from 0x17eca48 to 0x17efeb7, (0x346f bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4481 write 0x2a314a thru 0x2a734d (0x4204 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4482 read 0x8e68f1 thru 0x8f38cf (0xcfdf bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4486 read 0x55677d9 thru 0x556d879 (0x60a1 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4487 punch from 0x4eb2177 to 0x4ebf45b, (0xd2e4 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4488 read 0x62696b9 thru 0x627316e (0x9ab6 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4489 punch from 0x564f375 to 0x565e545, (0xf1d0 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4493 read 0x646e9a1 thru 0x6474d13 (0x6373 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4494 read 0x99d384d thru 0x99e1f9a (0xe74e bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4495 write 0xa175f99 thru 0xa17c7af (0x6817 bytes) 2024-04-23T23:38:52.383 INFO:teuthology.orchestra.run.smithi077.stdout:4496 read 0x462792b thru 0x4630179 (0x884f bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4497 read 0x9682e40 thru 0x968b2f1 (0x84b2 bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4499 read 0x441744 thru 0x44d26a (0xbb27 bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4500 read 0x21b3456 thru 0x21bd198 (0x9d43 bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4504 write 0xb3fd137 thru 0xb40ce37 (0xfd01 bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4508 write 0x1e42f6d thru 0x1e4ea17 (0xbaab bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4510 read 0xa755ae3 thru 0xa76479e (0xecbc bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4512 read 0x199e530 thru 0x19a7a9a (0x956b bytes) 2024-04-23T23:38:52.384 INFO:teuthology.orchestra.run.smithi077.stdout:4514 trunc from 0xb40ce38 to 0x7e83f88 2024-04-23T23:38:52.407 INFO:teuthology.orchestra.run.smithi077.stdout:4515 trunc from 0x7e83f88 to 0x1885d65 2024-04-23T23:38:52.420 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.433 INFO:teuthology.orchestra.run.smithi077.stdout:4517 trunc from 0x1885d65 to 0xc48fe7a 2024-04-23T23:38:52.440 INFO:teuthology.orchestra.run.smithi077.stdout:4518 trunc from 0xc48fe7a to 0xc208006 2024-04-23T23:38:52.445 INFO:teuthology.orchestra.run.smithi077.stdout:4520 read 0xb0ac16e thru 0xb0b130f (0x51a2 bytes) 2024-04-23T23:38:52.445 INFO:teuthology.orchestra.run.smithi077.stdout:4522 read 0x9201057 thru 0x92043ac (0x3356 bytes) 2024-04-23T23:38:52.446 INFO:teuthology.orchestra.run.smithi077.stdout:4523 read 0x4029393 thru 0x40354da (0xc148 bytes) 2024-04-23T23:38:52.446 INFO:teuthology.orchestra.run.smithi077.stdout:4525 write 0x8f45165 thru 0x8f52821 (0xd6bd bytes) 2024-04-23T23:38:52.451 INFO:teuthology.orchestra.run.smithi077.stdout:4526 writesame 0x7093f21 thru 0x7097a8d data_size 0xb(0x3b6d bytes) 2024-04-23T23:38:52.459 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.459 INFO:teuthology.orchestra.run.smithi077.stdout:4529 read 0x8c82306 thru 0x8c847e6 (0x24e1 bytes) 2024-04-23T23:38:52.460 INFO:teuthology.orchestra.run.smithi077.stdout:4530 write 0x3b38724 thru 0x3b45bc0 (0xd49d bytes) 2024-04-23T23:38:52.469 INFO:teuthology.orchestra.run.smithi077.stdout:4531 writesame 0x67c372d thru 0x67c49e1 data_size 0x1(0x12b5 bytes) 2024-04-23T23:38:52.473 INFO:teuthology.orchestra.run.smithi077.stdout:4534 writesame 0x5930681 thru 0x5935146 data_size 0x11(0x4ac6 bytes) 2024-04-23T23:38:52.477 INFO:teuthology.orchestra.run.smithi077.stdout:4535 punch from 0xbb86c5c to 0xbb93f6e, (0xd312 bytes) 2024-04-23T23:38:52.479 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:52.491+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:52.482 INFO:teuthology.orchestra.run.smithi077.stdout:4536 trunc from 0xc208006 to 0x84c92e9 2024-04-23T23:38:52.493 INFO:teuthology.orchestra.run.smithi077.stdout:4537 write 0x5916599 thru 0x592505a (0xeac2 bytes) 2024-04-23T23:38:52.513 INFO:teuthology.orchestra.run.smithi077.stdout:4538 write 0xbfbd746 thru 0xbfbecee (0x15a9 bytes) 2024-04-23T23:38:52.517 INFO:teuthology.orchestra.run.smithi077.stdout:4539 read 0x8a85d2 thru 0x8b324d (0xac7c bytes) 2024-04-23T23:38:52.517 INFO:teuthology.orchestra.run.smithi077.stdout:4540 trunc from 0xbfbecef to 0xc69c432 2024-04-23T23:38:52.535 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:52.535 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:52.535 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:52.535 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:52.536 INFO:teuthology.orchestra.run.smithi077.stdout:4541 trunc from 0xc69c432 to 0x1b3a18f 2024-04-23T23:38:52.546 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:52.549 INFO:teuthology.orchestra.run.smithi077.stdout:4542 read 0xf09c36 thru 0xf18bdf (0xefaa bytes) 2024-04-23T23:38:52.566 INFO:teuthology.orchestra.run.smithi077.stdout:4543 write 0x96c33be thru 0x96c4ef0 (0x1b33 bytes) 2024-04-23T23:38:52.570 INFO:teuthology.orchestra.run.smithi077.stdout:4544 write 0x437226d thru 0x437b251 (0x8fe5 bytes) 2024-04-23T23:38:52.578 INFO:teuthology.orchestra.run.smithi077.stdout:4545 read 0x524f5fa thru 0x5256bda (0x75e1 bytes) 2024-04-23T23:38:52.578 INFO:teuthology.orchestra.run.smithi077.stdout:4547 read 0x6c67e9b thru 0x6c71ab5 (0x9c1b bytes) 2024-04-23T23:38:52.578 INFO:teuthology.orchestra.run.smithi077.stdout:4548 read 0x40cfd63 thru 0x40dc1b3 (0xc451 bytes) 2024-04-23T23:38:52.578 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.580 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:52.592+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:52.580 INFO:teuthology.orchestra.run.smithi077.stdout:4551 trunc from 0x96c4ef1 to 0x4a50d0c 2024-04-23T23:38:52.604 INFO:teuthology.orchestra.run.smithi077.stdout:4552 write 0xaaf4479 thru 0xaaf84b4 (0x403c bytes) 2024-04-23T23:38:52.609 INFO:teuthology.orchestra.run.smithi077.stdout:4553 writesame 0x66c4814 thru 0x66cce12 data_size 0x1(0x85ff bytes) 2024-04-23T23:38:52.624 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.624 INFO:teuthology.orchestra.run.smithi077.stdout:4556 write 0x2c662f5 thru 0x2c68387 (0x2093 bytes) 2024-04-23T23:38:52.633 INFO:teuthology.orchestra.run.smithi077.stdout:4557 trunc from 0xaaf84b5 to 0xe44c20e 2024-04-23T23:38:52.639 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:52.639 INFO:teuthology.orchestra.run.smithi077.stdout:4560 write 0x86f9277 thru 0x87005f6 (0x7380 bytes) 2024-04-23T23:38:52.650 INFO:teuthology.orchestra.run.smithi077.stdout:4561 trunc from 0xe44c20e to 0x9042ad0 2024-04-23T23:38:52.663 INFO:teuthology.orchestra.run.smithi077.stdout:4564 read 0x25bae93 thru 0x25bd6b4 (0x2822 bytes) 2024-04-23T23:38:52.663 INFO:teuthology.orchestra.run.smithi077.stdout:4566 clone 36 order 18 su 1024 sc 4 2024-04-23T23:38:52.677 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:52.681 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:52.692+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:52.693 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:52.693 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:52.693 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:52.693 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:52.694 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:52.702 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:52.781 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:52.793+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:52.805 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:52.805 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:52.822 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:52.839 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:52.840 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:52.840 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.956759052999999, 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:52.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.956724852000001, 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.956691262, 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:52.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:52.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:52.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.956653727000003, 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:52.868 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.872 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.956630191000002, 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:52.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.955240975000002, 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.877 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:52.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.955212588000002, 2024-04-23T23:38:52.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:52.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:52.885 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.955190279, 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:52.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.889 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.955022055999997, 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.890 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:52.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.893 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954973330000001, 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:52.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:52.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:52.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954878135000001, 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.898 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954846185000001, 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:52.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:52.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954823885000003, 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.906 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:52.910 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954793688999999, 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:52.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954633923999999, 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.915 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:52.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:52.918 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954598304999998, 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.919 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954499024, 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:52.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.927 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954469457999998, 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:52.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:52.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:52.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 59.954447033999998, 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.935 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.324429370000001, 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:38:52.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:38:52.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:38:52.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:38:52.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:38:52.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:52.941 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:52.942 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:52.943 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:52.943 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:52.944 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:52.944 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:52.944 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:52.945 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:52.945 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:38:52.946 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:52.946 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:38:52.946 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone35 from 0x9042ad0 (overlap 0x12df2bf) to 0x96f95f 2024-04-23T23:38:52.946 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:52.954+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:53.044 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:53.056+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:53.051 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.051 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.059 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:53.145 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:53.157+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:53.163 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.164 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.172 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:53.246 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:53.258+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:53.283 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.283 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.295 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:53.347 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:53.358+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:53.356 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-04-23T23:38:53.362 INFO:teuthology.orchestra.run.smithi077.stdout:4567 trunc from 0x9042ad0 to 0xcbb60fc 2024-04-23T23:38:53.386 INFO:teuthology.orchestra.run.smithi077.stdout:4568 trunc from 0xcbb60fc to 0x1be5683 2024-04-23T23:38:53.404 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.404 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.413 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:53.414 INFO:teuthology.orchestra.run.smithi077.stdout:4569 trunc from 0x1be5683 to 0xb38a178 2024-04-23T23:38:53.432 INFO:teuthology.orchestra.run.smithi077.stdout:4570 trunc from 0xb38a178 to 0x1968e0a 2024-04-23T23:38:53.448 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:53.460+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:53.464 INFO:teuthology.orchestra.run.smithi077.stdout:4571 trunc from 0x1968e0a to 0xbb42ab4 2024-04-23T23:38:53.471 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:53.471 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:53.473 INFO:teuthology.orchestra.run.smithi077.stdout:4575 trunc from 0xbb42ab4 to 0x9e8e104 2024-04-23T23:38:53.478 INFO:teuthology.orchestra.run.smithi077.stdout:4576 read 0x5525b60 thru 0x5535913 (0xfdb4 bytes) 2024-04-23T23:38:53.478 INFO:teuthology.orchestra.run.smithi077.stdout:4578 read 0x4e20430 thru 0x4e236f8 (0x32c9 bytes) 2024-04-23T23:38:53.478 INFO:teuthology.orchestra.run.smithi077.stdout:4581 write 0xd1f0c7 thru 0xd27168 (0x80a2 bytes) 2024-04-23T23:38:53.549 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:53.560+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:53.558 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.558 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.567 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:53.631 INFO:teuthology.orchestra.run.smithi077.stdout:4582 read 0x6c32800 thru 0x6c355d9 (0x2dda bytes) 2024-04-23T23:38:53.631 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:53.631 INFO:teuthology.orchestra.run.smithi077.stdout:4587 read 0xf163fd thru 0xf22480 (0xc084 bytes) 2024-04-23T23:38:53.632 INFO:teuthology.orchestra.run.smithi077.stdout:4588 write 0x64b7b51 thru 0x64b894b (0xdfb bytes) 2024-04-23T23:38:53.648 INFO:teuthology.orchestra.run.smithi077.stdout:4589 trunc from 0x9e8e104 to 0x1828e0c 2024-04-23T23:38:53.652 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:53.664+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:53.665 INFO:teuthology.orchestra.run.smithi077.stdout:4590 read 0x90b4fb thru 0x915be7 (0xa6ed bytes) 2024-04-23T23:38:53.665 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:53.665 INFO:teuthology.orchestra.run.smithi077.stdout:4592 write 0x1742c4a thru 0x174d0cd (0xa484 bytes) 2024-04-23T23:38:53.672 INFO:teuthology.orchestra.run.smithi077.stdout:4593 read 0x10ca416 thru 0x10cc5ac (0x2197 bytes) 2024-04-23T23:38:53.683 INFO:teuthology.orchestra.run.smithi077.stdout:4595 write 0x58e31aa thru 0x58ee957 (0xb7ae bytes) 2024-04-23T23:38:53.689 INFO:teuthology.orchestra.run.smithi077.stdout:4598 punch from 0x1e7dcc1 to 0x1e850ea, (0x7429 bytes) 2024-04-23T23:38:53.689 INFO:teuthology.orchestra.run.smithi077.stdout:4599 read 0x2dae41e thru 0x2dbd62d (0xf210 bytes) 2024-04-23T23:38:53.693 INFO:teuthology.orchestra.run.smithi077.stdout:4600 trunc from 0x58ee958 to 0x1b770c4 2024-04-23T23:38:53.715 INFO:teuthology.orchestra.run.smithi077.stdout:4601 writesame 0x5cb6dcb thru 0x5cbb724 data_size 0x29(0x495a bytes) 2024-04-23T23:38:53.715 INFO:teuthology.orchestra.run.smithi077.stdout:4603 punch from 0x151b72 to 0x1534a1, (0x192f bytes) 2024-04-23T23:38:53.715 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:53.720 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.720 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.721 INFO:teuthology.orchestra.run.smithi077.stdout:4605 writesame 0x67de54e thru 0x67ec0c4 data_size 0x1(0xdb77 bytes) 2024-04-23T23:38:53.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:53.735 INFO:teuthology.orchestra.run.smithi077.stdout:4606 write 0xbb27837 thru 0xbb32ee6 (0xb6b0 bytes) 2024-04-23T23:38:53.746 INFO:teuthology.orchestra.run.smithi077.stdout:4607 read 0x5e0fd9d thru 0x5e158e2 (0x5b46 bytes) 2024-04-23T23:38:53.746 INFO:teuthology.orchestra.run.smithi077.stdout:4609 read 0xa92cf92 thru 0xa935f33 (0x8fa2 bytes) 2024-04-23T23:38:53.746 INFO:teuthology.orchestra.run.smithi077.stdout:4610 punch from 0x99e9828 to 0x99f895e, (0xf136 bytes) 2024-04-23T23:38:53.746 INFO:teuthology.orchestra.run.smithi077.stdout:4611 punch from 0x551a4ca to 0x551a7e5, (0x31b bytes) 2024-04-23T23:38:53.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-23T23:38:53.750 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:53.763+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:53.754 INFO:teuthology.orchestra.run.smithi077.stdout:4614 write 0xe143196 thru 0xe14911f (0x5f8a bytes) 2024-04-23T23:38:53.766 INFO:teuthology.orchestra.run.smithi077.stdout:4616 write 0x2962f99 thru 0x29667f3 (0x385b bytes) 2024-04-23T23:38:53.776 INFO:teuthology.orchestra.run.smithi077.stdout:4617 read 0x4932686 thru 0x493878d (0x6108 bytes) 2024-04-23T23:38:53.776 INFO:teuthology.orchestra.run.smithi077.stdout:4619 read 0xdc4339c thru 0xdc4bcd7 (0x893c bytes) 2024-04-23T23:38:53.776 INFO:teuthology.orchestra.run.smithi077.stdout:4620 read 0xacb6919 thru 0xacc4022 (0xd70a bytes) 2024-04-23T23:38:53.776 INFO:teuthology.orchestra.run.smithi077.stdout:4621 write 0x23686e8 thru 0x2371a5f (0x9378 bytes) 2024-04-23T23:38:53.783 INFO:teuthology.orchestra.run.smithi077.stdout:4622 punch from 0x8247a42 to 0x8247ead, (0x46b bytes) 2024-04-23T23:38:53.783 INFO:teuthology.orchestra.run.smithi077.stdout:4623 punch from 0x2c0988a to 0x2c12029, (0x879f bytes) 2024-04-23T23:38:53.783 INFO:teuthology.orchestra.run.smithi077.stdout:4624 punch from 0x8a87658 to 0x8a8baa7, (0x444f bytes) 2024-04-23T23:38:53.785 INFO:teuthology.orchestra.run.smithi077.stdout:4626 trunc from 0xe149120 to 0xbfbc469 2024-04-23T23:38:53.806 INFO:teuthology.orchestra.run.smithi077.stdout:4627 write 0xe32455b thru 0xe330d41 (0xc7e7 bytes) 2024-04-23T23:38:53.816 INFO:teuthology.orchestra.run.smithi077.stdout:4630 trunc from 0xe330d42 to 0xa0dbb00 2024-04-23T23:38:53.836 INFO:teuthology.orchestra.run.smithi077.stdout:4632 write 0xc4be41e thru 0xc4c430c (0x5eef bytes) 2024-04-23T23:38:53.845 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.845 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.846 INFO:teuthology.orchestra.run.smithi077.stdout:4633 trunc from 0xc4c430d to 0xba8d048 2024-04-23T23:38:53.851 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:53.862+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:53.855 INFO:teuthology.orchestra.run.smithi077.stdout:4634 read 0x9ed3c45 thru 0x9eddfaa (0xa366 bytes) 2024-04-23T23:38:53.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:53.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:38:53.863 INFO:teuthology.orchestra.run.smithi077.stdout:4635 trunc from 0xba8d048 to 0x579f79c 2024-04-23T23:38:53.869 INFO:teuthology.orchestra.run.smithi077.stdout:4636 read 0x3da2ec8 thru 0x3dad819 (0xa952 bytes) 2024-04-23T23:38:53.869 INFO:teuthology.orchestra.run.smithi077.stdout:4637 punch from 0x2c3ec2a to 0x2c4b536, (0xc90c bytes) 2024-04-23T23:38:53.874 INFO:teuthology.orchestra.run.smithi077.stdout:4639 trunc from 0x579f79c to 0x9a9dace 2024-04-23T23:38:53.879 INFO:teuthology.orchestra.run.smithi077.stdout:4640 read 0x25502bf thru 0x255fbaa (0xf8ec bytes) 2024-04-23T23:38:53.879 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:53.879 INFO:teuthology.orchestra.run.smithi077.stdout:4642 writesame 0x53fb354 thru 0x5405ff9 data_size 0x31(0xaca6 bytes) 2024-04-23T23:38:53.901 INFO:teuthology.orchestra.run.smithi077.stdout:4643 write 0xc86d229 thru 0xc87088a (0x3662 bytes) 2024-04-23T23:38:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:4644 read 0x3e13f11 thru 0x3e194ec (0x55dc bytes) 2024-04-23T23:38:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:4645 read 0x31e6bc6 thru 0x31e893a (0x1d75 bytes) 2024-04-23T23:38:53.912 INFO:teuthology.orchestra.run.smithi077.stdout:4646 read 0x2eadcc2 thru 0x2eb6faf (0x92ee bytes) 2024-04-23T23:38:53.920 INFO:teuthology.orchestra.run.smithi077.stdout:4647 write 0xe6f275e thru 0xe701758 (0xeffb bytes) 2024-04-23T23:38:53.933 INFO:teuthology.orchestra.run.smithi077.stdout:4648 writesame 0x1aedc7e thru 0x1afaffc data_size 0x1(0xd37f bytes) 2024-04-23T23:38:53.949 INFO:teuthology.orchestra.run.smithi077.stdout:4649 read 0x2fc3e43 thru 0x2fd31d6 (0xf394 bytes) 2024-04-23T23:38:53.950 INFO:teuthology.orchestra.run.smithi077.stdout:4650 writesame 0x13563be thru 0x135d294 data_size 0x19(0x6ed7 bytes) 2024-04-23T23:38:53.952 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:53.964+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:53.985 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:53.986 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:53.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:54.019 INFO:tasks.thrashosds.thrasher:No PGs found for osd.3 2024-04-23T23:38:54.023 INFO:teuthology.orchestra.run.smithi077.stdout:4651 write 0x4598ae6 thru 0x4598f3d (0x458 bytes) 2024-04-23T23:38:54.027 INFO:teuthology.orchestra.run.smithi077.stdout:4652 read 0x5a8b74e thru 0x5a8f1e5 (0x3a98 bytes) 2024-04-23T23:38:54.027 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:54.027 INFO:teuthology.orchestra.run.smithi077.stdout:4654 read 0xc8d697b thru 0xc8dc87a (0x5f00 bytes) 2024-04-23T23:38:54.028 INFO:teuthology.orchestra.run.smithi077.stdout:4656 write 0x92be79c thru 0x92c111c (0x2981 bytes) 2024-04-23T23:38:54.038 INFO:teuthology.orchestra.run.smithi077.stdout:4657 write 0x5647538 thru 0x5649b90 (0x2659 bytes) 2024-04-23T23:38:54.048 INFO:teuthology.orchestra.run.smithi077.stdout:4658 write 0x75d282e thru 0x75e163f (0xee12 bytes) 2024-04-23T23:38:54.053 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:54.065+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:54.078 INFO:teuthology.orchestra.run.smithi077.stdout:4659 trunc from 0xe701759 to 0x403ea 2024-04-23T23:38:54.143 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:54.143 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:54.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:54.153 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:54.165+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:54.203 INFO:teuthology.orchestra.run.smithi077.stdout:4660 read 0x29516 thru 0x2eefd (0x59e8 bytes) 2024-04-23T23:38:54.229 INFO:teuthology.orchestra.run.smithi077.stdout:4662 writesame 0xe65f30e thru 0xe66c743 data_size 0x17(0xd436 bytes) 2024-04-23T23:38:54.229 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:54.229 INFO:teuthology.orchestra.run.smithi077.stdout:4667 write 0x1813ed6 thru 0x181ec31 (0xad5c bytes) 2024-04-23T23:38:54.246 INFO:teuthology.orchestra.run.smithi077.stdout:4672 trunc from 0xe66c744 to 0x7879579 2024-04-23T23:38:54.253 INFO:teuthology.orchestra.run.smithi077.stdout:4673 trunc from 0x7879579 to 0x6013b6d 2024-04-23T23:38:54.254 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:54.265+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:54.258 INFO:teuthology.orchestra.run.smithi077.stdout:4674 read 0x29a67e1 thru 0x29b6020 (0xf840 bytes) 2024-04-23T23:38:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:4675 write 0xeb5139f thru 0xeb540ac (0x2d0e bytes) 2024-04-23T23:38:54.298 INFO:teuthology.orchestra.run.smithi077.stdout:4676 trunc from 0xeb540ad to 0x393861e 2024-04-23T23:38:54.327 INFO:teuthology.orchestra.run.smithi077.stdout:4677 writesame 0xc640562 thru 0xc649a6b data_size 0x3(0x950a bytes) 2024-04-23T23:38:54.327 INFO:teuthology.orchestra.run.smithi077.stdout:4679 write 0xb58e717 thru 0xb597163 (0x8a4d bytes) 2024-04-23T23:38:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:4682 read 0x47d034 thru 0x487d76 (0xad43 bytes) 2024-04-23T23:38:54.332 INFO:teuthology.orchestra.run.smithi077.stdout:4683 write 0x14f4815 thru 0x14f4f58 (0x744 bytes) 2024-04-23T23:38:54.337 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:54.337 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:54.338 INFO:teuthology.orchestra.run.smithi077.stdout:4684 punch from 0xf85500 to 0xf86c3e, (0x173e bytes) 2024-04-23T23:38:54.353 INFO:teuthology.orchestra.run.smithi077.stdout:4687 trunc from 0xc649a6c to 0x8d556b 2024-04-23T23:38:54.354 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:54.366+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:54.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:54.376 INFO:teuthology.orchestra.run.smithi077.stdout:4688 write 0x5fc6ad6 thru 0x5fd5dc6 (0xf2f1 bytes) 2024-04-23T23:38:54.387 INFO:teuthology.orchestra.run.smithi077.stdout:4689 punch from 0x3577199 to 0x3579c66, (0x2acd bytes) 2024-04-23T23:38:54.387 INFO:teuthology.orchestra.run.smithi077.stdout:4690 punch from 0x5c720aa to 0x5c7415a, (0x20b0 bytes) 2024-04-23T23:38:54.387 INFO:teuthology.orchestra.run.smithi077.stdout:4692 read 0x2b2a91f thru 0x2b2a9dd (0xbf bytes) 2024-04-23T23:38:54.387 INFO:teuthology.orchestra.run.smithi077.stdout:4693 punch from 0x1de3c09 to 0x1dee6f6, (0xaaed bytes) 2024-04-23T23:38:54.387 INFO:teuthology.orchestra.run.smithi077.stdout:4694 write 0x4805297 thru 0x480c4c5 (0x722f bytes) 2024-04-23T23:38:54.397 INFO:teuthology.orchestra.run.smithi077.stdout:4695 read 0x429173d thru 0x429cba4 (0xb468 bytes) 2024-04-23T23:38:54.398 INFO:teuthology.orchestra.run.smithi077.stdout:4699 write 0x2675e2 thru 0x276ed1 (0xf8f0 bytes) 2024-04-23T23:38:54.407 INFO:teuthology.orchestra.run.smithi077.stdout:4700 read 0x3f1fe0a thru 0x3f2cc64 (0xce5b bytes) 2024-04-23T23:38:54.414 INFO:teuthology.orchestra.run.smithi077.stdout:4702 trunc from 0x5fd5dc7 to 0xb065553 2024-04-23T23:38:54.419 INFO:teuthology.orchestra.run.smithi077.stdout:4703 write 0xa054cd7 thru 0xa058f45 (0x426f bytes) 2024-04-23T23:38:54.432 INFO:teuthology.orchestra.run.smithi077.stdout:4705 writesame 0xca04995 thru 0xca0e1e5 data_size 0x1(0x9851 bytes) 2024-04-23T23:38:54.432 INFO:teuthology.orchestra.run.smithi077.stdout:4706 punch from 0xc21a259 to 0xc21a5bc, (0x363 bytes) 2024-04-23T23:38:54.433 INFO:teuthology.orchestra.run.smithi077.stdout:4707 read 0x28c18dd thru 0x28d1540 (0xfc64 bytes) 2024-04-23T23:38:54.433 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:54.433 INFO:teuthology.orchestra.run.smithi077.stdout:4710 write 0x632e484 thru 0x6330265 (0x1de2 bytes) 2024-04-23T23:38:54.437 INFO:teuthology.orchestra.run.smithi077.stdout:4711 read 0x66be92b thru 0x66c7e13 (0x94e9 bytes) 2024-04-23T23:38:54.438 INFO:teuthology.orchestra.run.smithi077.stdout:4712 trunc from 0xca0e1e6 to 0xd89b25e 2024-04-23T23:38:54.443 INFO:teuthology.orchestra.run.smithi077.stdout:4713 writesame 0x3f62ed5 thru 0x3f673f8 data_size 0x64(0x4524 bytes) 2024-04-23T23:38:54.456 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:54.468+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:54.467 INFO:teuthology.orchestra.run.smithi077.stdout:4714 trunc from 0xd89b25e to 0x53be20 2024-04-23T23:38:54.480 INFO:teuthology.orchestra.run.smithi077.stdout:4716 punch from 0x1cec5c to 0x1d0182, (0x1526 bytes) 2024-04-23T23:38:54.486 INFO:teuthology.orchestra.run.smithi077.stdout:4719 write 0xa22e53 thru 0xa2fdda (0xcf88 bytes) 2024-04-23T23:38:54.503 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:54.503 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:54.508 INFO:teuthology.orchestra.run.smithi077.stdout:4721 writesame 0x9e45e46 thru 0x9e4cdf0 data_size 0xd(0x6fab bytes) 2024-04-23T23:38:54.508 INFO:teuthology.orchestra.run.smithi077.stdout:4722 write 0xf1b04b thru 0xf1f3e2 (0x4398 bytes) 2024-04-23T23:38:54.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:54.514 INFO:teuthology.orchestra.run.smithi077.stdout:4723 punch from 0x524f53d to 0x525c94b, (0xd40e bytes) 2024-04-23T23:38:54.514 INFO:teuthology.orchestra.run.smithi077.stdout:4724 read 0x5c38b27 thru 0x5c42058 (0x9532 bytes) 2024-04-23T23:38:54.514 INFO:teuthology.orchestra.run.smithi077.stdout:4725 write 0x526d3e7 thru 0x5271d1a (0x4934 bytes) 2024-04-23T23:38:54.518 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:54.518 INFO:teuthology.orchestra.run.smithi077.stdout:4727 clone 37 order 25 su 4194304 sc 6 2024-04-23T23:38:54.556 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:54.568+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:54.617 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:54.617 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:54.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:54.657 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:54.669+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:54.758 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:54.770+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:54.765 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:54.765 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:54.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:54.849 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:38:54.859 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:54.872+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:54.881 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:54.881 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:54.891 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:54.933 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone36 from 0x9e4cdf1 (overlap 0x403ea) to 0x33654 2024-04-23T23:38:54.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:54.960 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:54.972+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:55.031 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-04-23T23:38:55.046 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:55.047 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:55.058 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:55.061 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:55.073+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:55.072 INFO:teuthology.orchestra.run.smithi077.stdout:4729 write 0x86cd9c3 thru 0x86d64e1 (0x8b1f bytes) 2024-04-23T23:38:55.093 INFO:teuthology.orchestra.run.smithi077.stdout:4730 write 0xb4d3541 thru 0xb4d7f45 (0x4a05 bytes) 2024-04-23T23:38:55.095 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:55.100 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:55.100 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:55.102 INFO:teuthology.orchestra.run.smithi077.stdout:4733 trunc from 0xb4d7f46 to 0x4f64a43 2024-04-23T23:38:55.120 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:55.120 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:55.134 INFO:teuthology.orchestra.run.smithi077.stdout:4735 clone 38 order 23 su 32768 sc 2 2024-04-23T23:38:55.137 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:55.138 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:38:55.155 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:55.156 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:55.161 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:55.174+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:55.166 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:55.166 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:55.166 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:55.166 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:55.172 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:55.173 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:55.175 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:55.190 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:55.190 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:55.207 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:55.207 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:55.210 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:38:55.211 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:38:55.263 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:55.275+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:55.277 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:55.277 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:55.277 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:55.277 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:55.277 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:55.285 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:55.364 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:55.376+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.412519324999998, 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:38:55.390 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:38:55.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:38:55.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:38:55.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33566 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12025856~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155461293999998, 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047296019000000002, 2024-04-23T23:38:55.398 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33566 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245970+0000", 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245971+0000", 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9499999999999998e-07 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245973+0000", 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245979+0000", 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8210000000000004e-06 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245984+0000", 2024-04-23T23:38:55.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293076+0000", 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047091597999999998 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293164+0000", 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7928000000000002e-05 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293266+0000", 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102247 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155440570000003, 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:38:55.403 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:55.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:38:55.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155398237999997, 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:38:55.408 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:38:55.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155375638000002, 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.413 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:55.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:38:55.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.418 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155350550999998, 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.419 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:38:55.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155329213999998, 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:38:55.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.429 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155308167000001, 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.430 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:55.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:55.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.155103711999999, 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.436 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:38:55.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:38:55.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:38:55.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.441 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.154770313, 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.442 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:38:55.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.446 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.154744417000003, 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:38:55.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:38:55.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:38:55.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.451 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.154347485000002, 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.452 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:38:55.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.154311159000002, 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:38:55.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.153922801, 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.462 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:38:55.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.153897399999998, 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:38:55.467 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:38:55.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:55.472 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.151737005999998, 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:38:55.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.151716401999998, 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.477 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.481 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.151696053999999, 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:38:55.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:38:55.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:55.486 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.151676373999997, 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:38:55.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:38:55.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:55.491 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.149672918, 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:55.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:38:55.495 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.496 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.496 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.496 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.496 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.496 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:55.497 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:55.498 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:55.509+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:55.598 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:55.610+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:55.639 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:55.639 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:55.639 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:55.639 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:55.647 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:55.699 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:55.711+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:55.749 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:55.749 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:55.749 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:55.757 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:55.800 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:55.812+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.963710349000003, 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.863 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:38:55.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.963676147999998, 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.867 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:38:55.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:38:55.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:55.871 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.963642557999997, 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:38:55.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:38:55.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.963605023, 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.876 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:38:55.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:38:55.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:38:55.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.963581486999999, 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.962192270999999, 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.962163883999999, 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:55.892 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.962141574999997, 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961973352000001, 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.896 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:38:55.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:38:55.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961924625999998, 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.900 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:55.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:38:55.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961829430999998, 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:38:55.904 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961797480999998, 2024-04-23T23:38:55.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:38:55.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961775181, 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.912 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:38:55.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:38:55.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961744985000003, 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:38:55.916 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:55.920 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961585220000003, 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:38:55.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961549601000002, 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961450319999997, 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.928 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:38:55.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:38:55.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:38:55.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961420754000002, 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:38:55.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:38:55.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 62.961398330000002, 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:38:55.936 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:55.940 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.331380666000001, 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:55.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:38:55.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:55.945 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:55.947 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:55.947 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:55.958+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:55.954 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone37 2024-04-23T23:38:56.047 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:56.059+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:56.052 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:56.053 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:56.053 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:56.053 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:56.059 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-04-23T23:38:56.062 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:56.063 INFO:teuthology.orchestra.run.smithi077.stdout:4737 punch from 0x26b708d to 0x26c6d71, (0xfce4 bytes) 2024-04-23T23:38:56.066 INFO:teuthology.orchestra.run.smithi077.stdout:4738 write 0x11a5caf thru 0x11add0f (0x8061 bytes) 2024-04-23T23:38:56.097 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:56.098 INFO:teuthology.orchestra.run.smithi077.stdout:4740 writesame 0x3afdd7f thru 0x3b0a88f data_size 0x25(0xcb11 bytes) 2024-04-23T23:38:56.138 INFO:teuthology.orchestra.run.smithi077.stdout:4744 read 0x23a00a3 thru 0x23a470f (0x466d bytes) 2024-04-23T23:38:56.138 INFO:teuthology.orchestra.run.smithi077.stdout:4746 read 0x15f50 thru 0x1fb2b (0x9bdc bytes) 2024-04-23T23:38:56.138 INFO:teuthology.orchestra.run.smithi077.stdout:4747 write 0x41d9ad6 thru 0x41db833 (0x1d5e bytes) 2024-04-23T23:38:56.147 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:56.159+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:56.170 INFO:teuthology.orchestra.run.smithi077.stdout:4748 write 0xd1bbd08 thru 0xd1c2d1e (0x7017 bytes) 2024-04-23T23:38:56.176 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:56.183 INFO:teuthology.orchestra.run.smithi077.stdout:4751 write 0xeb6be54 thru 0xeb754ab (0x9658 bytes) 2024-04-23T23:38:56.191 INFO:teuthology.orchestra.run.smithi077.stdout:4752 read 0xb383ede thru 0xb38ab4c (0x6c6f bytes) 2024-04-23T23:38:56.192 INFO:teuthology.orchestra.run.smithi077.stdout:4753 read 0xa0416f3 thru 0xa0456fe (0x400c bytes) 2024-04-23T23:38:56.192 INFO:teuthology.orchestra.run.smithi077.stdout:4754 writesame 0x623ff0 thru 0x6261a9 data_size 0x3(0x21ba bytes) 2024-04-23T23:38:56.224 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:56.224 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:56.224 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:56.224 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:56.224 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:56.239 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:56.244 INFO:teuthology.orchestra.run.smithi077.stdout:4755 read 0x58667d8 thru 0x586f41a (0x8c43 bytes) 2024-04-23T23:38:56.259 INFO:teuthology.orchestra.run.smithi077.stdout:4759 trunc from 0xeb754ac to 0x1e8d315 2024-04-23T23:38:56.271 INFO:teuthology.orchestra.run.smithi077.stdout:4761 read 0x13fedaa thru 0x1400d5d (0x1fb4 bytes) 2024-04-23T23:38:56.272 INFO:teuthology.orchestra.run.smithi077.stdout:4763 punch from 0x16711b3 to 0x16791f3, (0x8040 bytes) 2024-04-23T23:38:56.273 INFO:teuthology.orchestra.run.smithi077.stdout:4764 trunc from 0x1e8d315 to 0x1175f01 2024-04-23T23:38:56.280 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:56.292+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:56.300 INFO:teuthology.orchestra.run.smithi077.stdout:4765 write 0xcbe9d37 thru 0xcbf2685 (0x894f bytes) 2024-04-23T23:38:56.307 INFO:teuthology.orchestra.run.smithi077.stdout:4767 trunc from 0xcbf2686 to 0x9cae964 2024-04-23T23:38:56.317 INFO:teuthology.orchestra.run.smithi077.stdout:4768 writesame 0x90ccdfc thru 0x90d9363 data_size 0x4(0xc568 bytes) 2024-04-23T23:38:56.324 INFO:teuthology.orchestra.run.smithi077.stdout:4769 writesame 0x1202dc2 thru 0x1203f76 data_size 0x1(0x11b5 bytes) 2024-04-23T23:38:56.336 INFO:teuthology.orchestra.run.smithi077.stdout:4770 trunc from 0x9cae964 to 0x1cca053 2024-04-23T23:38:56.347 INFO:teuthology.orchestra.run.smithi077.stdout:4771 read 0x4dbb4b thru 0x4ea8fb (0xedb1 bytes) 2024-04-23T23:38:56.348 INFO:teuthology.orchestra.run.smithi077.stdout:4773 clone 39 order 21 su 8192 sc 7 2024-04-23T23:38:56.348 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:56.360+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 98.671668459000003, 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.388 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:38:56.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:38:56.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:38:56.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8056 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 386048~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937836060999999, 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035300445999999999, 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.394 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8056 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461791+0000", 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461793+0000", 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.934e-06 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461797+0000", 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.262e-06 2024-04-23T23:38:56.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461800+0000", 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496914+0000", 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035114306999999997 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.496986+0000", 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2076000000000006e-05 2024-04-23T23:38:56.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497091+0000", 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010468599999999999 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8057 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 398336~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937823270999999, 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035441766, 2024-04-23T23:38:56.398 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8057 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461803+0000", 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461804+0000", 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461805+0000", 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0419999999999999e-06 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461808+0000", 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0290000000000001e-06 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461810+0000", 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.492e-06 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497119+0000", 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035309063000000002 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497188+0000", 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8233999999999998e-05 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497245+0000", 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7568999999999997e-05 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8058 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937813118999998, 2024-04-23T23:38:56.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035668894999999999, 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8058 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461814+0000", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9700000000000003e-07 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461816+0000", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.579e-06 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461821+0000", 2024-04-23T23:38:56.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.271e-06 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461824+0000", 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3170000000000002e-06 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497289+0000", 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464950000000002 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497373+0000", 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4007999999999999e-05 2024-04-23T23:38:56.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497483+0000", 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000109473 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8059 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937797361999998, 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035806894999999998, 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.406 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8059 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461829+0000", 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461830+0000", 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0699999999999998e-07 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461832+0000", 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.902e-06 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461838+0000", 2024-04-23T23:38:56.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.93e-06 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461843+0000", 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8729999999999998e-06 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497514+0000", 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035671527000000001 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497567+0000", 2024-04-23T23:38:56.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2691000000000001e-05 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497636+0000", 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9565000000000002e-05 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8060 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937778765999994, 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036030347999999997, 2024-04-23T23:38:56.410 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8060 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461848+0000", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461850+0000", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.649e-06 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461856+0000", 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.908e-06 2024-04-23T23:38:56.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461861+0000", 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497678+0000", 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035817373 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497767+0000", 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9296999999999996e-05 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497878+0000", 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011108299999999999 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8061 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 446464~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937759033999995, 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036220657000000003, 2024-04-23T23:38:56.414 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8061 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461868+0000", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461870+0000", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.796e-06 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461877+0000", 2024-04-23T23:38:56.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8290000000000002e-06 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461882+0000", 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0599999999999998e-06 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497914+0000", 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036032244999999997 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.497984+0000", 2024-04-23T23:38:56.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9790999999999996e-05 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498088+0000", 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104553 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8062 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 457728~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937739101999995, 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037251850000000003, 2024-04-23T23:38:56.418 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8062 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461888+0000", 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461890+0000", 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461896+0000", 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.037e-06 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461901+0000", 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498118+0000", 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036217469000000002 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.498189+0000", 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0919000000000003e-05 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499139+0000", 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00095021500000000002 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.422 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8063 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 470016~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937707175, 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037403111000000003, 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8063 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461920+0000", 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999996e-07 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461922+0000", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461929+0000", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9129999999999997e-06 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461940+0000", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.093e-05 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499173+0000", 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037232817000000001 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499246+0000", 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3486999999999996e-05 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499323+0000", 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6196e-05 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8064 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 482304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937678875000003, 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037558320999999999, 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8064 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461948+0000", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000005e-07 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461950+0000", 2024-04-23T23:38:56.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0609999999999998e-06 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461957+0000", 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9580000000000001e-06 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461967+0000", 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2550000000000003e-06 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499352+0000", 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037385230999999998 2024-04-23T23:38:56.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499419+0000", 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7384000000000004e-05 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499506+0000", 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6892999999999996e-05 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.430 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8065 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 494592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937652843999999, 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037702712999999999, 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8065 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461974+0000", 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461976+0000", 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461983+0000", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6100000000000002e-06 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461988+0000", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0629999999999996e-06 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499535+0000", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037547176000000002 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499606+0000", 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0562000000000006e-05 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499677+0000", 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0716000000000005e-05 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:8066 3.13 3:ca821b0a:::rbd_data.1194137ed5d1.0000000000000017:5 [read 505856~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.937632207000007, 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037855473000000001, 2024-04-23T23:38:56.434 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 8066 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:56.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.461995+0000", 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462001+0000", 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462007+0000", 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:38:56.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.462012+0000", 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499713+0000", 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037700702000000003 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499780+0000", 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7182999999999997e-05 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:43.499850+0000", 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0256e-05 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.34581545, 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:38:56.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:38:56.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61791 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 7454720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.611894086, 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035239131, 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61791 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787733+0000", 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3399999999999999e-07 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787736+0000", 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.509e-06 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787742+0000", 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.438e-06 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787747+0000", 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2100000000000001e-06 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.822800+0000", 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035052153000000003 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.822883+0000", 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2928000000000003e-05 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.822972+0000", 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9258999999999994e-05 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61792 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 7503872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.787755+0000", 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.611871726, 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035343959000000001, 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61792 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787755+0000", 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.787755+0000", 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788474+0000", 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00071897699999999998 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788478+0000", 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6669999999999998e-06 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788485+0000", 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2110000000000001e-06 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788491+0000", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1299999999999998e-06 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823001+0000", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034509896999999998 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823044+0000", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3359999999999998e-05 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823099+0000", 2024-04-23T23:38:56.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4716999999999998e-05 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61797 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 8142848~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.611049012999999, 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035388929, 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.453 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61797 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788578+0000", 2024-04-23T23:38:56.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5100000000000001e-07 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788586+0000", 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0190000000000006e-06 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788592+0000", 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2400000000000004e-06 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788598+0000", 2024-04-23T23:38:56.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7969999999999997e-06 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823795+0000", 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035196471999999999 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823877+0000", 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1967999999999999e-05 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823967+0000", 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0081999999999996e-05 2024-04-23T23:38:56.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61798 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 8192000~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.61102185, 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035476981999999997, 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.457 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61798 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788605+0000", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788607+0000", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.182e-06 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788613+0000", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5999999999999997e-06 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788619+0000", 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5570000000000003e-06 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.823992+0000", 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035373660000000001 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824034+0000", 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1872000000000002e-05 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824082+0000", 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7704999999999998e-05 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:61799 3.e 3:76a212f2:::rbd_data.1194be22366e.0000000000000000:1b [read 8372224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e69)", 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.611000232999999, 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035630739000000002, 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 61799 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788627+0000", 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8599999999999998e-07 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788629+0000", 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8899999999999999e-06 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788635+0000", 2024-04-23T23:38:56.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7749999999999998e-06 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.788640+0000", 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824105+0000", 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035464674000000002 2024-04-23T23:38:56.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824186+0000", 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1390999999999994e-05 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:32.824257+0000", 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1082999999999997e-05 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.465 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.846842413000001, 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:38:56.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.470 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77895 3.13 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11141120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.563857+0000", 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.835769639999999, 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035851547999999997, 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77895 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.471 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563857+0000", 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563857+0000", 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563858+0000", 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5300000000000004e-07 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573277+0000", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0094190109999999997 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573304+0000", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6920999999999999e-05 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573320+0000", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6188000000000002e-05 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573420+0000", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100368 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.573609+0000", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018845600000000001 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 2", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.574662+0000", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010529879999999999 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586633+0000", 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011970972999999999 2024-04-23T23:38:56.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599648+0000", 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013015380999999999 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599684+0000", 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6183999999999998e-05 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599709+0000", 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4425000000000001e-05 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.475 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.476 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.476 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:56.477 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:56.478 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:56.489+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:56.578 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:56.590+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:56.620 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:56.621 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:56.629 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:56.679 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:56.691+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:56.730 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:56.730 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:56.730 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:56.730 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:56.730 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:56.738 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:38:56.782 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:56.794+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:56.842 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:56.842 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:38:56.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:38:56.842 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33542 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7045120~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607978645000003, 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043837043999999999, 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33542 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246139+0000", 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246140+0000", 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246142+0000", 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246150+0000", 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9419999999999995e-06 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246155+0000", 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289798+0000", 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043643761000000003 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289882+0000", 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3294000000000006e-05 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.289976+0000", 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4707e-05 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.846 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33543 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7241728~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607956211999998, 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043970473000000003, 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33543 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246162+0000", 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:38:56.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246164+0000", 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2460000000000002e-06 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246170+0000", 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246176+0000", 2024-04-23T23:38:56.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.19e-06 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290013+0000", 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043836352000000002 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290067+0000", 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3915000000000001e-05 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290132+0000", 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5678000000000004e-05 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33544 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7438336~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607935108, 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044115293999999999, 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.851 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33544 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246183+0000", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246185+0000", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0310000000000001e-06 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246191+0000", 2024-04-23T23:38:56.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9449999999999998e-06 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246196+0000", 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5809999999999998e-06 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290170+0000", 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043974040999999998 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290242+0000", 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1627999999999999e-05 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290298+0000", 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6592999999999998e-05 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33546 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7634944~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607914825000002, 2024-04-23T23:38:56.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230141000000001, 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33546 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246203+0000", 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246204+0000", 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246205+0000", 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246211+0000", 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246218+0000", 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4309999999999999e-06 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290330+0000", 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044112116999999999 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290369+0000", 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8989999999999998e-05 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290433+0000", 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4376999999999997e-05 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33547 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 7831552~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:56.859 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607893257000001, 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348783000000003, 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33547 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246225+0000", 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246227+0000", 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8840000000000001e-06 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246233+0000", 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5670000000000002e-06 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246237+0000", 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290463+0000", 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044226201999999999 2024-04-23T23:38:56.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290515+0000", 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.219e-05 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290574+0000", 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8601999999999999e-05 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.863 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33549 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8028160~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607875659000001, 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044460081999999998, 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.865 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33549 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246242+0000", 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246243+0000", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246245+0000", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.933e-06 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246251+0000", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246256+0000", 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:38:56.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290604+0000", 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044348651000000003 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290645+0000", 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0918999999999999e-05 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290702+0000", 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7218e-05 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.868 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33550 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8224768~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607855084999997, 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044557411999999998, 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33550 2024-04-23T23:38:56.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246263+0000", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246265+0000", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.001e-06 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246271+0000", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246275+0000", 2024-04-23T23:38:56.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290727+0000", 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044452211999999998 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290770+0000", 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2685000000000002e-05 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290820+0000", 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0445000000000002e-05 2024-04-23T23:38:56.872 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33551 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8486912~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607825945999998, 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044758132999999999, 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33551 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.873 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246292+0000", 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246293+0000", 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:38:56.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246295+0000", 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2879999999999999e-06 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246306+0000", 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.763e-06 2024-04-23T23:38:56.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290850+0000", 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044544202999999997 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.290940+0000", 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9784000000000006e-05 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291050+0000", 2024-04-23T23:38:56.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110455 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33552 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8683520~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607805270999997, 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044962729999999999, 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.877 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33552 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246316+0000", 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.914e-06 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246322+0000", 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2149999999999998e-06 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246329+0000", 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2559999999999999e-06 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291094+0000", 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044765144 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291180+0000", 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6613999999999994e-05 2024-04-23T23:38:56.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291275+0000", 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5119999999999997e-05 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33553 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 8880128~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.607782471, 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045100073999999997, 2024-04-23T23:38:56.881 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33553 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246336+0000", 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247303+0000", 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00096741000000000004 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247308+0000", 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3210000000000004e-06 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247322+0000", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3403e-05 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247340+0000", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8383999999999999e-05 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291318+0000", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043977780000000001 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291372+0000", 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3696000000000002e-05 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291436+0000", 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4079999999999996e-05 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33555 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9076736~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.606766049999997, 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044230611000000003, 2024-04-23T23:38:56.885 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33555 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247352+0000", 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247355+0000", 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3190000000000002e-06 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247361+0000", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247366+0000", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8180000000000003e-06 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291476+0000", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044109560999999999 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291520+0000", 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4833000000000003e-05 2024-04-23T23:38:56.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291583+0000", 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2148000000000002e-05 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33556 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9273344~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.606746395000002, 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044339121000000002, 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.889 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33556 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247372+0000", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000005e-07 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247379+0000", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9999999999999999e-06 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247385+0000", 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:38:56.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247402+0000", 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7261e-05 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291608+0000", 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044205981999999998 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291648+0000", 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9761000000000001e-05 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291711+0000", 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2923999999999996e-05 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33557 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9469952~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.606707299999997, 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044440153000000003, 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33557 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247411+0000", 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247414+0000", 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4710000000000001e-06 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247421+0000", 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9009999999999997e-06 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247425+0000", 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7480000000000001e-06 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291735+0000", 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044309175999999999 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291798+0000", 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3115999999999997e-05 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291851+0000", 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226999999999997e-05 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33559 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9666560~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.606687508999997, 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044558629000000002, 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33559 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247430+0000", 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247431+0000", 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247432+0000", 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6220000000000001e-06 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247438+0000", 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8760000000000002e-06 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247444+0000", 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291883+0000", 2024-04-23T23:38:56.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044439369999999999 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291930+0000", 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6916999999999998e-05 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.291989+0000", 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8958e-05 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33560 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 9863168~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.606668910000003, 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044661632, 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33560 2024-04-23T23:38:56.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247449+0000", 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247451+0000", 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247473+0000", 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2456e-05 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247478+0000", 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292019+0000", 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044540217 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292057+0000", 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8571000000000001e-05 2024-04-23T23:38:56.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292111+0000", 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3609000000000001e-05 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33561 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 10059776~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.606632582000003, 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044754011000000003, 2024-04-23T23:38:56.906 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33561 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247485+0000", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249473+0000", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019870920000000002 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249478+0000", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.096e-06 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249492+0000", 2024-04-23T23:38:56.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4416000000000001e-05 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249499+0000", 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1199999999999996e-06 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292139+0000", 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042639415999999999 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292186+0000", 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7790999999999997e-05 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.292239+0000", 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.308e-05 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33571 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11304960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:56.910 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.604450620000001, 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043903286999999999, 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33571 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249667+0000", 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249668+0000", 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249669+0000", 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.319e-06 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249672+0000", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-06 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249675+0000", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4380000000000002e-06 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293464+0000", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043789280999999999 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293527+0000", 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3547000000000007e-05 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293571+0000", 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3302e-05 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33572 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11501568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.604440525999998, 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044073809999999998, 2024-04-23T23:38:56.914 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33572 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249677+0000", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249678+0000", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.03e-07 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249684+0000", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249687+0000", 2024-04-23T23:38:56.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.247e-06 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249690+0000", 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5390000000000002e-06 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293606+0000", 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043916086 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293679+0000", 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2992999999999997e-05 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293751+0000", 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2287999999999996e-05 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33574 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11698176~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.604424754, 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044281502, 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.918 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33574 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249693+0000", 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4200000000000002e-07 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1060000000000001e-06 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249701+0000", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293795+0000", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044094911000000001 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293888+0000", 2024-04-23T23:38:56.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2524999999999999e-05 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293975+0000", 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6800999999999998e-05 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33575 3.1c 3:3db6bb16:::rbd_data.1194fcca93b1.0000000000000000:d [read 11894784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.604414609999999, 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044471260999999998, 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:38:56.922 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33575 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249703+0000", 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:38:56.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251494+0000", 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017901200000000001 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251497+0000", 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.698e-06 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251505+0000", 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3329999999999999e-06 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251510+0000", 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2340000000000002e-06 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294017+0000", 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042507511999999997 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294091+0000", 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3831999999999994e-05 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:38:56.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294175+0000", 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3531999999999999e-05 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:38:56.926 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:56.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:38:56.928 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone38 from 0x1cca053 (overlap 0x1175f01) to 0x0 2024-04-23T23:38:56.928 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:56.939+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:56.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:38:57.020 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-04-23T23:38:57.028 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:57.040+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:57.051 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:57.051 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:57.052 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:38:57.052 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:57.061 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:38:57.111 INFO:teuthology.orchestra.run.smithi077.stdout:4774 punch from 0xa3500e to 0xa3df03, (0x8ef5 bytes) 2024-04-23T23:38:57.115 INFO:teuthology.orchestra.run.smithi077.stdout:4775 trunc from 0x1cca053 to 0x1572a16 2024-04-23T23:38:57.128 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:57.140+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:57.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:38:57.221 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:38:57.221 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:38:57.221 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:38:57.221 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:38:57.222 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:38:57.230 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:57.241+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:57.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:38:57.311 INFO:teuthology.orchestra.run.smithi077.stdout:4776 write 0xd5fe2b8 thru 0xd6025e5 (0x432e bytes) 2024-04-23T23:38:57.316 INFO:teuthology.orchestra.run.smithi077.stdout:4777 punch from 0x632e403 to 0x63338ac, (0x54a9 bytes) 2024-04-23T23:38:57.316 INFO:teuthology.orchestra.run.smithi077.stdout:4779 write 0x68e79b5 thru 0x68e9b98 (0x21e4 bytes) 2024-04-23T23:38:57.330 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:57.343+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:57.335 INFO:teuthology.orchestra.run.smithi077.stdout:4780 trunc from 0xd6025e6 to 0x419b958 2024-04-23T23:38:57.350 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:57.351 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:57.368 INFO:teuthology.orchestra.run.smithi077.stdout:4781 write 0x6af93a3 thru 0x6aff88f (0x64ed bytes) 2024-04-23T23:38:57.380 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:57.380 INFO:teuthology.orchestra.run.smithi077.stdout:4784 read 0x391df0f thru 0x392365f (0x5751 bytes) 2024-04-23T23:38:57.380 INFO:teuthology.orchestra.run.smithi077.stdout:4785 punch from 0x43e1dd to 0x43ef14, (0xd37 bytes) 2024-04-23T23:38:57.381 INFO:teuthology.orchestra.run.smithi077.stdout:4786 trunc from 0x6aff890 to 0x53015b1 2024-04-23T23:38:57.385 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:57.386 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:57.396 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:57.397 INFO:teuthology.orchestra.run.smithi077.stdout:4788 write 0x3ad778c thru 0x3adf04d (0x78c2 bytes) 2024-04-23T23:38:57.405 INFO:teuthology.orchestra.run.smithi077.stdout:4791 read 0x3b237d8 thru 0x3b2674f (0x2f78 bytes) 2024-04-23T23:38:57.406 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:57.406 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:57.407 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:57.407 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:57.407 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:38:57.415 INFO:teuthology.orchestra.run.smithi077.stdout:4792 write 0x8f0d07d thru 0x8f0f43b (0x23bf bytes) 2024-04-23T23:38:57.419 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:38:57.422 INFO:teuthology.orchestra.run.smithi077.stdout:4794 read 0x52902ee thru 0x5297b21 (0x7834 bytes) 2024-04-23T23:38:57.428 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:57.428 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:57.429 INFO:teuthology.orchestra.run.smithi077.stdout:4795 write 0x9a2e044 thru 0x9a35e6d (0x7e2a bytes) 2024-04-23T23:38:57.432 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:57.443+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:57.438 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:57.438 INFO:teuthology.orchestra.run.smithi077.stdout:4797 punch from 0x6988c0d to 0x6997c0f, (0xf002 bytes) 2024-04-23T23:38:57.438 INFO:teuthology.orchestra.run.smithi077.stdout:4798 read 0x4a885a thru 0x4af589 (0x6d30 bytes) 2024-04-23T23:38:57.439 INFO:teuthology.orchestra.run.smithi077.stdout:4799 clone 40 order 19 su 131072 sc 13 2024-04-23T23:38:57.448 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:57.448 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:57.466 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:57.466 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:57.483 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:57.483 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:57.486 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:38:57.487 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:38:57.527 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:57.527 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:57.533 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:57.545+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:57.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:38:57.634 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:57.646+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:57.677 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:57.677 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:57.686 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:38:57.734 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:57.746+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:57.790 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:57.790 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:57.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:38:57.840 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:38:57.852+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:38:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:38:57.935 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:57.946+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:57.939 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone39 from 0x9a35e6e (overlap 0x1572a16) to 0x894408 2024-04-23T23:38:57.951 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:57.951 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:57.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:38:58.035 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:38:58.047+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:38:58.108 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.108 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:38:58.136 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:58.148+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:58.238 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:58.250+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:58.238 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-04-23T23:38:58.240 INFO:teuthology.orchestra.run.smithi077.stdout:4800 write 0x870d3ec thru 0x87169a8 (0x95bd bytes) 2024-04-23T23:38:58.240 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.240 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.250 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:38:58.254 INFO:teuthology.orchestra.run.smithi077.stdout:4801 writesame 0xaa165dd thru 0xaa22b72 data_size 0x7(0xc596 bytes) 2024-04-23T23:38:58.254 INFO:teuthology.orchestra.run.smithi077.stdout:4803 write 0xa938815 thru 0xa94582b (0xd017 bytes) 2024-04-23T23:38:58.258 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:58.258 INFO:teuthology.orchestra.run.smithi077.stdout:4805 clone 41 order 25 su 1048576 sc 7 2024-04-23T23:38:58.339 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:58.351+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:58.353 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.353 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:38:58.446 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:58.458+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:58.504 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.504 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.512 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:38:58.541 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:58.553+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:58.642 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:58.654+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:58.655 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.655 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.664 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:38:58.748 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:58.760+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:58.806 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.807 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.815 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:38:58.856 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:58.868+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:58.943 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:58.955+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:58.957 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone40 from 0xaa22b73 (overlap 0x9a35e6e) to 0x0 2024-04-23T23:38:58.966 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:58.967 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:58.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:38:59.020 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 7] out_osds: [3, 4, 0] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:38:59.020 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:38:59.020 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-04-23T23:38:59.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-04-23T23:38:59.064 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:38:59.076+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:38:59.146 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:59.158+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:59.168 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:59.168 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:59.181 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:38:59.247 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:38:59.259+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:38:59.336 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:59.336 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:59.345 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:38:59.349 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-04-23T23:38:59.370 INFO:teuthology.orchestra.run.smithi077.stdout:4806 read 0xa06e663 thru 0xa0728f9 (0x4297 bytes) 2024-04-23T23:38:59.371 INFO:teuthology.orchestra.run.smithi077.stdout:4809 write 0x6be751 thru 0x6c6170 (0x7a20 bytes) 2024-04-23T23:38:59.388 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:59.400+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:59.397 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:38:59.409+0000 7f7374a68640 -1 mon.a@0(leader).osd e93 definitely_dead 0 2024-04-23T23:38:59.449 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:59.461+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:59.458 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:59.458 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:59.463 INFO:teuthology.orchestra.run.smithi077.stdout:4810 read 0x2611cee thru 0x2619f0b (0x821e bytes) 2024-04-23T23:38:59.463 INFO:teuthology.orchestra.run.smithi077.stdout:4811 punch from 0x3d095fb to 0x3d16670, (0xd075 bytes) 2024-04-23T23:38:59.463 INFO:teuthology.orchestra.run.smithi077.stdout:4812 read 0x59e97c6 thru 0x59f4168 (0xa9a3 bytes) 2024-04-23T23:38:59.463 INFO:teuthology.orchestra.run.smithi077.stdout:4813 read 0x462e548 thru 0x4633ba5 (0x565e bytes) 2024-04-23T23:38:59.463 INFO:teuthology.orchestra.run.smithi077.stdout:4815 read 0x1bf4964 thru 0x1bffcae (0xb34b bytes) 2024-04-23T23:38:59.463 INFO:teuthology.orchestra.run.smithi077.stdout:4816 read 0x3b28b0c thru 0x3b378d5 (0xedca bytes) 2024-04-23T23:38:59.467 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:38:59.474 INFO:teuthology.orchestra.run.smithi077.stdout:4817 trunc from 0xaa22b73 to 0x17a71bf 2024-04-23T23:38:59.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:38:59.551 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:59.563+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:59.582 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.596 INFO:teuthology.orchestra.run.smithi077.stdout:4819 trunc from 0x17a71bf to 0xd07caff 2024-04-23T23:38:59.601 INFO:teuthology.orchestra.run.smithi077.stdout:4821 read 0x80a268e thru 0x80a8e0e (0x6781 bytes) 2024-04-23T23:38:59.602 INFO:teuthology.orchestra.run.smithi077.stdout:4822 punch from 0xac162cf to 0xac1ad37, (0x4a68 bytes) 2024-04-23T23:38:59.602 INFO:teuthology.orchestra.run.smithi077.stdout:4823 read 0x61037fc thru 0x610dfe1 (0xa7e6 bytes) 2024-04-23T23:38:59.602 INFO:teuthology.orchestra.run.smithi077.stdout:4825 read 0x4699160 thru 0x469e304 (0x51a5 bytes) 2024-04-23T23:38:59.602 INFO:teuthology.orchestra.run.smithi077.stdout:4826 read 0xcc23dcb thru 0xcc243ca (0x600 bytes) 2024-04-23T23:38:59.603 INFO:teuthology.orchestra.run.smithi077.stdout:4827 read 0x901afbd thru 0x902248e (0x74d2 bytes) 2024-04-23T23:38:59.603 INFO:teuthology.orchestra.run.smithi077.stdout:4828 punch from 0xb133c91 to 0xb1364e6, (0x2855 bytes) 2024-04-23T23:38:59.603 INFO:teuthology.orchestra.run.smithi077.stdout:4830 read 0x5173bcd thru 0x517dd6a (0xa19e bytes) 2024-04-23T23:38:59.610 INFO:teuthology.orchestra.run.smithi077.stdout:4832 write 0xec007d2 thru 0xec04952 (0x4181 bytes) 2024-04-23T23:38:59.630 INFO:teuthology.orchestra.run.smithi077.stdout:4835 trunc from 0xec04953 to 0x1543054 2024-04-23T23:38:59.632 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:38:59.632 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:38:59.642 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:38:59.643 INFO:teuthology.orchestra.run.smithi077.stdout:4836 trunc from 0x1543054 to 0x2be1243 2024-04-23T23:38:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:38:59.647 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:38:59.660 INFO:teuthology.orchestra.run.smithi077.stdout:4837 write 0x847694f thru 0x84794ef (0x2ba1 bytes) 2024-04-23T23:38:59.667 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:38:59.668 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:38:59.671 INFO:teuthology.orchestra.run.smithi077.stdout:4838 write 0xc2fd7dd thru 0xc30a36c (0xcb90 bytes) 2024-04-23T23:38:59.673 INFO:teuthology.orchestra.run.smithi077.stdout:4839 read 0xb2fc3f0 thru 0xb302e7f (0x6a90 bytes) 2024-04-23T23:38:59.673 INFO:teuthology.orchestra.run.smithi077.stdout:4840 write 0x2e04e76 thru 0x2e0c22c (0x73b7 bytes) 2024-04-23T23:38:59.675 INFO:teuthology.orchestra.run.smithi077.stdout:4841 write 0xa4f3221 thru 0xa4ffe8c (0xcc6c bytes) 2024-04-23T23:38:59.676 INFO:teuthology.orchestra.run.smithi077.stdout:4842 writesame 0x3af0124 thru 0x3af293a data_size 0x1(0x2817 bytes) 2024-04-23T23:38:59.681 INFO:teuthology.orchestra.run.smithi077.stdout:4843 read 0x7c4d307 thru 0x7c54e10 (0x7b0a bytes) 2024-04-23T23:38:59.682 INFO:teuthology.orchestra.run.smithi077.stdout:4844 punch from 0x1c4bd27 to 0x1c4effa, (0x32d3 bytes) 2024-04-23T23:38:59.682 INFO:teuthology.orchestra.run.smithi077.stdout:4848 read 0x626c659 thru 0x626df9d (0x1945 bytes) 2024-04-23T23:38:59.683 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:59.695+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:59.687 INFO:teuthology.orchestra.run.smithi077.stdout:4849 trunc from 0xc30a36d to 0x819b82d 2024-04-23T23:38:59.687 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:38:59.687 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:38:59.688 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:38:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:4850 writesame 0x27a314 thru 0x27f026 data_size 0x1(0x4d13 bytes) 2024-04-23T23:38:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:38:59.708 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:38:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:4851 writesame 0xb6eb186 thru 0xb6f4e3e data_size 0x1(0x9cb9 bytes) 2024-04-23T23:38:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:4855 trunc from 0xb6f4e3f to 0x9e234e8 2024-04-23T23:38:59.727 INFO:teuthology.orchestra.run.smithi077.stdout:4857 writesame 0x4a01722 thru 0x4a0afe6 data_size 0x25(0x98c5 bytes) 2024-04-23T23:38:59.729 INFO:teuthology.orchestra.run.smithi077.stdout:4858 read 0x51d36c6 thru 0x51d7f90 (0x48cb bytes) 2024-04-23T23:38:59.729 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:38:59.730 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:38:59.730 INFO:teuthology.orchestra.run.smithi077.stdout:4859 read 0x4f5b180 thru 0x4f5b56f (0x3f0 bytes) 2024-04-23T23:38:59.730 INFO:teuthology.orchestra.run.smithi077.stdout:4860 read 0x56af28f thru 0x56b0873 (0x15e5 bytes) 2024-04-23T23:38:59.735 INFO:teuthology.orchestra.run.smithi077.stdout:4862 trunc from 0x9e234e8 to 0x6202cc6 2024-04-23T23:38:59.742 INFO:teuthology.orchestra.run.smithi077.stdout:4864 read 0x729549 thru 0x72a9a3 (0x145b bytes) 2024-04-23T23:38:59.743 INFO:teuthology.orchestra.run.smithi077.stdout:4865 read 0x2ac94c thru 0x2b7d39 (0xb3ee bytes) 2024-04-23T23:38:59.751 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:38:59.762+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:38:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:38:59.757 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:38:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:4866 write 0xc470247 thru 0xc472fc9 (0x2d83 bytes) 2024-04-23T23:38:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:4867 punch from 0x474085c to 0x47435a3, (0x2d47 bytes) 2024-04-23T23:38:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:4868 write 0x44e0eb8 thru 0x44e3572 (0x26bb bytes) 2024-04-23T23:38:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:4869 punch from 0x456437d to 0x4572116, (0xdd99 bytes) 2024-04-23T23:38:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:4871 write 0xda2d48f thru 0xda34dd0 (0x7942 bytes) 2024-04-23T23:38:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:4872 read 0xb8ac5d6 thru 0xb8b9f2b (0xd956 bytes) 2024-04-23T23:38:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:4873 read 0x55ad5d thru 0x568290 (0xd534 bytes) 2024-04-23T23:38:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:38:59.778 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:38:59.781 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:38:59.782 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:38:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:4874 trunc from 0xda34dd1 to 0x3a39645 2024-04-23T23:38:59.794 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:59.794 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:59.794 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:38:59.795 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:4877 writesame 0x43b46df thru 0x43be27b data_size 0x31(0x9b9d bytes) 2024-04-23T23:38:59.804 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:38:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:4878 trunc from 0x43be27c to 0x7a89fb6 2024-04-23T23:38:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:4882 trunc from 0x7a89fb6 to 0xa1b7f7 2024-04-23T23:38:59.855 INFO:teuthology.orchestra.run.smithi077.stdout:4884 writesame 0xc30a625 thru 0xc30fcb6 data_size 0x7(0x5692 bytes) 2024-04-23T23:38:59.856 INFO:teuthology.orchestra.run.smithi077.stdout:4885 write 0x92f8c91 thru 0x9305ad6 (0xce46 bytes) 2024-04-23T23:38:59.858 INFO:teuthology.orchestra.run.smithi077.stdout:4886 read 0x1bd538e thru 0x1be292d (0xd5a0 bytes) 2024-04-23T23:38:59.858 INFO:teuthology.orchestra.run.smithi077.stdout:4887 read 0x628712 thru 0x6383a0 (0xfc8f bytes) 2024-04-23T23:38:59.859 INFO:teuthology.orchestra.run.smithi077.stdout:4888 read 0x1037435 thru 0x1044fc4 (0xdb90 bytes) 2024-04-23T23:38:59.859 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.859 INFO:teuthology.orchestra.run.smithi077.stdout:4890 read 0xcfa457 thru 0xcfc3a4 (0x1f4e bytes) 2024-04-23T23:38:59.859 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.860 INFO:teuthology.orchestra.run.smithi077.stdout:4892 read 0xb4848d6 thru 0xb4852da (0xa05 bytes) 2024-04-23T23:38:59.860 INFO:teuthology.orchestra.run.smithi077.stdout:4894 writesame 0x51b93b8 thru 0x51c27ac data_size 0x7(0x93f5 bytes) 2024-04-23T23:38:59.863 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:38:59.869 INFO:teuthology.orchestra.run.smithi077.stdout:4897 trunc from 0xc30fcb7 to 0x7add38d 2024-04-23T23:38:59.876 INFO:teuthology.orchestra.run.smithi077.stderr:marked in osd.4. 2024-04-23T23:38:59.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:38:59.890 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:38:59.901+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:38:59.892 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-04-23T23:38:59.952 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:38:59.964+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:38:59.953 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:38:59.953 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:38:59.953 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:38:59.953 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:38:59.953 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:38:59.962 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:00.053 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:00.065+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107773 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2105344~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.882696492, 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046381483000000001, 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.107 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107773 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237470+0000", 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017644589999999999 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237474+0000", 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2069999999999997e-06 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237484+0000", 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6549999999999999e-06 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237493+0000", 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7539999999999995e-06 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.281924+0000", 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044431154 2024-04-23T23:39:00.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.282000+0000", 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6018000000000003e-05 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.282087+0000", 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7236000000000003e-05 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.111 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107783 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2744320~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8807230160000001, 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046491561000000001, 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107783 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237682+0000", 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.227e-06 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237687+0000", 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6629999999999998e-06 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237692+0000", 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4009999999999999e-06 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284013+0000", 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046320975 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284087+0000", 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4148999999999998e-05 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284171+0000", 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3796999999999997e-05 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107784 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2768896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8807045310000001, 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046693967000000003, 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107784 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239473+0000", 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017752600000000001 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239478+0000", 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9010000000000002e-06 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239488+0000", 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0665999999999999e-05 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239496+0000", 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4780000000000002e-06 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284207+0000", 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044711526000000001 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284291+0000", 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4074999999999997e-05 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284392+0000", 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100061 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.119 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107792 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3227648~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8787287519999998, 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046378053000000002, 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107792 2024-04-23T23:39:00.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239674+0000", 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7999999999999996e-07 2024-04-23T23:39:00.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239681+0000", 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3699999999999997e-06 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239688+0000", 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8430000000000004e-06 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239693+0000", 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2329999999999997e-06 2024-04-23T23:39:00.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.285868+0000", 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046175051000000002 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.285952+0000", 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3591999999999995e-05 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286051+0000", 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9483999999999998e-05 2024-04-23T23:39:00.123 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107793 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3252224~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8787016799999998, 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046545097000000001, 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.124 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107793 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239701+0000", 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239703+0000", 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239710+0000", 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7410000000000003e-06 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239715+0000", 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.592e-06 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286088+0000", 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046372505000000001 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286162+0000", 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4164000000000003e-05 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286246+0000", 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3689000000000005e-05 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107794 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3276800~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8786805630000001, 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046739817000000003, 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.128 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107794 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239724+0000", 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9630000000000001e-06 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239731+0000", 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9530000000000002e-06 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239736+0000", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1120000000000004e-06 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286283+0000", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046547036999999999 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286364+0000", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0463999999999994e-05 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286461+0000", 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7864999999999999e-05 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107795 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3432448~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.878659554, 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046961375, 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107795 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241472+0000", 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017296519999999999 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241477+0000", 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4769999999999997e-06 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241487+0000", 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.047e-05 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241494+0000", 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2690000000000002e-06 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286513+0000", 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045018247999999997 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286608+0000", 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4949000000000002e-05 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286704+0000", 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6310000000000005e-05 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107802 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3735552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8767381940000001, 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046511841999999998, 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107802 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241666+0000", 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9800000000000001e-06 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241673+0000", 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9269999999999999e-06 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241679+0000", 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3689999999999998e-06 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.287995+0000", 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046316607000000003 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288078+0000", 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3036999999999998e-05 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288176+0000", 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7441000000000004e-05 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107803 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3891200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.876715447, 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046680767999999997, 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107803 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:00.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3799999999999997e-07 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241689+0000", 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1129999999999999e-06 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241696+0000", 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3119999999999999e-06 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241702+0000", 2024-04-23T23:39:00.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0499999999999997e-06 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288212+0000", 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046509861 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288285+0000", 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3668e-05 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288367+0000", 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2225999999999995e-05 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.143 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107804 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3915776~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.87669335, 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046875829000000001, 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107804 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241715+0000", 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9830000000000001e-06 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241722+0000", 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9469999999999997e-06 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241727+0000", 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999999e-06 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288402+0000", 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046675109999999999 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288487+0000", 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4648000000000007e-05 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288585+0000", 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7578000000000007e-05 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107805 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3940352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.87666793, 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047048419000000001, 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107805 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243472+0000", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017380519999999999 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243478+0000", 2024-04-23T23:39:00.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243488+0000", 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0267e-05 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243495+0000", 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3690000000000001e-06 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288621+0000", 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04512567 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288698+0000", 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7307999999999999e-05 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288783+0000", 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4457999999999997e-05 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107812 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4374528~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8747562680000001, 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046449952000000003, 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107812 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243648+0000", 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243654+0000", 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4999999999999999e-06 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243658+0000", 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4449999999999998e-06 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.289986+0000", 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046327765 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290030+0000", 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4474999999999997e-05 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290096+0000", 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5497e-05 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107813 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4399104~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8747381519999999, 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046628018, 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107813 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243666+0000", 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243672+0000", 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7039999999999999e-06 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243677+0000", 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.814e-06 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290131+0000", 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046454349999999998 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290205+0000", 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4021000000000002e-05 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290292+0000", 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6794999999999998e-05 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.159 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107814 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4423680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8747180619999999, 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046737101000000003, 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107814 2024-04-23T23:39:00.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243686+0000", 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243692+0000", 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6520000000000003e-06 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243697+0000", 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6240000000000001e-06 2024-04-23T23:39:00.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290321+0000", 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046624684999999999 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290367+0000", 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5395000000000002e-05 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290421+0000", 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4432999999999999e-05 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107815 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4579328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8746995650000002, 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046922708, 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107815 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243705+0000", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.035e-06 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243711+0000", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4060000000000002e-06 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243716+0000", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290465+0000", 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046748513999999998 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290542+0000", 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7871e-05 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290625+0000", 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2888999999999999e-05 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107816 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4603904~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8746697299999999, 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047028900999999998, 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107816 2024-04-23T23:39:00.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243733+0000", 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8899999999999999e-07 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243739+0000", 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2190000000000001e-06 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243746+0000", 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243751+0000", 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8600000000000001e-06 2024-04-23T23:39:00.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290655+0000", 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046904121999999999 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290706+0000", 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1459000000000003e-05 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290761+0000", 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4979999999999999e-05 2024-04-23T23:39:00.171 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107817 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4628480~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.874640511, 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047190263000000003, 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107817 2024-04-23T23:39:00.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245470+0000", 2024-04-23T23:39:00.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017088730000000001 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245475+0000", 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245484+0000", 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9830000000000002e-06 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245490+0000", 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5409999999999997e-06 2024-04-23T23:39:00.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290795+0000", 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045305177000000002 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290869+0000", 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3708000000000006e-05 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290952+0000", 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2787000000000005e-05 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107824 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5062656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8727579319999998, 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046406714000000002, 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107824 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245645+0000", 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245647+0000", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9479999999999998e-06 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245652+0000", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5210000000000002e-06 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245657+0000", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.578e-06 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.291948+0000", 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046291111000000003 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.291997+0000", 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9466999999999999e-05 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292051+0000", 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3671000000000002e-05 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107825 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5087232~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8727395529999997, 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046582330999999998, 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107825 2024-04-23T23:39:00.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:00.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245665+0000", 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7e-06 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245670+0000", 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3820000000000003e-06 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245675+0000", 2024-04-23T23:39:00.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5950000000000001e-06 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292086+0000", 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046411263000000001 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292159+0000", 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3072999999999996e-05 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292245+0000", 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5938000000000003e-05 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.183 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107826 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5111808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.8727213809999999, 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046687909999999999, 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107826 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:00.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247474+0000", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017929739999999999 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:00.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247479+0000", 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9320000000000004e-06 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247490+0000", 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1783000000000001e-05 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247498+0000", 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7889999999999995e-06 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:00.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292273+0000", 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044775108000000001 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292316+0000", 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2836000000000001e-05 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292369+0000", 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2488000000000003e-05 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:00.187 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:00.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:00.189 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:00.201+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:00.289 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:00.301+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:00.292 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:00.292 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:00.292 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:00.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:00.389 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:00.402+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:00.402 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:00.402 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:00.402 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:00.402 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:00.402 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:00.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:00.494 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:00.507+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:00.554 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:00.554 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:00.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:00.554 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:00.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.554 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456516461999996, 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:00.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456502817000001, 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:00.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:00.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456489766999994, 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.563 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:00.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:00.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.567 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456478747999995, 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:00.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:00.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456469673000001, 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:00.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:00.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456457728999993, 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.456448617999996, 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.580 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.454803245999997, 2024-04-23T23:39:00.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.588 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.454790997000003, 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:00.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:00.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450612403999997, 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:00.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450600621999996, 2024-04-23T23:39:00.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450590552999998, 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:00.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450578894000003, 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.604 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.607 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450569573999999, 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.608 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450559061999996, 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.615 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450549621999997, 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.619 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450354528999995, 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:00.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450333495999999, 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:00.627 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.450319605999994, 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:00.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:00.631 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 67.847163101000007, 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:00.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:00.636 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:00.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:00.637 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:00.649+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:00.737 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:00.749+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:00.781 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:00.781 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:00.781 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:00.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:00.838 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:00.850+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:00.885 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:39:00.897 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:00.897 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:00.897 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:00.897 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:00.897 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:00.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:00.948 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:00.960+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:01.039 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:01.051+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:01.051 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:01.051 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:01.051 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:01.051 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:01.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 72.668888602999999, 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.052 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:39:01.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:39:01.056 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.670237974999999, 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:39:01.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:01.062 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 42.230584561999997, 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:01.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.068 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90590 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3441664~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.061051007, 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051386827000000003, 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90590 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001684+0000", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001690+0000", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1480000000000003e-06 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001694+0000", 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052909+0000", 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051214519 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052978+0000", 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8738000000000005e-05 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.053068+0000", 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0068000000000006e-05 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90592 3.0 3:06d5799c:::rbd_data.1194f3ed7b42.0000000000000194:head [sparse-read 0~262144] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001738+0000", 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.060993657999999, 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051259080999999998, 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:01.073 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90592 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001738+0000", 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001738+0000", 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001739+0000", 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001741+0000", 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2170000000000001e-06 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001748+0000", 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9789999999999996e-06 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001753+0000", 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9350000000000002e-06 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052904+0000", 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051151230999999998 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052997+0000", 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3257000000000005e-05 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.076 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90651 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3556352~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.057168365000001, 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051409877, 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90651 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.077 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:01.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005566+0000", 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9489999999999999e-06 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005572+0000", 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1179999999999997e-06 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005577+0000", 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7060000000000003e-06 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056808+0000", 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051230879999999999 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056879+0000", 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1261999999999996e-05 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056973+0000", 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4569999999999997e-05 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.080 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90653 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3563520~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.057149244, 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051620653000000002, 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90653 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.081 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005585+0000", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.883e-06 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005591+0000", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005596+0000", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057017+0000", 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051421175999999999 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057094+0000", 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7040999999999996e-05 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057203+0000", 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010935 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90655 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3570688~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.057130594, 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051736068000000003, 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90655 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.085 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005602+0000", 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:01.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005603+0000", 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005609+0000", 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005614+0000", 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6190000000000002e-06 2024-04-23T23:39:01.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057238+0000", 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051623872000000001 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057281+0000", 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3259e-05 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057337+0000", 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6298999999999997e-05 2024-04-23T23:39:01.088 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90662 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3613696~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.055546408, 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051308223, 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.089 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90662 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007186+0000", 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007188+0000", 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.945e-06 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007195+0000", 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007200+0000", 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058336+0000", 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051136231999999997 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058404+0000", 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8613000000000002e-05 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058494+0000", 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9314999999999994e-05 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90663 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3620864~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.055525232999999, 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051524557999999998, 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.093 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90663 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007209+0000", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.813e-06 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007215+0000", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3899999999999998e-06 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007220+0000", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8189999999999999e-06 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058536+0000", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051315847999999997 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058621+0000", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5453999999999999e-05 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058731+0000", 2024-04-23T23:39:01.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010982800000000001 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90664 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3628032~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.055506016000001, 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051704831, 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.097 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90664 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:01.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007228+0000", 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.829e-06 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007233+0000", 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007238+0000", 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5159999999999996e-06 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058770+0000", 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051532124999999998 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058839+0000", 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9356999999999993e-05 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058931+0000", 2024-04-23T23:39:01.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1230000000000006e-05 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90665 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3635200~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.055488123, 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051935859000000001, 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.101 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90665 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008976+0000", 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017323939999999999 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008980+0000", 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0910000000000003e-06 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008987+0000", 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.131e-06 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008992+0000", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6670000000000004e-06 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058981+0000", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049988772000000001 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059068+0000", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7640999999999997e-05 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059180+0000", 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011116300000000001 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90673 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4476928~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009163+0000", 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.053568422, 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051258210999999998, 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.105 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90673 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009163+0000", 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009163+0000", 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009164+0000", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009166+0000", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.08e-06 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009172+0000", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8409999999999996e-06 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009178+0000", 2024-04-23T23:39:01.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.84e-06 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060280+0000", 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051102183000000002 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060349+0000", 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8873000000000003e-05 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060422+0000", 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3034000000000006e-05 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.108 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90674 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4484096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.053548422, 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051442084999999999, 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90674 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.109 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009184+0000", 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009186+0000", 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009192+0000", 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009198+0000", 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:01.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060463+0000", 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051264788999999998 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060543+0000", 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0344000000000002e-05 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060626+0000", 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2576000000000004e-05 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.112 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90675 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4491264~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.053527659, 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051599027999999998, 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90675 2024-04-23T23:39:01.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009205+0000", 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:01.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009207+0000", 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009212+0000", 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7479999999999999e-06 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009218+0000", 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1919999999999996e-06 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060663+0000", 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051445554999999997 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060732+0000", 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9041000000000005e-05 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060803+0000", 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1135000000000002e-05 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.116 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90676 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4498432~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.053508681, 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051792194999999999, 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90676 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009224+0000", 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009225+0000", 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009232+0000", 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5089999999999999e-06 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009238+0000", 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:39:01.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060845+0000", 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051607346999999998 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060927+0000", 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1644999999999995e-05 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061015+0000", 2024-04-23T23:39:01.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8642999999999998e-05 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90677 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4505600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.053488095000001, 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051967037000000001, 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.121 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90677 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010979+0000", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017348070000000001 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010985+0000", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010995+0000", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0370000000000001e-05 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011002+0000", 2024-04-23T23:39:01.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2960000000000001e-06 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061051+0000", 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.050048603999999997 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061134+0000", 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3219000000000004e-05 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061211+0000", 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6724999999999995e-05 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90686 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4562944~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.051479377, 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051380604000000003, 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90686 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011253+0000", 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.34e-07 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011254+0000", 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011258+0000", 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7050000000000001e-06 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011261+0000", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9349999999999999e-06 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062492+0000", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051231454000000003 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062563+0000", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0461000000000002e-05 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062633+0000", 2024-04-23T23:39:01.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0548000000000003e-05 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90687 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4570112~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.051468232, 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051576652000000001, 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.129 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90687 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9299999999999999e-07 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011265+0000", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2109999999999999e-06 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011268+0000", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1470000000000001e-06 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011271+0000", 2024-04-23T23:39:01.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6309999999999999e-06 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062678+0000", 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051406962 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062759+0000", 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0803000000000005e-05 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062840+0000", 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1605000000000002e-05 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90688 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4577280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 10.051458103, 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051748664999999999, 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90688 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.133 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012977+0000", 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017037109999999999 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012982+0000", 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5979999999999999e-06 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013006+0000", 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4300000000000001e-05 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013015+0000", 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4649999999999994e-06 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062879+0000", 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049864420999999999 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062949+0000", 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9728999999999996e-05 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.063022+0000", 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3441000000000004e-05 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.136 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.137 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:01.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:01.141 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:01.153+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:01.241 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:01.241 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:01.241 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:01.241 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:01.253+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:01.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:01.342 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:01.354+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:01.392 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:01.392 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:01.392 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:01.392 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:01.393 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:01.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:01.443 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:01.455+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:01.544 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:01.544 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:01.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:01.544 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 73.146890002000006, 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:01.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:01.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:01.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:01.549 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 64.147194147999997, 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:01.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.467937051, 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.554 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:39:01.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286760106000003, 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:39:01.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.563 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286749776999997, 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:39:01.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:39:01.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286738859000003, 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286710673000002, 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.575 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:01.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:39:01.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.579 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286694967999999, 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:01.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:39:01.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286683985000003, 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.584 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:39:01.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286669613999997, 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.588 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:39:01.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286632275000002, 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.592 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:39:01.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286609955999999, 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:39:01.596 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:39:01.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.600 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286582742, 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:01.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:39:01.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:39:01.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.604 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286562689, 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:01.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:39:01.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286543311999999, 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:39:01.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 32.286523887999998, 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.616 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 28.375174738999998, 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.620 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.167332511000001, 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:39:01.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:39:01.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:39:01.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.999333492000002, 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:01.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:01.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 22.980765260999998, 2024-04-23T23:39:01.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:01.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:01.633 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:01.634 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:01.556+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:01.635 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:01.679 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:01.691+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:01.745 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:01.756+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:01.749 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:01.749 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:01.749 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:01.758 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:01.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:01.846 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:01.857+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:01.911 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:01.911 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:01.918 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:01.918 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:01.918 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:01.918 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:01.919 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:01.929 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:01.929 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:01.934 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:01.942 INFO:teuthology.orchestra.run.smithi077.stdout:4898 writesame 0xebe1fdb thru 0xebed808 data_size 0x19(0xb82e bytes) 2024-04-23T23:39:01.942 INFO:teuthology.orchestra.run.smithi077.stdout:4899 read 0xdb5e4a6 thru 0xdb6553b (0x7096 bytes) 2024-04-23T23:39:01.950 INFO:teuthology.orchestra.run.smithi077.stdout:4900 trunc from 0xebed809 to 0x8c43415 2024-04-23T23:39:01.958 INFO:teuthology.orchestra.run.smithi077.stdout:4901 write 0x29794b2 thru 0x2984443 (0xaf92 bytes) 2024-04-23T23:39:01.958 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:01.959 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:01.959 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:01.959 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:01.959 INFO:teuthology.orchestra.run.smithi077.stdout:4903 writesame 0x1225bc0 thru 0x122d02c data_size 0x5(0x746d bytes) 2024-04-23T23:39:01.965 INFO:teuthology.orchestra.run.smithi077.stdout:4904 trunc from 0x8c43415 to 0x68ac682 2024-04-23T23:39:01.975 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:01.987+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:01.979 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:01.980 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:01.982 INFO:teuthology.orchestra.run.smithi077.stdout:4905 trunc from 0x68ac682 to 0xe25c1a6 2024-04-23T23:39:01.990 INFO:teuthology.orchestra.run.smithi077.stdout:4906 read 0x85d6b58 thru 0x85db0ac (0x4555 bytes) 2024-04-23T23:39:01.999 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:01.999 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:02.003 INFO:teuthology.orchestra.run.smithi077.stdout:4907 trunc from 0xe25c1a6 to 0x367a2ce 2024-04-23T23:39:02.020 INFO:teuthology.orchestra.run.smithi077.stdout:4908 trunc from 0x367a2ce to 0x6ce8547 2024-04-23T23:39:02.021 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:02.021 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:02.026 INFO:teuthology.orchestra.run.smithi077.stdout:4911 read 0x37abac9 thru 0x37b3bb5 (0x80ed bytes) 2024-04-23T23:39:02.030 INFO:teuthology.orchestra.run.smithi077.stdout:4912 trunc from 0x6ce8547 to 0xa00df58 2024-04-23T23:39:02.038 INFO:teuthology.orchestra.run.smithi077.stdout:4913 writesame 0x4714e8f thru 0x471a27c data_size 0x3(0x53ee bytes) 2024-04-23T23:39:02.042 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:02.046 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:02.046 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:02.048 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:02.060+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:02.051 INFO:teuthology.orchestra.run.smithi077.stdout:4914 write 0xcba9c95 thru 0xcbb5441 (0xb7ad bytes) 2024-04-23T23:39:02.053 INFO:teuthology.orchestra.run.smithi077.stdout:4915 write 0xbaf37c7 thru 0xbb02006 (0xe840 bytes) 2024-04-23T23:39:02.056 INFO:teuthology.orchestra.run.smithi077.stdout:4916 punch from 0x106fceb to 0x107c422, (0xc737 bytes) 2024-04-23T23:39:02.056 INFO:teuthology.orchestra.run.smithi077.stdout:4917 write 0x5908be5 thru 0x59129f5 (0x9e11 bytes) 2024-04-23T23:39:02.058 INFO:teuthology.orchestra.run.smithi077.stdout:4918 write 0xa011c61 thru 0xa01d900 (0xbca0 bytes) 2024-04-23T23:39:02.060 INFO:teuthology.orchestra.run.smithi077.stdout:4920 punch from 0xa2c9ed6 to 0xa2d2a09, (0x8b33 bytes) 2024-04-23T23:39:02.060 INFO:teuthology.orchestra.run.smithi077.stdout:4921 writesame 0x5475ead thru 0x5483d01 data_size 0x2f(0xde55 bytes) 2024-04-23T23:39:02.064 INFO:teuthology.orchestra.run.smithi077.stdout:4922 read 0x546b92c thru 0x547a444 (0xeb19 bytes) 2024-04-23T23:39:02.064 INFO:teuthology.orchestra.run.smithi077.stdout:4923 writesame 0x17aaa56 thru 0x17aefb4 data_size 0x2b(0x455f bytes) 2024-04-23T23:39:02.066 INFO:teuthology.orchestra.run.smithi077.stdout:4925 write 0x3ab541e thru 0x3ab65fa (0x11dd bytes) 2024-04-23T23:39:02.067 INFO:teuthology.orchestra.run.smithi077.stdout:4927 write 0x6b27371 thru 0x6b2d86f (0x64ff bytes) 2024-04-23T23:39:02.069 INFO:teuthology.orchestra.run.smithi077.stdout:4928 punch from 0x2a6617e to 0x2a72c48, (0xcaca bytes) 2024-04-23T23:39:02.071 INFO:teuthology.orchestra.run.smithi077.stdout:4930 trunc from 0xcbb5442 to 0xa701bdf 2024-04-23T23:39:02.094 INFO:teuthology.orchestra.run.smithi077.stdout:4931 write 0xd0b92b4 thru 0xd0c5c27 (0xc974 bytes) 2024-04-23T23:39:02.098 INFO:teuthology.orchestra.run.smithi077.stdout:4932 read 0x9b562a9 thru 0x9b61d55 (0xbaad bytes) 2024-04-23T23:39:02.099 INFO:teuthology.orchestra.run.smithi077.stdout:4933 read 0x229acfb thru 0x22aa27e (0xf584 bytes) 2024-04-23T23:39:02.099 INFO:teuthology.orchestra.run.smithi077.stdout:4935 read 0x9b526 thru 0xaa6d4 (0xf1af bytes) 2024-04-23T23:39:02.100 INFO:teuthology.orchestra.run.smithi077.stdout:4936 punch from 0x7d073ed to 0x7d10b6d, (0x9780 bytes) 2024-04-23T23:39:02.100 INFO:teuthology.orchestra.run.smithi077.stdout:4937 punch from 0x76f3f to 0x864b9, (0xf57a bytes) 2024-04-23T23:39:02.100 INFO:teuthology.orchestra.run.smithi077.stdout:4938 write 0x2ad4cb1 thru 0x2ad5dd6 (0x1126 bytes) 2024-04-23T23:39:02.100 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:02.101 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:02.101 INFO:teuthology.orchestra.run.smithi077.stdout:4939 writesame 0xc8bec8f thru 0xc8c5215 data_size 0x2f(0x6587 bytes) 2024-04-23T23:39:02.104 INFO:teuthology.orchestra.run.smithi077.stdout:4940 read 0x6d55f8e thru 0x6d602e8 (0xa35b bytes) 2024-04-23T23:39:02.104 INFO:teuthology.orchestra.run.smithi077.stdout:4942 read 0x5e3f7ca thru 0x5e4bd1b (0xc552 bytes) 2024-04-23T23:39:02.105 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:02.105 INFO:teuthology.orchestra.run.smithi077.stdout:4944 read 0x6058551 thru 0x60652b6 (0xcd66 bytes) 2024-04-23T23:39:02.105 INFO:teuthology.orchestra.run.smithi077.stdout:4945 writesame 0x24ec65d thru 0x24f9010 data_size 0x4e(0xc9b4 bytes) 2024-04-23T23:39:02.107 INFO:teuthology.orchestra.run.smithi077.stdout:4946 write 0xee01c0 thru 0xee0ba2 (0x9e3 bytes) 2024-04-23T23:39:02.108 INFO:teuthology.orchestra.run.smithi077.stdout:4947 read 0xc8e5c1c thru 0xc8f5090 (0xf475 bytes) 2024-04-23T23:39:02.109 INFO:teuthology.orchestra.run.smithi077.stdout:4949 writesame 0xc2362bb thru 0xc237798 data_size 0x1(0x14de bytes) 2024-04-23T23:39:02.112 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:02.116 INFO:teuthology.orchestra.run.smithi077.stdout:4950 trunc from 0xd0c5c28 to 0xeccea36 2024-04-23T23:39:02.122 INFO:teuthology.orchestra.run.smithi077.stdout:4951 write 0x3c210e2 thru 0x3c2f74a (0xe669 bytes) 2024-04-23T23:39:02.123 INFO:teuthology.orchestra.run.smithi077.stdout:4952 read 0xe101759 thru 0xe102cfa (0x15a2 bytes) 2024-04-23T23:39:02.124 INFO:teuthology.orchestra.run.smithi077.stdout:4956 read 0x1e0a92f thru 0x1e0b8bd (0xf8f bytes) 2024-04-23T23:39:02.124 INFO:teuthology.orchestra.run.smithi077.stdout:4957 writesame 0x3b9ca77 thru 0x3ba8654 data_size 0x8b(0xbbde bytes) 2024-04-23T23:39:02.128 INFO:teuthology.orchestra.run.smithi077.stdout:4958 read 0x7472c14 thru 0x747db8b (0xaf78 bytes) 2024-04-23T23:39:02.128 INFO:teuthology.orchestra.run.smithi077.stdout:4960 read 0x100308d thru 0x100bee1 (0x8e55 bytes) 2024-04-23T23:39:02.129 INFO:teuthology.orchestra.run.smithi077.stdout:4961 write 0x1edb8d3 thru 0x1edc089 (0x7b7 bytes) 2024-04-23T23:39:02.130 INFO:teuthology.orchestra.run.smithi077.stdout:4962 write 0xa4e2aa4 thru 0xa4e4be2 (0x213f bytes) 2024-04-23T23:39:02.131 INFO:teuthology.orchestra.run.smithi077.stdout:4964 writesame 0x38a72e8 thru 0x38ab867 data_size 0x4(0x4580 bytes) 2024-04-23T23:39:02.134 INFO:teuthology.orchestra.run.smithi077.stdout:4965 writesame 0x64760d thru 0x6550a5 data_size 0x1(0xda99 bytes) 2024-04-23T23:39:02.153 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:02.165+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:02.157 INFO:teuthology.orchestra.run.smithi077.stdout:4967 trunc from 0xeccea36 to 0xc31f89b 2024-04-23T23:39:02.165 INFO:teuthology.orchestra.run.smithi077.stdout:4968 read 0x78dc9c thru 0x799c4d (0xbfb2 bytes) 2024-04-23T23:39:02.165 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:02.166 INFO:teuthology.orchestra.run.smithi077.stdout:4970 trunc from 0xc31f89b to 0xbc3d655 2024-04-23T23:39:02.174 INFO:teuthology.orchestra.run.smithi077.stdout:4971 write 0x7a5162b thru 0x7a54dd3 (0x37a9 bytes) 2024-04-23T23:39:02.176 INFO:teuthology.orchestra.run.smithi077.stdout:4972 trunc from 0xbc3d655 to 0xbdeda61 2024-04-23T23:39:02.181 INFO:teuthology.orchestra.run.smithi077.stdout:4974 read 0x6973e3b thru 0x698245e (0xe624 bytes) 2024-04-23T23:39:02.189 INFO:teuthology.orchestra.run.smithi077.stdout:4975 writesame 0xca8d6ef thru 0xca97a0f data_size 0x1(0xa321 bytes) 2024-04-23T23:39:02.190 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:02.190 INFO:teuthology.orchestra.run.smithi077.stdout:4977 writesame 0x748441 thru 0x74c563 data_size 0x1d(0x4123 bytes) 2024-04-23T23:39:02.192 INFO:teuthology.orchestra.run.smithi077.stdout:4978 read 0xca583b8 thru 0xca5dfb5 (0x5bfe bytes) 2024-04-23T23:39:02.192 INFO:teuthology.orchestra.run.smithi077.stdout:4981 read 0x600101b thru 0x600a3af (0x9395 bytes) 2024-04-23T23:39:02.192 INFO:teuthology.orchestra.run.smithi077.stdout:4982 write 0x2fb9aeb thru 0x2fbe922 (0x4e38 bytes) 2024-04-23T23:39:02.194 INFO:teuthology.orchestra.run.smithi077.stdout:4984 read 0x2ed0ae2 thru 0x2ed1dce (0x12ed bytes) 2024-04-23T23:39:02.194 INFO:teuthology.orchestra.run.smithi077.stdout:4985 clone 42 order 25 su 1048576 sc 14 2024-04-23T23:39:02.249 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:02.261+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:02.278 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:02.278 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:02.289 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:02.351 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:02.363+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:02.448 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:02.448 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:02.451 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:02.463+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:02.459 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:02.552 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:02.564+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:02.617 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:02.617 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:02.627 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:02.653 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:02.665+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:02.737 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:02.737 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:02.746 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:02.753 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:02.766+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:02.855 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:02.855 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:02.855 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:02.866+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:02.865 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:02.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:39:02.955 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:02.967+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:03.031 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.031 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.041 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:03.081 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:03.093+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:03.158 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:03.170+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:03.195 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.195 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.206 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:03.259 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:03.271+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:03.315 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.315 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.326 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:03.369 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:03.381+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:03.435 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.435 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.444 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:03.485 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:03.497+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:03.549 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.549 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:03.561 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:03.573+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:03.658 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.658 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.661 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:03.673+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:03.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:03.762 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:03.774+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:03.770 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.770 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:03.798 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:39:03.863 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:03.875+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:03.875 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone41 from 0xca97a10 (overlap 0xa1b7f7) to 0x3083fd 2024-04-23T23:39:03.902 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:03.902 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:03.912 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:03.964 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:03.976+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:04.016 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:04.016 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:04.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:04.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:04.066 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:04.078+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:04.166 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:04.178+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:04.177 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:04.177 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:04.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:04.196 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:04.218 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:04.218 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:04.238 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:04.239 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:04.257 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:04.258 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:04.267 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:04.279+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:04.277 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:04.277 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:04.294 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:04.295 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:04.311 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:04.311 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:04.312 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:04.312 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:04.313 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:04.313 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:04.316 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:04.317 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:04.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:04.405 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:04.418+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:04.469 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:04.481+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:04.471 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:04.471 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:04.471 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:04.471 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:04.471 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:04.480 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:04.569 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:04.581+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 76.234236691999996, 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.632 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 67.234540838000001, 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:04.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:04.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 54.555283740999997, 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.640 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:04.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:39:04.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374106796, 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:39:04.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:39:04.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374096467000001, 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:39:04.648 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:04.652 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374085549, 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:39:04.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:39:04.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.656 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374057362999999, 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374041658000003, 2024-04-23T23:39:04.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:39:04.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374030675, 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.664 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.374016304000001, 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.669 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:39:04.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.373978964999999, 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.373956646000003, 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.373929431999997, 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.681 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:04.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:39:04.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:39:04.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.373909378999997, 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.685 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:04.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.373890002000003, 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:04.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 35.373870578000002, 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:04.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:39:04.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.462521428999999, 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:04.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:39:04.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:39:04.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.700 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.254679200999998, 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.086680181999998, 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:04.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:04.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.708 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.068111950999999, 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:04.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:04.712 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:04.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:04.714 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:04.726+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:04.815 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:04.827+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:04.826 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:04.826 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:04.826 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:04.827 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:04.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:04.893 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 7, 4] out_osds: [3, 0] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:04.893 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:04.893 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [1, 2, 5, 6, 7, 4] 2024-04-23T23:39:04.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-04-23T23:39:04.938 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:04.938 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:04.938 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:04.938 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:04.938 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:04.938 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:04.950+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:04.946 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:05.017 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:05.029+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:05.051 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:05.051 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 60.074083575000003, 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:05.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:05.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:05.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.057 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.817004820000001, 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.058 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:05.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:39:05.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:39:05.061 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816962488000001, 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:39:05.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:39:05.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:39:05.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.065 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816939888, 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:39:05.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:39:05.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816914801000003, 2024-04-23T23:39:05.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:39:05.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816893464000003, 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.074 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816872416999999, 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.078 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:39:05.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:05.082 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816667961999997, 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816334562999998, 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:39:05.086 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:05.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:39:05.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:39:05.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.816308667000001, 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:39:05.090 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:39:05.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.815911735, 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:39:05.094 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:39:05.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.815875409, 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.098 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.815487050999998, 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.102 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:05.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:39:05.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:39:05.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.815461650000003, 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.106 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33597 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 9928704~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.813301256000003, 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047304243000000003, 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33597 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249695+0000", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249697+0000", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249704+0000", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5459999999999997e-06 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249709+0000", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296894+0000", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047185605999999998 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296938+0000", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3698000000000001e-05 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.296999+0000", 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0653999999999999e-05 2024-04-23T23:39:05.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.813280652000003, 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.114 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:39:05.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:39:05.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:39:05.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.813260304000003, 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.813240624000002, 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:39:05.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.811237167999998, 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.126 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.1703291580000004, 2024-04-23T23:39:05.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.135 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:05.136 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:05.137 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:05.148+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:05.184 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:39:05.196+0000 7f7374a68640 -1 mon.a@0(leader).osd e99 definitely_dead 0 2024-04-23T23:39:05.237 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:05.249+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:05.279 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:05.279 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:05.279 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:05.288 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:05.372 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:05.384+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:05.430 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:05.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:05.430 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:05.430 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:05.431 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:05.439 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:05.439 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:05.451+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:05.540 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:05.552+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.684908687999993, 2024-04-23T23:39:05.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:05.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:39:05.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.684874487000002, 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.589 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:05.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:39:05.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.684840897000001, 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.684803361999997, 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.598 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:05.602 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.684779825999996, 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:05.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:39:05.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:39:05.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.606 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13805 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 483328~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.683390610000004, 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030292475999999999, 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13805 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911909+0000", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911912+0000", 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.869e-06 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911923+0000", 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0794e-05 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911929+0000", 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942046+0000", 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030116671000000001 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942123+0000", 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7150000000000005e-05 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942201+0000", 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.86e-05 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.683362223000003, 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.611 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:39:05.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:39:05.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:39:05.614 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.683339914000001, 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.615 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.683171690999998, 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.619 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:39:05.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.683122964999995, 2024-04-23T23:39:05.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:05.627 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.683027769999995, 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:39:05.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.631 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682995820000002, 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.632 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:05.636 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682973520000004, 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:39:05.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:39:05.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.640 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682943324000007, 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682783559000001, 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:39:05.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:39:05.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:39:05.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682747939999999, 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.649 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:39:05.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:39:05.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682648658999994, 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:39:05.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:39:05.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:05.657 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682619093, 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.661 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 72.682596669000006, 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:39:05.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:05.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:39:05.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:39:05.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.052579004999998, 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:05.666 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:39:05.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:05.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:05.672 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:05.672 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:05.673 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:05.673 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:05.685+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:05.774 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:05.786+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:05.776 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:05.776 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:05.776 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:05.776 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:05.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:05.797 INFO:teuthology.orchestra.run.smithi077.stderr:marked out osd.7. 2024-04-23T23:39:05.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:39:05.874 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:05.886+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:05.892 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:05.892 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:05.892 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:05.892 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:05.893 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:05.901 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:05.985 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:05.997+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 108.329821282, 2024-04-23T23:39:06.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:06.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:06.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:39:06.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 38.003968272999998, 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.052 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:06.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:39:06.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.504995235999999, 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.058 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:39:06.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106837 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1105920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9119462499999997, 2024-04-23T23:39:06.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043899269999999997, 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106837 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145834+0000", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0699999999999999e-07 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145835+0000", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0210000000000001e-06 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145837+0000", 2024-04-23T23:39:06.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.847e-06 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145840+0000", 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.481e-06 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189637+0000", 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043796663 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189681+0000", 2024-04-23T23:39:06.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4725999999999998e-05 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189733+0000", 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1325000000000001e-05 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106838 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1130496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9119368610000009, 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044012456999999998, 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.067 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106838 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145844+0000", 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.049e-06 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145847+0000", 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8289999999999999e-06 2024-04-23T23:39:06.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145849+0000", 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189761+0000", 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911752999999998 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189804+0000", 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2695999999999999e-05 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189855+0000", 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1431999999999998e-05 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106839 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1155072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:06.071 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9119275120000001, 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044114555999999999, 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106839 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146080+0000", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000227486 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146083+0000", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.258e-06 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146093+0000", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0672999999999999e-05 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146100+0000", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0299999999999999e-06 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189882+0000", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043782284999999997 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189920+0000", 2024-04-23T23:39:06.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8516000000000002e-05 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189967+0000", 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6307999999999998e-05 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106840 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1179648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9116699859999997, 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043966107999999997, 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.075 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106840 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:06.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146117+0000", 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6619999999999999e-06 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146129+0000", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2371000000000001e-05 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146134+0000", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2449999999999998e-06 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189992+0000", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043858000000000001 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190030+0000", 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7755e-05 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190076+0000", 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5538999999999999e-05 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106841 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1335296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9116372580000007, 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044044613000000003, 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.079 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106841 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146143+0000", 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146145+0000", 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.334e-06 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146152+0000", 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4479999999999999e-06 2024-04-23T23:39:06.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146156+0000", 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7509999999999999e-06 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190099+0000", 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043942795999999999 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190140+0000", 2024-04-23T23:39:06.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0813999999999999e-05 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190187+0000", 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6974999999999997e-05 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106842 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1359872~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9116168309999999, 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044137033999999999, 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.083 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106842 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:06.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147472+0000", 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0013091859999999999 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147475+0000", 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3739999999999998e-06 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147487+0000", 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1212e-05 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147494+0000", 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1459999999999999e-06 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190215+0000", 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042721228999999999 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190254+0000", 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9161e-05 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190300+0000", 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5726000000000002e-05 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106855 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2072576~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9099534039999995, 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043925840000000001, 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.087 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106855 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147827+0000", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147829+0000", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7010000000000001e-06 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147837+0000", 2024-04-23T23:39:06.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7910000000000005e-06 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147843+0000", 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9560000000000002e-06 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191668+0000", 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043824701000000001 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191708+0000", 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0371999999999999e-05 2024-04-23T23:39:06.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191752+0000", 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3792999999999999e-05 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106856 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2097152~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9099289010000007, 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044011869000000002, 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.091 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106856 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7599999999999997e-07 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147853+0000", 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1780000000000002e-06 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147860+0000", 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5019999999999998e-06 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147865+0000", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191777+0000", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911126000000002 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191819+0000", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1990000000000003e-05 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191863+0000", 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3995999999999997e-05 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106857 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9099075780000003, 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044095387999999999, 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106857 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147873+0000", 2024-04-23T23:39:06.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.82e-07 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147874+0000", 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147881+0000", 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.392e-06 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147886+0000", 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9389999999999996e-06 2024-04-23T23:39:06.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191884+0000", 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043998430999999998 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191922+0000", 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7339000000000003e-05 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191967+0000", 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5785000000000003e-05 2024-04-23T23:39:06.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106858 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2277376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9098874549999998, 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044206352999999997, 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106858 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.099 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149473+0000", 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001580733 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149477+0000", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149488+0000", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0891e-05 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149495+0000", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2289999999999997e-06 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191990+0000", 2024-04-23T23:39:06.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042494707999999999 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192048+0000", 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7615000000000003e-05 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192098+0000", 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0915999999999998e-05 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.102 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106873 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3170304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9079472840000005, 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043985420999999997, 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106873 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149833+0000", 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999998e-07 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149834+0000", 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.15e-06 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149837+0000", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9390000000000002e-06 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149839+0000", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5739999999999998e-06 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193731+0000", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043891442000000003 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193770+0000", 2024-04-23T23:39:06.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9236999999999997e-05 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193818+0000", 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7839000000000001e-05 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106874 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3194880~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9079376129999996, 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044084569999999997, 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.106 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106874 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149843+0000", 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2600000000000001e-07 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149846+0000", 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.366e-06 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149851+0000", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999997e-06 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193842+0000", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043991808 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193880+0000", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7296999999999999e-05 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193927+0000", 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6864999999999999e-05 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106875 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3219456~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9079238420000006, 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044177196000000002, 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106875 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149940+0000", 2024-04-23T23:39:06.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4321999999999997e-05 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149942+0000", 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.26e-06 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149948+0000", 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9190000000000004e-06 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149952+0000", 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7560000000000001e-06 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193948+0000", 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043995819999999998 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193985+0000", 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6798999999999998e-05 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194033+0000", 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999998e-05 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106876 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3244032~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9078206669999993, 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044183060000000003, 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106876 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151472+0000", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001513316 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151481+0000", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6829999999999997e-06 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151490+0000", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8929999999999994e-06 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151496+0000", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8690000000000001e-06 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194058+0000", 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042562068000000002 2024-04-23T23:39:06.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194095+0000", 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7336000000000003e-05 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194142+0000", 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6894999999999997e-05 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106886 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3883008~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:06.117 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9060903650000007, 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043926192000000003, 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106886 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4600000000000001e-07 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151691+0000", 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.277e-06 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151694+0000", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0599999999999999e-06 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151696+0000", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.531e-06 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195434+0000", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043737442000000001 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195516+0000", 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2545000000000003e-05 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195615+0000", 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9091000000000004e-05 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106887 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3907584~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9060800659999995, 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044058967999999997, 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.121 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106887 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-07 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151701+0000", 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1310000000000001e-06 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151704+0000", 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.954e-06 2024-04-23T23:39:06.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151706+0000", 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.571e-06 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195662+0000", 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043955283999999997 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195711+0000", 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8872999999999998e-05 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195758+0000", 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7935000000000001e-05 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106888 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3932160~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.9060704719999997, 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044184735000000003, 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106888 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153471+0000", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001761777 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153485+0000", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4015999999999999e-05 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153495+0000", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7899999999999994e-06 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153500+0000", 2024-04-23T23:39:06.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1739999999999999e-06 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195787+0000", 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042287400000000003 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195830+0000", 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2624999999999999e-05 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195894+0000", 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3953000000000002e-05 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.128 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.129 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.129 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:06.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:06.130 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:06.142+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:06.231 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:06.243+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:06.273 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:06.273 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116360 3.7 3.d2272347 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e100)", 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:05.832114+0000", 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.45456305499999999, 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.454582771, 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116360 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.274 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832114+0000", 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832114+0000", 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832115+0000", 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4300000000000003e-07 2024-04-23T23:39:06.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832119+0000", 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4209999999999997e-06 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832127+0000", 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8849999999999999e-06 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832133+0000", 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4819999999999999e-06 2024-04-23T23:39:06.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832198+0000", 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4739999999999993e-05 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:05.832210+0000", 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1912e-05 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:39:06.277 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 1 2024-04-23T23:39:06.278 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:06.282 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:06.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:06.362 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:06.374+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:06.384 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:06.384 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:06.384 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:06.384 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:06.384 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:06.392 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:06.431 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:06.443+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:06.436 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:06.437 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:06.454 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:06.454 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:06.471 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:06.471 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:06.488 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:06.488 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:06.497 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:06.497 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:06.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:06.497 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:06.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.497 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107773 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2105344~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2734846819999994, 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046381483000000001, 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107773 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237470+0000", 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017644589999999999 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237474+0000", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2069999999999997e-06 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237484+0000", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6549999999999999e-06 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237493+0000", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7539999999999995e-06 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.281924+0000", 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044431154 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.282000+0000", 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6018000000000003e-05 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.282087+0000", 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7236000000000003e-05 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107783 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2744320~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2715112059999996, 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046491561000000001, 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107783 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.502 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237682+0000", 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.227e-06 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237687+0000", 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6629999999999998e-06 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237692+0000", 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4009999999999999e-06 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284013+0000", 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046320975 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284087+0000", 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4148999999999998e-05 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284171+0000", 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3796999999999997e-05 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107784 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2768896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2714927209999995, 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046693967000000003, 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107784 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239473+0000", 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017752600000000001 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239478+0000", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9010000000000002e-06 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239488+0000", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0665999999999999e-05 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239496+0000", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4780000000000002e-06 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284207+0000", 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044711526000000001 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284291+0000", 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4074999999999997e-05 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284392+0000", 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100061 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107792 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3227648~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2695169419999992, 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046378053000000002, 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107792 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.510 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239674+0000", 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7999999999999996e-07 2024-04-23T23:39:06.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239681+0000", 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3699999999999997e-06 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239688+0000", 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8430000000000004e-06 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239693+0000", 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2329999999999997e-06 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.285868+0000", 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046175051000000002 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.285952+0000", 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3591999999999995e-05 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286051+0000", 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9483999999999998e-05 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.513 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107793 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3252224~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2694898699999992, 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046545097000000001, 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107793 2024-04-23T23:39:06.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239701+0000", 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239703+0000", 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239710+0000", 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7410000000000003e-06 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239715+0000", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.592e-06 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286088+0000", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046372505000000001 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286162+0000", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4164000000000003e-05 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286246+0000", 2024-04-23T23:39:06.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3689000000000005e-05 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107794 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3276800~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2694687529999999, 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046739817000000003, 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107794 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239724+0000", 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9630000000000001e-06 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239731+0000", 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9530000000000002e-06 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239736+0000", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1120000000000004e-06 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286283+0000", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046547036999999999 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286364+0000", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0463999999999994e-05 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286461+0000", 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7864999999999999e-05 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107795 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3432448~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2694477440000007, 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046961375, 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107795 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241472+0000", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017296519999999999 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241477+0000", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4769999999999997e-06 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241487+0000", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.047e-05 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241494+0000", 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2690000000000002e-06 2024-04-23T23:39:06.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286513+0000", 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045018247999999997 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286608+0000", 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4949000000000002e-05 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286704+0000", 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6310000000000005e-05 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.525 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107802 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3735552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.267526384, 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046511841999999998, 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107802 2024-04-23T23:39:06.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:06.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241666+0000", 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9800000000000001e-06 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241673+0000", 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9269999999999999e-06 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241679+0000", 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3689999999999998e-06 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.287995+0000", 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046316607000000003 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288078+0000", 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3036999999999998e-05 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288176+0000", 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7441000000000004e-05 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.529 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107803 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3891200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2675036370000008, 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046680767999999997, 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107803 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.530 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3799999999999997e-07 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241689+0000", 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1129999999999999e-06 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241696+0000", 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3119999999999999e-06 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241702+0000", 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0499999999999997e-06 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288212+0000", 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046509861 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288285+0000", 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3668e-05 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288367+0000", 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2225999999999995e-05 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107804 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3915776~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2674815400000004, 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046875829000000001, 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107804 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241715+0000", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9830000000000001e-06 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241722+0000", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9469999999999997e-06 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241727+0000", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999999e-06 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288402+0000", 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046675109999999999 2024-04-23T23:39:06.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288487+0000", 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4648000000000007e-05 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288585+0000", 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7578000000000007e-05 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107805 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3940352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.537 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2674561200000003, 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047048419000000001, 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107805 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243472+0000", 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017380519999999999 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243478+0000", 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243488+0000", 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0267e-05 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243495+0000", 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3690000000000001e-06 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288621+0000", 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04512567 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288698+0000", 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7307999999999999e-05 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288783+0000", 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4457999999999997e-05 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.541 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107812 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4374528~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2655444580000008, 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046449952000000003, 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107812 2024-04-23T23:39:06.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243648+0000", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243654+0000", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4999999999999999e-06 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243658+0000", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4449999999999998e-06 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.289986+0000", 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046327765 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290030+0000", 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4474999999999997e-05 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290096+0000", 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5497e-05 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.545 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107813 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4399104~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2655263419999994, 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046628018, 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107813 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243666+0000", 2024-04-23T23:39:06.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243672+0000", 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7039999999999999e-06 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243677+0000", 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.814e-06 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290131+0000", 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046454349999999998 2024-04-23T23:39:06.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290205+0000", 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4021000000000002e-05 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290292+0000", 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6794999999999998e-05 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107814 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4423680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:06.549 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2655062519999998, 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046737101000000003, 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107814 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243686+0000", 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243692+0000", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6520000000000003e-06 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243697+0000", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6240000000000001e-06 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290321+0000", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046624684999999999 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290367+0000", 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5395000000000002e-05 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290421+0000", 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4432999999999999e-05 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107815 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4579328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2654877550000005, 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046922708, 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.553 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107815 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243705+0000", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.035e-06 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243711+0000", 2024-04-23T23:39:06.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4060000000000002e-06 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243716+0000", 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290465+0000", 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046748513999999998 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290542+0000", 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7871e-05 2024-04-23T23:39:06.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290625+0000", 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2888999999999999e-05 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107816 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4603904~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2654579199999993, 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047028900999999998, 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.557 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107816 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:06.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243733+0000", 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8899999999999999e-07 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243739+0000", 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2190000000000001e-06 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243746+0000", 2024-04-23T23:39:06.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243751+0000", 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8600000000000001e-06 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290655+0000", 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046904121999999999 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290706+0000", 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1459000000000003e-05 2024-04-23T23:39:06.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290761+0000", 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4979999999999999e-05 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107817 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4628480~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2654287009999994, 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047190263000000003, 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.561 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107817 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245470+0000", 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017088730000000001 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245475+0000", 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245484+0000", 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9830000000000002e-06 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245490+0000", 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5409999999999997e-06 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290795+0000", 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045305177000000002 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290869+0000", 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3708000000000006e-05 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290952+0000", 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2787000000000005e-05 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107824 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5062656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2635461219999993, 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046406714000000002, 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107824 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245645+0000", 2024-04-23T23:39:06.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245647+0000", 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9479999999999998e-06 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245652+0000", 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5210000000000002e-06 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245657+0000", 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.578e-06 2024-04-23T23:39:06.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.291948+0000", 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046291111000000003 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.291997+0000", 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9466999999999999e-05 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292051+0000", 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3671000000000002e-05 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.568 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107825 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5087232~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2635277429999991, 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046582330999999998, 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107825 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245665+0000", 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7e-06 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245670+0000", 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3820000000000003e-06 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245675+0000", 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5950000000000001e-06 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292086+0000", 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046411263000000001 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292159+0000", 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3072999999999996e-05 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292245+0000", 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5938000000000003e-05 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.572 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107826 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5111808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.2635095710000002, 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046687909999999999, 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107826 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.573 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247474+0000", 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017929739999999999 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247479+0000", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9320000000000004e-06 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247490+0000", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1783000000000001e-05 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247498+0000", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7889999999999995e-06 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292273+0000", 2024-04-23T23:39:06.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044775108000000001 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292316+0000", 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2836000000000001e-05 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292369+0000", 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2488000000000003e-05 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:06.576 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:06.577 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:06.578 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:06.578 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:06.578 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:06.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:06.579 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:06.580 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:06.580 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:06.580 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:06.580 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:06.590+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:06.679 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:06.691+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:06.722 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:06.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:06.780 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:06.792+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:06.798 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:39:06.838 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:06.838 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:06.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:06.882 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:06.894+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:06.983 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:06.995+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:06.990 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:06.990 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:06.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:07.083 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:07.095+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:07.102 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.102 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:07.184 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:07.196+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:07.252 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.252 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:07.285 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:07.298+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:07.362 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.362 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:07.386 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:07.399+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:07.473 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.473 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:07.487 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:07.499+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.588 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:07.600+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:07.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:07.689 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:07.701+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.702 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:07.790 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:07.801+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:07.822 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:07.823 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:07.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:07.869 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-04-23T23:39:07.875 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:07.876 INFO:teuthology.orchestra.run.smithi077.stdout:4988 trunc from 0xca97a10 to 0xba9b321 2024-04-23T23:39:07.920 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:07.932+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:07.926 INFO:teuthology.orchestra.run.smithi077.stdout:4989 write 0x6d6b04 thru 0x6e3df7 (0xd2f4 bytes) 2024-04-23T23:39:07.929 INFO:teuthology.orchestra.run.smithi077.stdout:4990 read 0xaa32853 thru 0xaa3cdbb (0xa569 bytes) 2024-04-23T23:39:07.929 INFO:teuthology.orchestra.run.smithi077.stdout:4992 punch from 0x4f0c544 to 0x4f0fa1c, (0x34d8 bytes) 2024-04-23T23:39:07.929 INFO:teuthology.orchestra.run.smithi077.stdout:4993 read 0x93c48a8 thru 0x93c8a21 (0x417a bytes) 2024-04-23T23:39:07.930 INFO:teuthology.orchestra.run.smithi077.stdout:4995 writesame 0x9290ef7 thru 0x929cde5 data_size 0x3(0xbeef bytes) 2024-04-23T23:39:07.940 INFO:teuthology.orchestra.run.smithi077.stdout:4997 punch from 0x305af11 to 0x3061353, (0x6442 bytes) 2024-04-23T23:39:07.949 INFO:teuthology.orchestra.run.smithi077.stdout:4998 write 0xd9a07c3 thru 0xd9a5c82 (0x54c0 bytes) 2024-04-23T23:39:07.952 INFO:teuthology.orchestra.run.smithi077.stdout:4999 read 0x471577c thru 0x47174f2 (0x1d77 bytes) 2024-04-23T23:39:07.952 INFO:teuthology.orchestra.run.smithi077.stdout:5001 write 0x21b9a45 thru 0x21ba121 (0x6dd bytes) 2024-04-23T23:39:07.953 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:07.954 INFO:teuthology.orchestra.run.smithi077.stdout:5006 writesame 0x17447eb thru 0x174707c data_size 0x9(0x2892 bytes) 2024-04-23T23:39:07.958 INFO:teuthology.orchestra.run.smithi077.stdout:5008 write 0x6f41190 thru 0x6f489f4 (0x7865 bytes) 2024-04-23T23:39:07.961 INFO:teuthology.orchestra.run.smithi077.stdout:5010 read 0xb26e046 thru 0xb26ec27 (0xbe2 bytes) 2024-04-23T23:39:07.962 INFO:teuthology.orchestra.run.smithi077.stdout:5011 write 0x31d3de9 thru 0x31e0b79 (0xcd91 bytes) 2024-04-23T23:39:07.964 INFO:teuthology.orchestra.run.smithi077.stdout:5012 writesame 0x2a836f8 thru 0x2a8a383 data_size 0x2(0x6c8c bytes) 2024-04-23T23:39:07.972 INFO:teuthology.orchestra.run.smithi077.stdout:5013 read 0x241c2db thru 0x241d616 (0x133c bytes) 2024-04-23T23:39:07.973 INFO:teuthology.orchestra.run.smithi077.stdout:5014 punch from 0x59e4483 to 0x59e8e51, (0x49ce bytes) 2024-04-23T23:39:07.973 INFO:teuthology.orchestra.run.smithi077.stdout:5015 write 0x45c1f0c thru 0x45cfb29 (0xdc1e bytes) 2024-04-23T23:39:07.976 INFO:teuthology.orchestra.run.smithi077.stdout:5016 writesame 0xb6d403e thru 0xb6d4315 data_size 0xd(0x2d8 bytes) 2024-04-23T23:39:07.977 INFO:teuthology.orchestra.run.smithi077.stdout:5017 writesame 0x703a8a3 thru 0x703ce72 data_size 0xb(0x25d0 bytes) 2024-04-23T23:39:07.979 INFO:teuthology.orchestra.run.smithi077.stdout:5018 writesame 0x6addd31 thru 0x6ae3fa5 data_size 0x5(0x6275 bytes) 2024-04-23T23:39:07.983 INFO:teuthology.orchestra.run.smithi077.stdout:5019 read 0xc4376f6 thru 0xc437e6e (0x779 bytes) 2024-04-23T23:39:07.984 INFO:teuthology.orchestra.run.smithi077.stdout:5020 read 0x69a5315 thru 0x69ae2e5 (0x8fd1 bytes) 2024-04-23T23:39:07.984 INFO:teuthology.orchestra.run.smithi077.stdout:5021 punch from 0xd5aeb3b to 0xd5bbbf2, (0xd0b7 bytes) 2024-04-23T23:39:07.984 INFO:teuthology.orchestra.run.smithi077.stdout:5023 read 0xa6e280c thru 0xa6ee74c (0xbf41 bytes) 2024-04-23T23:39:07.985 INFO:teuthology.orchestra.run.smithi077.stdout:5024 write 0xf98d0b thru 0xf9b71f (0x2a15 bytes) 2024-04-23T23:39:07.986 INFO:teuthology.orchestra.run.smithi077.stdout:5025 write 0xbc4ba1 thru 0xbcfb29 (0xaf89 bytes) 2024-04-23T23:39:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:5029 read 0x859dd00 thru 0x85aa3e3 (0xc6e4 bytes) 2024-04-23T23:39:07.988 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:07.989 INFO:teuthology.orchestra.run.smithi077.stdout:5031 writesame 0x300ae2 thru 0x301982 data_size 0x7(0xea1 bytes) 2024-04-23T23:39:07.991 INFO:teuthology.orchestra.run.smithi077.stdout:5032 read 0x1a2f613 thru 0x1a3a3c8 (0xadb6 bytes) 2024-04-23T23:39:07.991 INFO:teuthology.orchestra.run.smithi077.stdout:5033 write 0xcf9c001 thru 0xcfa150f (0x550f bytes) 2024-04-23T23:39:07.991 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:08.003+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:07.992 INFO:teuthology.orchestra.run.smithi077.stdout:5034 read 0xa4d10c5 thru 0xa4da7f3 (0x972f bytes) 2024-04-23T23:39:07.993 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:07.993 INFO:teuthology.orchestra.run.smithi077.stdout:5037 writesame 0x8cbb4fa thru 0x8cbcfb8 data_size 0x1(0x1abf bytes) 2024-04-23T23:39:07.998 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:07.998 INFO:teuthology.orchestra.run.smithi077.stdout:5040 read 0x3f4519c thru 0x3f4cc02 (0x7a67 bytes) 2024-04-23T23:39:07.999 INFO:teuthology.orchestra.run.smithi077.stdout:5041 read 0xcaa9058 thru 0xcaadce6 (0x4c8f bytes) 2024-04-23T23:39:07.999 INFO:teuthology.orchestra.run.smithi077.stdout:5042 read 0x9c4c9fd thru 0x9c552b5 (0x88b9 bytes) 2024-04-23T23:39:08.008 INFO:teuthology.orchestra.run.smithi077.stdout:5044 writesame 0xe8b9b41 thru 0xe8bfb71 data_size 0x19(0x6031 bytes) 2024-04-23T23:39:08.010 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:08.010 INFO:teuthology.orchestra.run.smithi077.stdout:5048 punch from 0x75a977e to 0x75aaf02, (0x1784 bytes) 2024-04-23T23:39:08.020 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:08.020 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:08.025 INFO:teuthology.orchestra.run.smithi077.stdout:5050 trunc from 0xe8bfb72 to 0x2a35981 2024-04-23T23:39:08.033 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:08.053 INFO:teuthology.orchestra.run.smithi077.stdout:5054 write 0x7e7659e thru 0x7e8565f (0xf0c2 bytes) 2024-04-23T23:39:08.065 INFO:teuthology.orchestra.run.smithi077.stdout:5055 trunc from 0x7e85660 to 0x336d7f 2024-04-23T23:39:08.097 INFO:teuthology.orchestra.run.smithi077.stdout:5057 clone 43 order 19 su 8192 sc 2 2024-04-23T23:39:08.118 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:08.130+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:08.192 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:08.204+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:08.200 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:08.200 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:08.212 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:08.296 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:08.308+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:08.380 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:08.380 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:08.391 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:08.432 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:08.444+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:08.494 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:08.506+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:08.559 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:08.559 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:08.569 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:08.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:08.613 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:08.625+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:08.682 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:08.682 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:08.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:08.699 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:08.717 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:08.717 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:08.733 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:08.734 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:08.745+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:08.734 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:08.751 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:08.751 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:08.769 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:08.769 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:08.788 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:08.788 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:08.796 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:08.808+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:08.809 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:08.809 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:08.813 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:08.813 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:08.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:39:08.845 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:08.845 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:08.845 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:08.845 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:08.854 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:08.937 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:08.949+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:08.998 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:09.010+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:09.003 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:09.003 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:09.003 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:09.003 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:09.003 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:09.013 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:09.099 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:09.111+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:09.156 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:09.156 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:09.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:09.156 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:09.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.156 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 111.44005648, 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:39:09.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:09.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.114203471000003, 2024-04-23T23:39:09.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:39:09.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:09.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:39:09.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 30.615230434000001, 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:39:09.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:39:09.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106837 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1105920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.022181448, 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043899269999999997, 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.173 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106837 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145834+0000", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0699999999999999e-07 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145835+0000", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0210000000000001e-06 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145837+0000", 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.847e-06 2024-04-23T23:39:09.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145840+0000", 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.481e-06 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189637+0000", 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043796663 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189681+0000", 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4725999999999998e-05 2024-04-23T23:39:09.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189733+0000", 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1325000000000001e-05 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106838 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1130496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.022172059000001, 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044012456999999998, 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106838 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:09.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145844+0000", 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.049e-06 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145847+0000", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8289999999999999e-06 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145849+0000", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189761+0000", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911752999999998 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189804+0000", 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2695999999999999e-05 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189855+0000", 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1431999999999998e-05 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106839 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1155072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.02216271, 2024-04-23T23:39:09.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044114555999999999, 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106839 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146080+0000", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000227486 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146083+0000", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.258e-06 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146093+0000", 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0672999999999999e-05 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146100+0000", 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0299999999999999e-06 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189882+0000", 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043782284999999997 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189920+0000", 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8516000000000002e-05 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189967+0000", 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6307999999999998e-05 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106840 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1179648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.021905184, 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043966107999999997, 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106840 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146117+0000", 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6619999999999999e-06 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146129+0000", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2371000000000001e-05 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146134+0000", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2449999999999998e-06 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189992+0000", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043858000000000001 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190030+0000", 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7755e-05 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190076+0000", 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5538999999999999e-05 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106841 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1335296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.021872456000001, 2024-04-23T23:39:09.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044044613000000003, 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106841 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146143+0000", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146145+0000", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.334e-06 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146152+0000", 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4479999999999999e-06 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146156+0000", 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7509999999999999e-06 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190099+0000", 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043942795999999999 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190140+0000", 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0813999999999999e-05 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190187+0000", 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6974999999999997e-05 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106842 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1359872~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.021852029, 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044137033999999999, 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.193 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106842 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147472+0000", 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0013091859999999999 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147475+0000", 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3739999999999998e-06 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147487+0000", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1212e-05 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147494+0000", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1459999999999999e-06 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190215+0000", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042721228999999999 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190254+0000", 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9161e-05 2024-04-23T23:39:09.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190300+0000", 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5726000000000002e-05 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106855 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2072576~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.020188601999999, 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043925840000000001, 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.197 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106855 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147827+0000", 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147829+0000", 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7010000000000001e-06 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147837+0000", 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7910000000000005e-06 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147843+0000", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9560000000000002e-06 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191668+0000", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043824701000000001 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191708+0000", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0371999999999999e-05 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191752+0000", 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3792999999999999e-05 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106856 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2097152~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.020164099, 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044011869000000002, 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.201 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106856 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7599999999999997e-07 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147853+0000", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1780000000000002e-06 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147860+0000", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5019999999999998e-06 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147865+0000", 2024-04-23T23:39:09.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191777+0000", 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911126000000002 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191819+0000", 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1990000000000003e-05 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191863+0000", 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3995999999999997e-05 2024-04-23T23:39:09.204 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106857 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.020142776, 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044095387999999999, 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.205 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106857 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147873+0000", 2024-04-23T23:39:09.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.82e-07 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147874+0000", 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147881+0000", 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.392e-06 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147886+0000", 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9389999999999996e-06 2024-04-23T23:39:09.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191884+0000", 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043998430999999998 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191922+0000", 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7339000000000003e-05 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191967+0000", 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5785000000000003e-05 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106858 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2277376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.020122653, 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044206352999999997, 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106858 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149473+0000", 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001580733 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149477+0000", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149488+0000", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0891e-05 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149495+0000", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2289999999999997e-06 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191990+0000", 2024-04-23T23:39:09.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042494707999999999 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192048+0000", 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7615000000000003e-05 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192098+0000", 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0915999999999998e-05 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.212 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106873 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3170304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.018182482, 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043985420999999997, 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106873 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149833+0000", 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999998e-07 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149834+0000", 2024-04-23T23:39:09.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.15e-06 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149837+0000", 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9390000000000002e-06 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149839+0000", 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5739999999999998e-06 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193731+0000", 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043891442000000003 2024-04-23T23:39:09.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193770+0000", 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9236999999999997e-05 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193818+0000", 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7839000000000001e-05 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106874 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3194880~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:09.216 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.018172810999999, 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044084569999999997, 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106874 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149843+0000", 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2600000000000001e-07 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149846+0000", 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.366e-06 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149851+0000", 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999997e-06 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193842+0000", 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043991808 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193880+0000", 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7296999999999999e-05 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193927+0000", 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6864999999999999e-05 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106875 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3219456~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.01815904, 2024-04-23T23:39:09.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044177196000000002, 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106875 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149940+0000", 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4321999999999997e-05 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149942+0000", 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.26e-06 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149948+0000", 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9190000000000004e-06 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149952+0000", 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7560000000000001e-06 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193948+0000", 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043995819999999998 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193985+0000", 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6798999999999998e-05 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194033+0000", 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999998e-05 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106876 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3244032~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.018055864999999, 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044183060000000003, 2024-04-23T23:39:09.224 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106876 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151472+0000", 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001513316 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151481+0000", 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6829999999999997e-06 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151490+0000", 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8929999999999994e-06 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151496+0000", 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8690000000000001e-06 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194058+0000", 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042562068000000002 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194095+0000", 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7336000000000003e-05 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194142+0000", 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6894999999999997e-05 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106886 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3883008~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:09.228 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.016325563000001, 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043926192000000003, 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106886 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:09.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4600000000000001e-07 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151691+0000", 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.277e-06 2024-04-23T23:39:09.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151694+0000", 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0599999999999999e-06 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151696+0000", 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.531e-06 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195434+0000", 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043737442000000001 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195516+0000", 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2545000000000003e-05 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195615+0000", 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9091000000000004e-05 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106887 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3907584~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:09.232 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.016315263999999, 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044058967999999997, 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106887 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-07 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151701+0000", 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1310000000000001e-06 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151704+0000", 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.954e-06 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151706+0000", 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.571e-06 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195662+0000", 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043955283999999997 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195711+0000", 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8872999999999998e-05 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195758+0000", 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7935000000000001e-05 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106888 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3932160~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.016305669999999, 2024-04-23T23:39:09.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044184735000000003, 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106888 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153471+0000", 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001761777 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153485+0000", 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4015999999999999e-05 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153495+0000", 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7899999999999994e-06 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153500+0000", 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1739999999999999e-06 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195787+0000", 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042287400000000003 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195830+0000", 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2624999999999999e-05 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195894+0000", 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3953000000000002e-05 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.240 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:09.241 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:09.242 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:09.254+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:09.342 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:09.354+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3.ee184b56 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.57942558499999997, 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.57944726800000002, 2024-04-23T23:39:09.385 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 1 2024-04-23T23:39:09.389 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:09.393 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:09.478 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:09.490+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:09.535 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:09.535 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:09.536 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:09.536 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:09.536 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:09.544 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:09.545 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:09.556+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:09.644 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:09.656+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107773 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2105344~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.463972502000001, 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046381483000000001, 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.688 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107773 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.235706+0000", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237470+0000", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017644589999999999 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237474+0000", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2069999999999997e-06 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237484+0000", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6549999999999999e-06 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237493+0000", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7539999999999995e-06 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.281924+0000", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044431154 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.282000+0000", 2024-04-23T23:39:09.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6018000000000003e-05 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.282087+0000", 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7236000000000003e-05 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107783 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2744320~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.461999026000001, 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046491561000000001, 2024-04-23T23:39:09.692 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107783 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237679+0000", 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237682+0000", 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.227e-06 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237687+0000", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6629999999999998e-06 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237692+0000", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4009999999999999e-06 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284013+0000", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046320975 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284087+0000", 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4148999999999998e-05 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284171+0000", 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3796999999999997e-05 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107784 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 2768896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.461980541000001, 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046693967000000003, 2024-04-23T23:39:09.696 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107784 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.237698+0000", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239473+0000", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017752600000000001 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239478+0000", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9010000000000002e-06 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239488+0000", 2024-04-23T23:39:09.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0665999999999999e-05 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239496+0000", 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4780000000000002e-06 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284207+0000", 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044711526000000001 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284291+0000", 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4074999999999997e-05 2024-04-23T23:39:09.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.284392+0000", 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100061 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107792 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3227648~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.460004762000001, 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046378053000000002, 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.700 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107792 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239673+0000", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239674+0000", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7999999999999996e-07 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239681+0000", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3699999999999997e-06 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239688+0000", 2024-04-23T23:39:09.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8430000000000004e-06 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239693+0000", 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2329999999999997e-06 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.285868+0000", 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046175051000000002 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.285952+0000", 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3591999999999995e-05 2024-04-23T23:39:09.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286051+0000", 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9483999999999998e-05 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107793 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3252224~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.459977690000001, 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046545097000000001, 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107793 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239700+0000", 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239701+0000", 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239703+0000", 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239710+0000", 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7410000000000003e-06 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239715+0000", 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.592e-06 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286088+0000", 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046372505000000001 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286162+0000", 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4164000000000003e-05 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286246+0000", 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3689000000000005e-05 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107794 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3276800~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.459956572999999, 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046739817000000003, 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.708 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107794 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239722+0000", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239724+0000", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9630000000000001e-06 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239731+0000", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9530000000000002e-06 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239736+0000", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1120000000000004e-06 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286283+0000", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046547036999999999 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286364+0000", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0463999999999994e-05 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286461+0000", 2024-04-23T23:39:09.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7864999999999999e-05 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107795 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3432448~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.459935564, 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046961375, 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107795 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.239743+0000", 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241472+0000", 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017296519999999999 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241477+0000", 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4769999999999997e-06 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241487+0000", 2024-04-23T23:39:09.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.047e-05 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241494+0000", 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2690000000000002e-06 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286513+0000", 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045018247999999997 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286608+0000", 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4949000000000002e-05 2024-04-23T23:39:09.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.286704+0000", 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6310000000000005e-05 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107802 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3735552~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.458014203999999, 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046511841999999998, 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107802 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241664+0000", 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8100000000000003e-07 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241666+0000", 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9800000000000001e-06 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241673+0000", 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9269999999999999e-06 2024-04-23T23:39:09.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241679+0000", 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3689999999999998e-06 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.287995+0000", 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046316607000000003 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288078+0000", 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3036999999999998e-05 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288176+0000", 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7441000000000004e-05 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107803 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3891200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.457991457, 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046680767999999997, 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107803 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241687+0000", 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3799999999999997e-07 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241689+0000", 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1129999999999999e-06 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241696+0000", 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3119999999999999e-06 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241702+0000", 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0499999999999997e-06 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288212+0000", 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046509861 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288285+0000", 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3668e-05 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288367+0000", 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2225999999999995e-05 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107804 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3915776~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.45796936, 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046875829000000001, 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107804 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241709+0000", 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241715+0000", 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9830000000000001e-06 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241722+0000", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9469999999999997e-06 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241727+0000", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999999e-06 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288402+0000", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046675109999999999 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288487+0000", 2024-04-23T23:39:09.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4648000000000007e-05 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288585+0000", 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7578000000000007e-05 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107805 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 3940352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.45794394, 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047048419000000001, 2024-04-23T23:39:09.728 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107805 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.241734+0000", 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243472+0000", 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017380519999999999 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243478+0000", 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243488+0000", 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0267e-05 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243495+0000", 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3690000000000001e-06 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288621+0000", 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04512567 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288698+0000", 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7307999999999999e-05 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.288783+0000", 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4457999999999997e-05 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107812 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4374528~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.456032278, 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046449952000000003, 2024-04-23T23:39:09.732 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107812 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243646+0000", 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243648+0000", 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243654+0000", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4999999999999999e-06 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243658+0000", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4449999999999998e-06 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.289986+0000", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046327765 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290030+0000", 2024-04-23T23:39:09.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4474999999999997e-05 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290096+0000", 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5497e-05 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107813 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4399104~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.456014162000001, 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046628018, 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107813 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243664+0000", 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243666+0000", 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243672+0000", 2024-04-23T23:39:09.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7039999999999999e-06 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243677+0000", 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.814e-06 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290131+0000", 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046454349999999998 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290205+0000", 2024-04-23T23:39:09.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4021000000000002e-05 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290292+0000", 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6794999999999998e-05 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107814 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4423680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.455994071999999, 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046737101000000003, 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.740 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107814 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243684+0000", 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243686+0000", 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243692+0000", 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6520000000000003e-06 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243697+0000", 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6240000000000001e-06 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290321+0000", 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046624684999999999 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290367+0000", 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5395000000000002e-05 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290421+0000", 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4432999999999999e-05 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107815 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4579328~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.455975575, 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046922708, 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107815 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243703+0000", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243705+0000", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.035e-06 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243711+0000", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4060000000000002e-06 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243716+0000", 2024-04-23T23:39:09.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290465+0000", 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046748513999999998 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290542+0000", 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7871e-05 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290625+0000", 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2888999999999999e-05 2024-04-23T23:39:09.747 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107816 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4603904~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.455945740000001, 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047028900999999998, 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107816 2024-04-23T23:39:09.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243732+0000", 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243733+0000", 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8899999999999999e-07 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243739+0000", 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2190000000000001e-06 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243746+0000", 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243751+0000", 2024-04-23T23:39:09.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8600000000000001e-06 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290655+0000", 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046904121999999999 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290706+0000", 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1459000000000003e-05 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290761+0000", 2024-04-23T23:39:09.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4979999999999999e-05 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107817 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 4628480~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.455916521000001, 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047190263000000003, 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.752 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107817 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.243762+0000", 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245470+0000", 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017088730000000001 2024-04-23T23:39:09.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245475+0000", 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245484+0000", 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9830000000000002e-06 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245490+0000", 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5409999999999997e-06 2024-04-23T23:39:09.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290795+0000", 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045305177000000002 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290869+0000", 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3708000000000006e-05 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.290952+0000", 2024-04-23T23:39:09.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2787000000000005e-05 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107824 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5062656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.454033942000001, 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046406714000000002, 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107824 2024-04-23T23:39:09.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245644+0000", 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245645+0000", 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:09.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245647+0000", 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9479999999999998e-06 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245652+0000", 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5210000000000002e-06 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245657+0000", 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.578e-06 2024-04-23T23:39:09.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.291948+0000", 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046291111000000003 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.291997+0000", 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9466999999999999e-05 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292051+0000", 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3671000000000002e-05 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.759 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107825 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5087232~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.454015563, 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046582330999999998, 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107825 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.760 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245663+0000", 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245665+0000", 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7e-06 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245670+0000", 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3820000000000003e-06 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245675+0000", 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5950000000000001e-06 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292086+0000", 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046411263000000001 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292159+0000", 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3072999999999996e-05 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292245+0000", 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5938000000000003e-05 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:107826 3.7 3:e1302fcf:::rbd_data.1194f5419933.0000000000000002:29 [read 5111808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 12.453997391, 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046687909999999999, 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 107826 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:09.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.245681+0000", 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247474+0000", 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017929739999999999 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247479+0000", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9320000000000004e-06 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247490+0000", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1783000000000001e-05 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.247498+0000", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7889999999999995e-06 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:09.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292273+0000", 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044775108000000001 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292316+0000", 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2836000000000001e-05 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.292369+0000", 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2488000000000003e-05 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:09.767 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:09.768 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:09.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:09.769 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:09.781+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:09.797 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:39:09.869 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:09.881+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:09.882 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:09.883 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:09.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:09.898 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone42 intact 2024-04-23T23:39:09.971 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:09.982+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:09.994 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-04-23T23:39:10.006 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:10.006 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:10.099 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:10.111+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060259518999999, 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060245874000003, 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060232823999996, 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060221804999998, 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060212730000003, 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060200785999996, 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.060191674999999, 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.058546303, 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.058534054000006, 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054355461, 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054343678999999, 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.05433361, 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054321951000006, 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054312631000002, 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054302118999999, 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054292679, 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054097585999997, 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054076553000002, 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.054062662999996, 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 77.450906157999995, 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.236 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.238 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:10.238 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:10.249+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:10.339 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:10.351+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:10.381 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:10.381 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:10.439 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:10.452+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:10.531 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.531 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:10.531 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:10.531 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:10.531 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:10.540 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:10.553+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:10.642 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:10.654+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:10.644 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 82.262426632, 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:39:10.650 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 73.263776003999993, 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:39:10.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.824122590999998, 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:10.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:10.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:10.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:10.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90590 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3441664~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.654589036000001, 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051386827000000003, 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90590 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001684+0000", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001690+0000", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1480000000000003e-06 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001694+0000", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052909+0000", 2024-04-23T23:39:10.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051214519 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052978+0000", 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8738000000000005e-05 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.053068+0000", 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0068000000000006e-05 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90651 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3556352~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.650706394, 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051409877, 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90651 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005566+0000", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9489999999999999e-06 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005572+0000", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1179999999999997e-06 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005577+0000", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7060000000000003e-06 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056808+0000", 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051230879999999999 2024-04-23T23:39:10.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056879+0000", 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1261999999999996e-05 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056973+0000", 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4569999999999997e-05 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.669 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90653 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3563520~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.650687272999999, 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051620653000000002, 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90653 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:10.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005585+0000", 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.883e-06 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005591+0000", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005596+0000", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057017+0000", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051421175999999999 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057094+0000", 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7040999999999996e-05 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057203+0000", 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010935 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90655 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3570688~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.650668623000001, 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051736068000000003, 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.673 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90655 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:10.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005602+0000", 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005603+0000", 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005609+0000", 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:39:10.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005614+0000", 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6190000000000002e-06 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057238+0000", 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051623872000000001 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057281+0000", 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3259e-05 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057337+0000", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6298999999999997e-05 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90662 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3613696~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.649084436999999, 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051308223, 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.677 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90662 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007186+0000", 2024-04-23T23:39:10.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007188+0000", 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.945e-06 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007195+0000", 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007200+0000", 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058336+0000", 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051136231999999997 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058404+0000", 2024-04-23T23:39:10.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8613000000000002e-05 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058494+0000", 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9314999999999994e-05 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90663 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3620864~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:10.681 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.649063261999999, 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051524557999999998, 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90663 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007209+0000", 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.813e-06 2024-04-23T23:39:10.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007215+0000", 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3899999999999998e-06 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007220+0000", 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8189999999999999e-06 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058536+0000", 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051315847999999997 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058621+0000", 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5453999999999999e-05 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058731+0000", 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010982800000000001 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90664 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3628032~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.649044045, 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051704831, 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90664 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007228+0000", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.829e-06 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007233+0000", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007238+0000", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5159999999999996e-06 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058770+0000", 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051532124999999998 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058839+0000", 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9356999999999993e-05 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058931+0000", 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1230000000000006e-05 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90665 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3635200~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.649026152000001, 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051935859000000001, 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90665 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008976+0000", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017323939999999999 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008980+0000", 2024-04-23T23:39:10.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0910000000000003e-06 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008987+0000", 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.131e-06 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008992+0000", 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6670000000000004e-06 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058981+0000", 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049988772000000001 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059068+0000", 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7640999999999997e-05 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059180+0000", 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011116300000000001 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90674 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4484096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.647086451, 2024-04-23T23:39:10.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051442084999999999, 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90674 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009184+0000", 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009186+0000", 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009192+0000", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009198+0000", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060463+0000", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051264788999999998 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060543+0000", 2024-04-23T23:39:10.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0344000000000002e-05 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060626+0000", 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2576000000000004e-05 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90675 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4491264~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.647065688000001, 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051599027999999998, 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.697 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90675 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009205+0000", 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009207+0000", 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009212+0000", 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7479999999999999e-06 2024-04-23T23:39:10.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009218+0000", 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1919999999999996e-06 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060663+0000", 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051445554999999997 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060732+0000", 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9041000000000005e-05 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060803+0000", 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1135000000000002e-05 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90676 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4498432~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.647046710000001, 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051792194999999999, 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90676 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009224+0000", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009225+0000", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009232+0000", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5089999999999999e-06 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009238+0000", 2024-04-23T23:39:10.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060845+0000", 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051607346999999998 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060927+0000", 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1644999999999995e-05 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061015+0000", 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8642999999999998e-05 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.704 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90677 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4505600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.647026124, 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051967037000000001, 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90677 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.705 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010979+0000", 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017348070000000001 2024-04-23T23:39:10.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010985+0000", 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010995+0000", 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0370000000000001e-05 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011002+0000", 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2960000000000001e-06 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061051+0000", 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.050048603999999997 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061134+0000", 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3219000000000004e-05 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061211+0000", 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6724999999999995e-05 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.708 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90686 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4562944~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.645017406000001, 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051380604000000003, 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90686 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.709 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011253+0000", 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.34e-07 2024-04-23T23:39:10.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011254+0000", 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011258+0000", 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7050000000000001e-06 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011261+0000", 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9349999999999999e-06 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062492+0000", 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051231454000000003 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062563+0000", 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0461000000000002e-05 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062633+0000", 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0548000000000003e-05 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90687 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4570112~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.645006260999999, 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051576652000000001, 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90687 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9299999999999999e-07 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011265+0000", 2024-04-23T23:39:10.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2109999999999999e-06 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011268+0000", 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1470000000000001e-06 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011271+0000", 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6309999999999999e-06 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062678+0000", 2024-04-23T23:39:10.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051406962 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062759+0000", 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0803000000000005e-05 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062840+0000", 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1605000000000002e-05 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90688 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4577280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:10.716 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 19.644996131999999, 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051748664999999999, 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90688 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012977+0000", 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017037109999999999 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012982+0000", 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5979999999999999e-06 2024-04-23T23:39:10.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013006+0000", 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4300000000000001e-05 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013015+0000", 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4649999999999994e-06 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062879+0000", 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049864420999999999 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062949+0000", 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9728999999999996e-05 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.063022+0000", 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3441000000000004e-05 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:10.720 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.762262819, 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.7894332999999998, 2024-04-23T23:39:10.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:10.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:39:10.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.729 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.730 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.730 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:10.730 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:10.730 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:10.742 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:10.755+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:10.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:10.815 INFO:teuthology.orchestra.run.smithi077.stdout:5058 read 0x17bd36 thru 0x17c512 (0x7dd bytes) 2024-04-23T23:39:10.815 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4] out_osds: [3, 0, 7] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:10.815 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:10.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:39:10.817 INFO:teuthology.orchestra.run.smithi077.stdout:5060 read 0x29984b thru 0x2a0245 (0x69fb bytes) 2024-04-23T23:39:10.819 INFO:teuthology.orchestra.run.smithi077.stdout:5061 read 0x2ca412 thru 0x2d2a04 (0x85f3 bytes) 2024-04-23T23:39:10.842 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:10.854+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:10.848 INFO:teuthology.orchestra.run.smithi077.stdout:5062 write 0xca37dcb thru 0xca3ba71 (0x3ca7 bytes) 2024-04-23T23:39:10.849 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:10.849 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:10.849 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.852 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:10.852 INFO:teuthology.orchestra.run.smithi077.stdout:5065 write 0x908e568 thru 0x9094663 (0x60fc bytes) 2024-04-23T23:39:10.857 INFO:teuthology.orchestra.run.smithi077.stdout:5066 trunc from 0xca3ba72 to 0xd423df6 2024-04-23T23:39:10.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:10.862 INFO:teuthology.orchestra.run.smithi077.stdout:5067 read 0xbbc6f6d thru 0xbbd577a (0xe80e bytes) 2024-04-23T23:39:10.877 INFO:teuthology.orchestra.run.smithi077.stdout:5068 trunc from 0xd423df6 to 0xad694f 2024-04-23T23:39:10.888 INFO:teuthology.orchestra.run.smithi077.stdout:5069 punch from 0xd8e4c to 0xd980e, (0x9c2 bytes) 2024-04-23T23:39:10.888 INFO:teuthology.orchestra.run.smithi077.stdout:5070 punch from 0x3700e3 to 0x3723cd, (0x22ea bytes) 2024-04-23T23:39:10.888 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:10.888 INFO:teuthology.orchestra.run.smithi077.stdout:5072 write 0x1e8395 thru 0x1e926f (0xedb bytes) 2024-04-23T23:39:10.902 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:10.917 INFO:teuthology.orchestra.run.smithi077.stdout:5076 write 0x7ed181e thru 0x7ed4e9c (0x367f bytes) 2024-04-23T23:39:10.929 INFO:teuthology.orchestra.run.smithi077.stdout:5077 write 0xa4046ac thru 0xa40a3cd (0x5d22 bytes) 2024-04-23T23:39:10.933 INFO:teuthology.orchestra.run.smithi077.stdout:5078 write 0xc438dc thru 0xc4db11 (0xa236 bytes) 2024-04-23T23:39:10.937 INFO:teuthology.orchestra.run.smithi077.stdout:5079 write 0x46b5fb7 thru 0x46c5e8a (0xfed4 bytes) 2024-04-23T23:39:10.941 INFO:teuthology.orchestra.run.smithi077.stdout:5080 writesame 0x71a2f97 thru 0x71ab357 data_size 0x1(0x83c1 bytes) 2024-04-23T23:39:10.943 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:10.955+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:10.954 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:10.954 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:10.956 INFO:teuthology.orchestra.run.smithi077.stdout:5081 writesame 0x9ed9dbb thru 0x9ee7864 data_size 0xd(0xdaaa bytes) 2024-04-23T23:39:10.961 INFO:teuthology.orchestra.run.smithi077.stdout:5082 write 0x644a049 thru 0x644a747 (0x6ff bytes) 2024-04-23T23:39:10.975 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:10.975 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:10.975 INFO:teuthology.orchestra.run.smithi077.stdout:5083 write 0xd9ca83b thru 0xd9d29ae (0x8174 bytes) 2024-04-23T23:39:10.979 INFO:teuthology.orchestra.run.smithi077.stdout:5084 write 0x761f58a thru 0x762d6fb (0xe172 bytes) 2024-04-23T23:39:10.983 INFO:teuthology.orchestra.run.smithi077.stdout:5085 read 0x4eee997 thru 0x4ef3a97 (0x5101 bytes) 2024-04-23T23:39:10.983 INFO:teuthology.orchestra.run.smithi077.stdout:5087 writesame 0xe24db0 thru 0xe2ccec data_size 0x1(0x7f3d bytes) 2024-04-23T23:39:10.984 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:10.984 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:10.984 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:10.985 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:10.985 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:10.993 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:10.994 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:10.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:10.995 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:11.003 INFO:teuthology.orchestra.run.smithi077.stdout:5088 trunc from 0xd9d29af to 0x7f84730 2024-04-23T23:39:11.013 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:11.013 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:11.013 INFO:teuthology.orchestra.run.smithi077.stdout:5089 read 0x528b1a8 thru 0x5296548 (0xb3a1 bytes) 2024-04-23T23:39:11.020 INFO:teuthology.orchestra.run.smithi077.stdout:5090 trunc from 0x7f84730 to 0x259c40b 2024-04-23T23:39:11.031 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.033 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:11.033 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:11.035 INFO:teuthology.orchestra.run.smithi077.stdout:5095 trunc from 0x259c40b to 0x6273dd1 2024-04-23T23:39:11.040 INFO:teuthology.orchestra.run.smithi077.stdout:5098 punch from 0x1f4d39b to 0x1f528af, (0x5514 bytes) 2024-04-23T23:39:11.041 INFO:teuthology.orchestra.run.smithi077.stdout:5099 read 0x3467282 thru 0x34684f8 (0x1277 bytes) 2024-04-23T23:39:11.044 INFO:teuthology.orchestra.run.smithi077.stdout:5100 trunc from 0x6273dd1 to 0x39a4b8f 2024-04-23T23:39:11.044 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:11.057+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:11.055 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:11.055 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:11.062 INFO:teuthology.orchestra.run.smithi077.stdout:5101 writesame 0x7ebf460 thru 0x7ecba43 data_size 0x14(0xc5e4 bytes) 2024-04-23T23:39:11.062 INFO:teuthology.orchestra.run.smithi077.stdout:5102 read 0x8a455b thru 0x8b2298 (0xdd3e bytes) 2024-04-23T23:39:11.062 INFO:teuthology.orchestra.run.smithi077.stdout:5103 write 0x57c3afa thru 0x57d322f (0xf736 bytes) 2024-04-23T23:39:11.066 INFO:teuthology.orchestra.run.smithi077.stdout:5105 read 0x7048d4e thru 0x704bc4e (0x2f01 bytes) 2024-04-23T23:39:11.066 INFO:teuthology.orchestra.run.smithi077.stdout:5106 write 0x7632096 thru 0x763ae78 (0x8de3 bytes) 2024-04-23T23:39:11.069 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.075 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:11.075 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:11.078 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:11.079 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:11.079 INFO:teuthology.orchestra.run.smithi077.stdout:5111 write 0xa636e01 thru 0xa63e9fe (0x7bfe bytes) 2024-04-23T23:39:11.082 INFO:teuthology.orchestra.run.smithi077.stdout:5112 read 0x4afef43 thru 0x4b0e9a9 (0xfa67 bytes) 2024-04-23T23:39:11.082 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.082 INFO:teuthology.orchestra.run.smithi077.stdout:5114 write 0x4899af4 thru 0x489f7b4 (0x5cc1 bytes) 2024-04-23T23:39:11.086 INFO:teuthology.orchestra.run.smithi077.stdout:5115 write 0x33feb12 thru 0x34040a1 (0x5590 bytes) 2024-04-23T23:39:11.090 INFO:teuthology.orchestra.run.smithi077.stdout:5116 write 0x4d85c39 thru 0x4d90227 (0xa5ef bytes) 2024-04-23T23:39:11.094 INFO:teuthology.orchestra.run.smithi077.stdout:5117 read 0x4ea9d6c thru 0x4eb4eea (0xb17f bytes) 2024-04-23T23:39:11.094 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.104 INFO:teuthology.orchestra.run.smithi077.stdout:5119 write 0xe1d300c thru 0xe1dba8a (0x8a7f bytes) 2024-04-23T23:39:11.108 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.108 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.108 INFO:teuthology.orchestra.run.smithi077.stdout:5123 read 0x22ac991 thru 0x22ba709 (0xdd79 bytes) 2024-04-23T23:39:11.108 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.109 INFO:teuthology.orchestra.run.smithi077.stdout:5126 trunc from 0xe1dba8b to 0xec9b591 2024-04-23T23:39:11.114 INFO:teuthology.orchestra.run.smithi077.stdout:5128 writesame 0xe9e63e3 thru 0xe9e9c78 data_size 0x1(0x3896 bytes) 2024-04-23T23:39:11.122 INFO:teuthology.orchestra.run.smithi077.stdout:5129 punch from 0x73cd14c to 0x73d69a5, (0x9859 bytes) 2024-04-23T23:39:11.122 INFO:teuthology.orchestra.run.smithi077.stdout:5130 read 0x3ac1f4c thru 0x3ac1fed (0xa2 bytes) 2024-04-23T23:39:11.122 INFO:teuthology.orchestra.run.smithi077.stdout:5131 writesame 0x32847f3 thru 0x3290489 data_size 0x85(0xbc97 bytes) 2024-04-23T23:39:11.124 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.124 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.126 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.126 INFO:teuthology.orchestra.run.smithi077.stdout:5133 write 0xbfb4b13 thru 0xbfc46b6 (0xfba4 bytes) 2024-04-23T23:39:11.129 INFO:teuthology.orchestra.run.smithi077.stdout:5134 write 0x2bca975 thru 0x2bce9b6 (0x4042 bytes) 2024-04-23T23:39:11.134 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:11.135 INFO:teuthology.orchestra.run.smithi077.stdout:5135 punch from 0x52d7b20 to 0x52dfb70, (0x8050 bytes) 2024-04-23T23:39:11.135 INFO:teuthology.orchestra.run.smithi077.stdout:5136 read 0xc399dcf thru 0xc3a6a5e (0xcc90 bytes) 2024-04-23T23:39:11.135 INFO:teuthology.orchestra.run.smithi077.stdout:5137 write 0x127b204 thru 0x1281422 (0x621f bytes) 2024-04-23T23:39:11.137 INFO:teuthology.orchestra.run.smithi077.stdout:5139 writesame 0x351f538 thru 0x352db85 data_size 0x29(0xe64e bytes) 2024-04-23T23:39:11.141 INFO:teuthology.orchestra.run.smithi077.stdout:5140 writesame 0xc12bc2c thru 0xc1348b3 data_size 0xc(0x8c88 bytes) 2024-04-23T23:39:11.145 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:11.158+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:11.146 INFO:teuthology.orchestra.run.smithi077.stdout:5141 read 0xae55be3 thru 0xae63cf0 (0xe10e bytes) 2024-04-23T23:39:11.146 INFO:teuthology.orchestra.run.smithi077.stdout:5142 writesame 0xe70e236 thru 0xe7190af data_size 0x17(0xae7a bytes) 2024-04-23T23:39:11.147 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:11.148 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:39:11.151 INFO:teuthology.orchestra.run.smithi077.stdout:5143 writesame 0xbb3d9e0 thru 0xbb43d14 data_size 0x1(0x6335 bytes) 2024-04-23T23:39:11.160 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-04-23T23:39:10.811912+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1759668793,"num_objects":2426,"num_object_clones":305,"num_object_copies":4852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":230,"num_objects_misplaced":66,"num_objects_unfound":0,"num_objects_dirty":2426,"num_whiteouts":1352,"num_read":148461,"num_read_kb":932271,"num_write":17224,"num_write_kb":548128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5117,"num_bytes_recovered":279305124,"num_keys_recovered":769,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14664,"ondisk_log_size":14664,"up":82,"acting":79,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":80,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":629728,"kb_used_data":450520,"kb_used_omap":10,"kb_used_meta":179125,"kb_avail":471229472,"statfs":{"total":483183820800,"available":482538979328,"internally_reserved":0,"allocated":461332480,"data_stored":559895454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10877,"internal_metadata":183424387},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":4096},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":224765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":103,"num_objects_misplaced":66,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":961,"num_read_kb":9299,"num_write":61,"num_write_kb":3697,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":826,"num_bytes_recovered":43577907,"num_keys_recovered":130,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.999948"},"pg_stats":[{"pgid":"3.1f","version":"99'472","reported_seq":3824,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.820949+0000","last_change":"2024-04-23T23:38:44.815145+0000","last_active":"2024-04-23T23:39:07.820949+0000","last_peered":"2024-04-23T23:39:07.820949+0000","last_clean":"2024-04-23T23:39:07.820949+0000","last_became_active":"2024-04-23T23:38:44.813152+0000","last_became_peered":"2024-04-23T23:38:44.813152+0000","last_unstale":"2024-04-23T23:39:07.820949+0000","last_undegraded":"2024-04-23T23:39:07.820949+0000","last_fullsized":"2024-04-23T23:39:07.820949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:27:12.339114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036166670000000001,"stat_sum":{"num_bytes":38439797,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":43,"num_read":4574,"num_read_kb":16528,"num_write":516,"num_write_kb":4417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":3224152,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"93'365","reported_seq":3135,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:10.004561+0000","last_change":"2024-04-23T23:38:29.052716+0000","last_active":"2024-04-23T23:39:10.004561+0000","last_peered":"2024-04-23T23:39:10.004561+0000","last_clean":"2024-04-23T23:39:10.004561+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:39:10.004561+0000","last_undegraded":"2024-04-23T23:39:10.004561+0000","last_fullsized":"2024-04-23T23:39:10.004561+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:05:19.109531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061879000000000003,"stat_sum":{"num_bytes":48208677,"num_objects":90,"num_object_clones":8,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":53,"num_read":3428,"num_read_kb":20221,"num_write":302,"num_write_kb":5016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"93'409","reported_seq":3596,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.871653+0000","last_change":"2024-04-23T23:39:04.817002+0000","last_active":"2024-04-23T23:39:07.871653+0000","last_peered":"2024-04-23T23:39:07.871653+0000","last_clean":"2024-04-23T23:39:07.871653+0000","last_became_active":"2024-04-23T23:39:04.816060+0000","last_became_peered":"2024-04-23T23:39:04.816060+0000","last_unstale":"2024-04-23T23:39:07.871653+0000","last_undegraded":"2024-04-23T23:39:07.871653+0000","last_fullsized":"2024-04-23T23:39:07.871653+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:09:27.122580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013335580000000001,"stat_sum":{"num_bytes":29688404,"num_objects":84,"num_object_clones":14,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":45,"num_read":4113,"num_read_kb":24000,"num_write":443,"num_write_kb":23333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"98'493","reported_seq":4150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.818217+0000","last_change":"2024-04-23T23:39:03.818256+0000","last_active":"2024-04-23T23:39:07.818217+0000","last_peered":"2024-04-23T23:39:07.818217+0000","last_clean":"2024-04-23T23:39:07.818217+0000","last_became_active":"2024-04-23T23:39:03.817321+0000","last_became_peered":"2024-04-23T23:39:03.817321+0000","last_unstale":"2024-04-23T23:39:07.818217+0000","last_undegraded":"2024-04-23T23:39:07.818217+0000","last_fullsized":"2024-04-23T23:39:07.818217+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:41.882052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51704264,"num_objects":79,"num_object_clones":11,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":47,"num_read":5852,"num_read_kb":36216,"num_write":475,"num_write_kb":13817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"102'673","reported_seq":2959,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.814905+0000","last_change":"2024-04-23T23:39:06.824155+0000","last_active":"2024-04-23T23:39:09.814905+0000","last_peered":"2024-04-23T23:39:09.814905+0000","last_clean":"2024-04-23T23:39:09.814905+0000","last_became_active":"2024-04-23T23:39:06.823397+0000","last_became_peered":"2024-04-23T23:39:06.823397+0000","last_unstale":"2024-04-23T23:39:09.814905+0000","last_undegraded":"2024-04-23T23:39:09.814905+0000","last_fullsized":"2024-04-23T23:39:09.814905+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":673,"log_dups_size":0,"ondisk_log_size":673,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:28.780435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048779100000000001,"stat_sum":{"num_bytes":29120749,"num_objects":78,"num_object_clones":9,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":47,"num_read":4317,"num_read_kb":25211,"num_write":981,"num_write_kb":27218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":258,"num_bytes_recovered":19138163,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"104'514","reported_seq":4125,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.998497+0000","last_change":"2024-04-23T23:39:03.813310+0000","last_active":"2024-04-23T23:39:09.998497+0000","last_peered":"2024-04-23T23:39:09.998497+0000","last_clean":"2024-04-23T23:39:09.998497+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:39:09.998497+0000","last_undegraded":"2024-04-23T23:39:09.998497+0000","last_fullsized":"2024-04-23T23:39:09.998497+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:19.956995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109447,"stat_sum":{"num_bytes":45823515,"num_objects":66,"num_object_clones":6,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":35,"num_read":5434,"num_read_kb":22034,"num_write":652,"num_write_kb":17893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"93'445","reported_seq":4518,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-23T23:39:05.829044+0000","last_change":"2024-04-23T23:39:05.824747+0000","last_active":"2024-04-23T23:39:05.829044+0000","last_peered":"2024-04-23T23:39:05.829044+0000","last_clean":"2024-04-23T23:39:05.829044+0000","last_became_active":"2024-04-23T23:39:05.823040+0000","last_became_peered":"2024-04-23T23:39:05.823040+0000","last_unstale":"2024-04-23T23:39:05.829044+0000","last_undegraded":"2024-04-23T23:39:05.829044+0000","last_fullsized":"2024-04-23T23:39:05.829044+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:59.662521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044664900000000003,"stat_sum":{"num_bytes":141438648,"num_objects":99,"num_object_clones":14,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":55,"num_read":3724,"num_read_kb":39507,"num_write":397,"num_write_kb":27719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":15840300,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"93'358","reported_seq":2204,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-23T23:39:05.817672+0000","last_change":"2024-04-23T23:38:44.810906+0000","last_active":"2024-04-23T23:39:05.817672+0000","last_peered":"2024-04-23T23:39:05.817672+0000","last_clean":"2024-04-23T23:39:05.817672+0000","last_became_active":"2024-04-23T23:38:44.809902+0000","last_became_peered":"2024-04-23T23:38:44.809902+0000","last_unstale":"2024-04-23T23:39:05.817672+0000","last_undegraded":"2024-04-23T23:39:05.817672+0000","last_fullsized":"2024-04-23T23:39:05.817672+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":358,"log_dups_size":0,"ondisk_log_size":358,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:10.597316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091463299999999998,"stat_sum":{"num_bytes":52507714,"num_objects":69,"num_object_clones":11,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":38,"num_read":2041,"num_read_kb":23569,"num_write":457,"num_write_kb":17758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":16101144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"93'347","reported_seq":4043,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.820893+0000","last_change":"2024-04-23T23:38:44.815156+0000","last_active":"2024-04-23T23:39:07.820893+0000","last_peered":"2024-04-23T23:39:07.820893+0000","last_clean":"2024-04-23T23:39:07.820893+0000","last_became_active":"2024-04-23T23:38:44.814027+0000","last_became_peered":"2024-04-23T23:38:44.814027+0000","last_unstale":"2024-04-23T23:39:07.820893+0000","last_undegraded":"2024-04-23T23:39:07.820893+0000","last_fullsized":"2024-04-23T23:39:07.820893+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":347,"log_dups_size":0,"ondisk_log_size":347,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:57.275490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035554319999999999,"stat_sum":{"num_bytes":80016186,"num_objects":73,"num_object_clones":8,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":42,"num_read":4161,"num_read_kb":45153,"num_write":440,"num_write_kb":35863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":34599238,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"102'476","reported_seq":3366,"reported_epoch":102,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2024-04-23T23:39:07.880138+0000","last_change":"2024-04-23T23:39:07.880208+0000","last_active":"2024-04-23T23:39:07.880138+0000","last_peered":"2024-04-23T23:39:07.880138+0000","last_clean":"2024-04-23T23:39:04.864555+0000","last_became_active":"2024-04-23T23:39:07.833562+0000","last_became_peered":"2024-04-23T23:39:07.833562+0000","last_unstale":"2024-04-23T23:39:07.880138+0000","last_undegraded":"2024-04-23T23:39:07.880138+0000","last_fullsized":"2024-04-23T23:39:07.817990+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012770870000000001,"stat_sum":{"num_bytes":46334617,"num_objects":68,"num_object_clones":10,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":66,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":38,"num_read":4333,"num_read_kb":27079,"num_write":565,"num_write_kb":23874,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":115981,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5],"avail_no_missing":["5","7"],"object_location_counts":[{"shards":"5","objects":1},{"shards":"5,7","objects":66}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"93'331","reported_seq":3405,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.819018+0000","last_change":"2024-04-23T23:39:09.817144+0000","last_active":"2024-04-23T23:39:09.819018+0000","last_peered":"2024-04-23T23:39:09.819018+0000","last_clean":"2024-04-23T23:39:09.819018+0000","last_became_active":"2024-04-23T23:39:09.816070+0000","last_became_peered":"2024-04-23T23:39:09.816070+0000","last_unstale":"2024-04-23T23:39:09.819018+0000","last_undegraded":"2024-04-23T23:39:09.819018+0000","last_fullsized":"2024-04-23T23:39:09.819018+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:19:12.734860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066396700000000001,"stat_sum":{"num_bytes":55345388,"num_objects":97,"num_object_clones":11,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":66,"num_read":2420,"num_read_kb":17673,"num_write":263,"num_write_kb":15052,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":18174444,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"104'625","reported_seq":3484,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.821006+0000","last_change":"2024-04-23T23:39:09.819191+0000","last_active":"2024-04-23T23:39:09.821006+0000","last_peered":"2024-04-23T23:39:09.821006+0000","last_clean":"2024-04-23T23:39:09.821006+0000","last_became_active":"2024-04-23T23:39:09.816573+0000","last_became_peered":"2024-04-23T23:39:09.816573+0000","last_unstale":"2024-04-23T23:39:09.821006+0000","last_undegraded":"2024-04-23T23:39:09.821006+0000","last_fullsized":"2024-04-23T23:39:09.821006+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:08:20.270126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000411357,"stat_sum":{"num_bytes":17433833,"num_objects":74,"num_object_clones":6,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":42,"num_read":5091,"num_read_kb":10872,"num_write":815,"num_write_kb":4865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":274,"num_bytes_recovered":6692999,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.818938+0000","last_change":"2024-04-23T23:39:06.819217+0000","last_active":"2024-04-23T23:39:09.818938+0000","last_peered":"2024-04-23T23:39:09.818938+0000","last_clean":"2024-04-23T23:39:09.818938+0000","last_became_active":"2024-04-23T23:39:06.818805+0000","last_became_peered":"2024-04-23T23:39:06.818805+0000","last_unstale":"2024-04-23T23:39:09.818938+0000","last_undegraded":"2024-04-23T23:39:09.818938+0000","last_fullsized":"2024-04-23T23:39:09.818938+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:10:59.164225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"98'287","reported_seq":3667,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-23T23:39:05.817037+0000","last_change":"2024-04-23T23:39:03.817855+0000","last_active":"2024-04-23T23:39:05.817037+0000","last_peered":"2024-04-23T23:39:05.817037+0000","last_clean":"2024-04-23T23:39:05.817037+0000","last_became_active":"2024-04-23T23:39:03.817144+0000","last_became_peered":"2024-04-23T23:39:03.817144+0000","last_unstale":"2024-04-23T23:39:05.817037+0000","last_undegraded":"2024-04-23T23:39:05.817037+0000","last_fullsized":"2024-04-23T23:39:05.817037+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:21:57.781194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043457199999999999,"stat_sum":{"num_bytes":74810911,"num_objects":66,"num_object_clones":7,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":37,"num_read":3451,"num_read_kb":28175,"num_write":255,"num_write_kb":1847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":1741635,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":172,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-23T23:39:05.817128+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:39:05.817128+0000","last_peered":"2024-04-23T23:39:05.817128+0000","last_clean":"2024-04-23T23:39:05.817128+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:39:05.817128+0000","last_undegraded":"2024-04-23T23:39:05.817128+0000","last_fullsized":"2024-04-23T23:39:05.817128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"98'675","reported_seq":3704,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-23T23:39:07.855433+0000","last_change":"2024-04-23T23:39:07.851212+0000","last_active":"2024-04-23T23:39:07.855433+0000","last_peered":"2024-04-23T23:39:07.855433+0000","last_clean":"2024-04-23T23:39:04.846664+0000","last_became_active":"2024-04-23T23:39:07.849868+0000","last_became_peered":"2024-04-23T23:39:07.849868+0000","last_unstale":"2024-04-23T23:39:07.855433+0000","last_undegraded":"2024-04-23T23:39:07.820379+0000","last_fullsized":"2024-04-23T23:39:07.817991+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":675,"log_dups_size":0,"ondisk_log_size":675,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000861358,"stat_sum":{"num_bytes":51232886,"num_objects":76,"num_object_clones":8,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":106,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":41,"num_read":5551,"num_read_kb":54190,"num_write":991,"num_write_kb":14851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":124,"num_bytes_recovered":11031257,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5],"avail_no_missing":["5","7"],"object_location_counts":[{"shards":"5,7","objects":76}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.814970+0000","last_change":"2024-04-23T23:39:06.826203+0000","last_active":"2024-04-23T23:39:09.814970+0000","last_peered":"2024-04-23T23:39:09.814970+0000","last_clean":"2024-04-23T23:39:09.814970+0000","last_became_active":"2024-04-23T23:39:06.825912+0000","last_became_peered":"2024-04-23T23:39:06.825912+0000","last_unstale":"2024-04-23T23:39:09.814970+0000","last_undegraded":"2024-04-23T23:39:09.814970+0000","last_fullsized":"2024-04-23T23:39:09.814970+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:48:08.669634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"93'339","reported_seq":2269,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-23T23:39:05.816181+0000","last_change":"2024-04-23T23:37:33.804737+0000","last_active":"2024-04-23T23:39:05.816181+0000","last_peered":"2024-04-23T23:39:05.816181+0000","last_clean":"2024-04-23T23:39:05.816181+0000","last_became_active":"2024-04-23T23:37:31.799126+0000","last_became_peered":"2024-04-23T23:37:31.799126+0000","last_unstale":"2024-04-23T23:39:05.816181+0000","last_undegraded":"2024-04-23T23:39:05.816181+0000","last_fullsized":"2024-04-23T23:39:05.816181+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:52.242433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000552153,"stat_sum":{"num_bytes":52482507,"num_objects":64,"num_object_clones":7,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":30,"num_read":2347,"num_read_kb":30579,"num_write":336,"num_write_kb":13418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":99,"state":"peering","last_fresh":"2024-04-23T23:39:04.812472+0000","last_change":"2024-04-23T23:39:05.816676+0000","last_active":"2024-04-23T23:39:05.816676+0000","last_peered":"2024-04-23T23:39:04.812472+0000","last_clean":"2024-04-23T23:39:04.812472+0000","last_became_active":"2024-04-23T23:38:42.158903+0000","last_became_peered":"2024-04-23T23:38:42.158903+0000","last_unstale":"2024-04-23T23:39:04.812472+0000","last_undegraded":"2024-04-23T23:39:04.812472+0000","last_fullsized":"2024-04-23T23:39:04.812472+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"93'672","reported_seq":2025,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.818625+0000","last_change":"2024-04-23T23:38:19.815075+0000","last_active":"2024-04-23T23:39:07.818625+0000","last_peered":"2024-04-23T23:39:07.818625+0000","last_clean":"2024-04-23T23:39:07.818625+0000","last_became_active":"2024-04-23T23:38:19.813635+0000","last_became_peered":"2024-04-23T23:38:19.813635+0000","last_unstale":"2024-04-23T23:39:07.818625+0000","last_undegraded":"2024-04-23T23:39:07.818625+0000","last_fullsized":"2024-04-23T23:39:07.818625+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":672,"log_dups_size":0,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:33.261244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014827079999999999,"stat_sum":{"num_bytes":29692431,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":47,"num_read":4450,"num_read_kb":27781,"num_write":1036,"num_write_kb":22777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"93'384","reported_seq":3096,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.814583+0000","last_change":"2024-04-23T23:39:05.818157+0000","last_active":"2024-04-23T23:39:09.814583+0000","last_peered":"2024-04-23T23:39:09.814583+0000","last_clean":"2024-04-23T23:39:09.814583+0000","last_became_active":"2024-04-23T23:39:05.817222+0000","last_became_peered":"2024-04-23T23:39:05.817222+0000","last_unstale":"2024-04-23T23:39:09.814583+0000","last_undegraded":"2024-04-23T23:39:09.814583+0000","last_fullsized":"2024-04-23T23:39:09.814583+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:29:12.227708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400399999999997,"stat_sum":{"num_bytes":17860762,"num_objects":72,"num_object_clones":13,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":38,"num_read":3205,"num_read_kb":19431,"num_write":452,"num_write_kb":11178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11294254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.818034+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:39:07.818034+0000","last_peered":"2024-04-23T23:39:07.818034+0000","last_clean":"2024-04-23T23:39:07.818034+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:39:07.818034+0000","last_undegraded":"2024-04-23T23:39:07.818034+0000","last_fullsized":"2024-04-23T23:39:07.818034+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"99'425","reported_seq":2056,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-04-23T23:39:05.818527+0000","last_change":"2024-04-23T23:37:33.804968+0000","last_active":"2024-04-23T23:39:05.818527+0000","last_peered":"2024-04-23T23:39:05.818527+0000","last_clean":"2024-04-23T23:39:05.818527+0000","last_became_active":"2024-04-23T23:37:31.799146+0000","last_became_peered":"2024-04-23T23:37:31.799146+0000","last_unstale":"2024-04-23T23:39:05.818527+0000","last_undegraded":"2024-04-23T23:39:05.818527+0000","last_fullsized":"2024-04-23T23:39:05.818527+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:05:44.961810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055612800000000003,"stat_sum":{"num_bytes":89009518,"num_objects":79,"num_object_clones":9,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":41,"num_read":2259,"num_read_kb":42196,"num_write":613,"num_write_kb":67694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.818706+0000","last_change":"2024-04-23T23:38:42.163377+0000","last_active":"2024-04-23T23:39:09.818706+0000","last_peered":"2024-04-23T23:39:09.818706+0000","last_clean":"2024-04-23T23:39:09.818706+0000","last_became_active":"2024-04-23T23:38:42.163067+0000","last_became_peered":"2024-04-23T23:38:42.163067+0000","last_unstale":"2024-04-23T23:39:09.818706+0000","last_undegraded":"2024-04-23T23:39:09.818706+0000","last_fullsized":"2024-04-23T23:39:09.818706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:15.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"102'581","reported_seq":3822,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.815085+0000","last_change":"2024-04-23T23:39:05.821214+0000","last_active":"2024-04-23T23:39:09.815085+0000","last_peered":"2024-04-23T23:39:09.815085+0000","last_clean":"2024-04-23T23:39:09.815085+0000","last_became_active":"2024-04-23T23:39:05.820082+0000","last_became_peered":"2024-04-23T23:39:05.820082+0000","last_unstale":"2024-04-23T23:39:09.815085+0000","last_undegraded":"2024-04-23T23:39:09.815085+0000","last_fullsized":"2024-04-23T23:39:09.815085+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:51.219439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047655700000000001,"stat_sum":{"num_bytes":75620116,"num_objects":56,"num_object_clones":5,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":35,"num_read":4592,"num_read_kb":16123,"num_write":830,"num_write_kb":10205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":5883246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":122,"reported_epoch":99,"state":"peering","last_fresh":"2024-04-23T23:39:04.811666+0000","last_change":"2024-04-23T23:39:05.818826+0000","last_active":"2024-04-23T23:39:05.818826+0000","last_peered":"2024-04-23T23:39:04.811666+0000","last_clean":"2024-04-23T23:39:04.811666+0000","last_became_active":"2024-04-23T23:38:05.927354+0000","last_became_peered":"2024-04-23T23:38:05.927354+0000","last_unstale":"2024-04-23T23:39:04.811666+0000","last_undegraded":"2024-04-23T23:39:04.811666+0000","last_fullsized":"2024-04-23T23:39:04.811666+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5,7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"97'579","reported_seq":1853,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.818142+0000","last_change":"2024-04-23T23:38:19.814491+0000","last_active":"2024-04-23T23:39:07.818142+0000","last_peered":"2024-04-23T23:39:07.818142+0000","last_clean":"2024-04-23T23:39:07.818142+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:39:07.818142+0000","last_undegraded":"2024-04-23T23:39:07.818142+0000","last_fullsized":"2024-04-23T23:39:07.818142+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":579,"log_dups_size":0,"ondisk_log_size":579,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:23.952760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000789393,"stat_sum":{"num_bytes":40421881,"num_objects":58,"num_object_clones":5,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":30,"num_read":3419,"num_read_kb":5923,"num_write":733,"num_write_kb":2916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":172,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.818790+0000","last_change":"2024-04-23T23:37:32.837969+0000","last_active":"2024-04-23T23:39:09.818790+0000","last_peered":"2024-04-23T23:39:09.818790+0000","last_clean":"2024-04-23T23:39:09.818790+0000","last_became_active":"2024-04-23T23:37:32.837752+0000","last_became_peered":"2024-04-23T23:37:32.837752+0000","last_unstale":"2024-04-23T23:39:09.818790+0000","last_undegraded":"2024-04-23T23:39:09.818790+0000","last_fullsized":"2024-04-23T23:39:09.818790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:24.064742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":1,"reported_epoch":100,"state":"unknown","last_fresh":"2024-04-23T23:39:05.817071+0000","last_change":"2024-04-23T23:39:06.250663+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-23T23:39:05.817071+0000","last_undegraded":"2024-04-23T23:39:05.817071+0000","last_fullsized":"2024-04-23T23:39:05.817071+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"93'260","reported_seq":17810,"reported_epoch":99,"state":"peering","last_fresh":"2024-04-23T23:39:04.811479+0000","last_change":"2024-04-23T23:39:05.818396+0000","last_active":"2024-04-23T23:39:05.818396+0000","last_peered":"2024-04-23T23:39:04.811479+0000","last_clean":"2024-04-23T23:39:04.811479+0000","last_became_active":"2024-04-23T23:38:19.808534+0000","last_became_peered":"2024-04-23T23:38:19.808534+0000","last_unstale":"2024-04-23T23:39:04.811479+0000","last_undegraded":"2024-04-23T23:39:04.811479+0000","last_fullsized":"2024-04-23T23:39:04.811479+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701399999999997,"stat_sum":{"num_bytes":48268983,"num_objects":79,"num_object_clones":10,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":50,"num_read":17350,"num_read_kb":32480,"num_write":254,"num_write_kb":20607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":54,"num_bytes_recovered":5130309,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"102'353","reported_seq":4646,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.814939+0000","last_change":"2024-04-23T23:39:03.814910+0000","last_active":"2024-04-23T23:39:09.814939+0000","last_peered":"2024-04-23T23:39:09.814939+0000","last_clean":"2024-04-23T23:39:09.814939+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:39:09.814939+0000","last_undegraded":"2024-04-23T23:39:09.814939+0000","last_fullsized":"2024-04-23T23:39:09.814939+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:42:16.123164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078111900000000004,"stat_sum":{"num_bytes":66148854,"num_objects":83,"num_object_clones":13,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":46,"num_read":4303,"num_read_kb":26723,"num_write":311,"num_write_kb":28785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"104'646","reported_seq":2752,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:10.005412+0000","last_change":"2024-04-23T23:39:05.817000+0000","last_active":"2024-04-23T23:39:10.005412+0000","last_peered":"2024-04-23T23:39:10.005412+0000","last_clean":"2024-04-23T23:39:10.005412+0000","last_became_active":"2024-04-23T23:39:05.815581+0000","last_became_peered":"2024-04-23T23:39:05.815581+0000","last_unstale":"2024-04-23T23:39:10.005412+0000","last_undegraded":"2024-04-23T23:39:10.005412+0000","last_fullsized":"2024-04-23T23:39:10.005412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":646,"log_dups_size":0,"ondisk_log_size":646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:03:13.323098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036496,"stat_sum":{"num_bytes":23266642,"num_objects":72,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":34,"num_read":4244,"num_read_kb":19164,"num_write":845,"num_write_kb":7846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"99'378","reported_seq":4805,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.814830+0000","last_change":"2024-04-23T23:39:04.822168+0000","last_active":"2024-04-23T23:39:09.814830+0000","last_peered":"2024-04-23T23:39:09.814830+0000","last_clean":"2024-04-23T23:39:09.814830+0000","last_became_active":"2024-04-23T23:39:04.819875+0000","last_became_peered":"2024-04-23T23:39:04.819875+0000","last_unstale":"2024-04-23T23:39:09.814830+0000","last_undegraded":"2024-04-23T23:39:09.814830+0000","last_fullsized":"2024-04-23T23:39:09.814830+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:25:55.838615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070273799999999995,"stat_sum":{"num_bytes":83495001,"num_objects":85,"num_object_clones":14,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":39,"num_read":4530,"num_read_kb":39852,"num_write":326,"num_write_kb":10704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":11368218,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"93'329","reported_seq":4462,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-23T23:39:07.818207+0000","last_change":"2024-04-23T23:38:19.814484+0000","last_active":"2024-04-23T23:39:07.818207+0000","last_peered":"2024-04-23T23:39:07.818207+0000","last_clean":"2024-04-23T23:39:07.818207+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:39:07.818207+0000","last_undegraded":"2024-04-23T23:39:07.818207+0000","last_fullsized":"2024-04-23T23:39:07.818207+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":329,"log_dups_size":0,"ondisk_log_size":329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:42:06.622257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001080988,"stat_sum":{"num_bytes":95875227,"num_objects":90,"num_object_clones":13,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":47,"num_read":4292,"num_read_kb":49124,"num_write":294,"num_write_kb":13391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"93'363","reported_seq":3568,"reported_epoch":102,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2024-04-23T23:39:07.834325+0000","last_change":"2024-04-23T23:39:07.834986+0000","last_active":"2024-04-23T23:39:07.834325+0000","last_peered":"2024-04-23T23:39:07.834325+0000","last_clean":"2024-04-23T23:39:04.813916+0000","last_became_active":"2024-04-23T23:39:07.833598+0000","last_became_peered":"2024-04-23T23:39:07.833598+0000","last_unstale":"2024-04-23T23:39:07.834325+0000","last_undegraded":"2024-04-23T23:39:07.819883+0000","last_fullsized":"2024-04-23T23:39:07.818326+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090758899999999999,"stat_sum":{"num_bytes":23845653,"num_objects":82,"num_object_clones":13,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":123,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":4600,"num_read_kb":28473,"num_write":320,"num_write_kb":6028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":22374,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5],"avail_no_missing":["5","7"],"object_location_counts":[{"shards":"5,7","objects":82}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"93'667","reported_seq":4736,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.822523+0000","last_change":"2024-04-23T23:39:09.821178+0000","last_active":"2024-04-23T23:39:09.822523+0000","last_peered":"2024-04-23T23:39:09.822523+0000","last_clean":"2024-04-23T23:39:09.822523+0000","last_became_active":"2024-04-23T23:39:09.820009+0000","last_became_peered":"2024-04-23T23:39:09.820009+0000","last_unstale":"2024-04-23T23:39:09.822523+0000","last_undegraded":"2024-04-23T23:39:09.822523+0000","last_fullsized":"2024-04-23T23:39:09.822523+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:55:10.599602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727580000000001,"stat_sum":{"num_bytes":73508146,"num_objects":74,"num_object_clones":10,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":39,"num_read":6660,"num_read_kb":28518,"num_write":804,"num_write_kb":9973,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":6150574,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"102'562","reported_seq":4229,"reported_epoch":104,"state":"peering","last_fresh":"2024-04-23T23:39:09.815498+0000","last_change":"2024-04-23T23:39:09.815498+0000","last_active":"2024-04-23T23:39:09.815498+0000","last_peered":"2024-04-23T23:39:09.049016+0000","last_clean":"2024-04-23T23:38:59.886385+0000","last_became_active":"2024-04-23T23:39:07.848660+0000","last_became_peered":"2024-04-23T23:39:07.848660+0000","last_unstale":"2024-04-23T23:39:09.815498+0000","last_undegraded":"2024-04-23T23:39:09.815498+0000","last_fullsized":"2024-04-23T23:39:09.815498+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001215793,"stat_sum":{"num_bytes":86333966,"num_objects":83,"num_object_clones":15,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":43,"num_read":4663,"num_read_kb":45754,"num_write":635,"num_write_kb":20782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":376,"num_bytes_recovered":17288489,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"93'361","reported_seq":2901,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.813249+0000","last_change":"2024-04-23T23:38:44.814041+0000","last_active":"2024-04-23T23:39:09.813249+0000","last_peered":"2024-04-23T23:39:09.813249+0000","last_clean":"2024-04-23T23:39:09.813249+0000","last_became_active":"2024-04-23T23:38:44.813024+0000","last_became_peered":"2024-04-23T23:38:44.813024+0000","last_unstale":"2024-04-23T23:39:09.813249+0000","last_undegraded":"2024-04-23T23:39:09.813249+0000","last_fullsized":"2024-04-23T23:39:09.813249+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":361,"log_dups_size":0,"ondisk_log_size":361,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:47:37.737835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044726999999999999,"stat_sum":{"num_bytes":54884046,"num_objects":75,"num_object_clones":8,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":42,"num_read":3033,"num_read_kb":15031,"num_write":416,"num_write_kb":23169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":6225512,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"102'365","reported_seq":5416,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.818073+0000","last_change":"2024-04-23T23:39:09.818073+0000","last_active":"2024-04-23T23:39:09.818073+0000","last_peered":"2024-04-23T23:39:09.818073+0000","last_clean":"2024-04-23T23:39:09.818073+0000","last_became_active":"2024-04-23T23:39:09.816446+0000","last_became_peered":"2024-04-23T23:39:09.816446+0000","last_unstale":"2024-04-23T23:39:09.818073+0000","last_undegraded":"2024-04-23T23:39:09.818073+0000","last_fullsized":"2024-04-23T23:39:09.818073+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:23:24.326761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318700000000001,"stat_sum":{"num_bytes":66828147,"num_objects":78,"num_object_clones":12,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":40,"num_read":5334,"num_read_kb":60229,"num_write":314,"num_write_kb":18465,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":30597124,"num_keys_recovered":27,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"93'611","reported_seq":4990,"reported_epoch":100,"state":"unknown","last_fresh":"2024-04-23T23:39:05.817395+0000","last_change":"2024-04-23T23:39:06.250719+0000","last_active":"2024-04-23T23:39:05.817395+0000","last_peered":"2024-04-23T23:38:59.241598+0000","last_clean":"2024-04-23T23:38:59.241598+0000","last_became_active":"2024-04-23T23:38:45.813751+0000","last_became_peered":"2024-04-23T23:38:45.813751+0000","last_unstale":"2024-04-23T23:39:05.817395+0000","last_undegraded":"2024-04-23T23:39:05.817395+0000","last_fullsized":"2024-04-23T23:39:05.817395+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064394099999999998,"stat_sum":{"num_bytes":26124924,"num_objects":70,"num_object_clones":5,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":40,"num_read":6510,"num_read_kb":35095,"num_write":860,"num_write_kb":20935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12161398,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"93'319","reported_seq":3982,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-04-23T23:39:09.814894+0000","last_change":"2024-04-23T23:39:06.820108+0000","last_active":"2024-04-23T23:39:09.814894+0000","last_peered":"2024-04-23T23:39:09.814894+0000","last_clean":"2024-04-23T23:39:09.814894+0000","last_became_active":"2024-04-23T23:39:06.818912+0000","last_became_peered":"2024-04-23T23:39:06.818912+0000","last_unstale":"2024-04-23T23:39:09.814894+0000","last_undegraded":"2024-04-23T23:39:09.814894+0000","last_fullsized":"2024-04-23T23:39:09.814894+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:53.128545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045588699999999998,"stat_sum":{"num_bytes":43896400,"num_objects":59,"num_object_clones":5,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":35,"num_read":4180,"num_read_kb":19367,"num_write":293,"num_write_kb":5732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":2237133,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1759668793,"num_objects":2426,"num_object_clones":305,"num_object_copies":4852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":230,"num_objects_misplaced":66,"num_objects_unfound":0,"num_objects_dirty":2426,"num_whiteouts":1352,"num_read":148461,"num_read_kb":932271,"num_write":17224,"num_write_kb":548128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5117,"num_bytes_recovered":279305124,"num_keys_recovered":769,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":500551680,"data_stored":622443487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":14664,"ondisk_log_size":14664,"up":64,"acting":61,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127476,"kb_used_data":96292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94244364,"statfs":{"total":96636764160,"available":96506228736,"internally_reserved":0,"allocated":98603008,"data_stored":120798956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":0,"seq":55834574874,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107352,"kb_used_data":72008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94264488,"statfs":{"total":96636764160,"available":96526835712,"internally_reserved":0,"allocated":73736192,"data_stored":81385637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855376,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112080,"kb_used_data":83968,"kb_used_omap":4,"kb_used_meta":28091,"kb_avail":94259760,"statfs":{"total":96636764160,"available":96521994240,"internally_reserved":0,"allocated":85983232,"data_stored":104995346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":28765806},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,1],"upper_bound":4096},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":174600,"kb_used_data":129532,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94197240,"statfs":{"total":96636764160,"available":96457973760,"internally_reserved":0,"allocated":132640768,"data_stored":160837570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108220,"kb_used_data":68720,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94263620,"statfs":{"total":96636764160,"available":96525946880,"internally_reserved":0,"allocated":70369280,"data_stored":91877945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":14347775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":97415168,"data_stored":120238726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69152768,"data_stored":91298770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":131420160,"data_stored":160258380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":84783104,"data_stored":104428700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71905280,"data_stored":80210164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7106560,"data_stored":10799346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:39:11.162 INFO:teuthology.orchestra.run.smithi077.stdout:5144 write 0xeb9dc89 thru 0xeb9ec40 (0xfb8 bytes) 2024-04-23T23:39:11.164 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.165 INFO:teuthology.orchestra.run.smithi077.stdout:5146 write 0x6121724 thru 0x6131300 (0xfbdd bytes) 2024-04-23T23:39:11.168 INFO:teuthology.orchestra.run.smithi077.stdout:5147 write 0x5e7b536 thru 0x5e7ebeb (0x36b6 bytes) 2024-04-23T23:39:11.172 INFO:teuthology.orchestra.run.smithi077.stdout:5148 read 0xc40bd48 thru 0xc41862f (0xc8e8 bytes) 2024-04-23T23:39:11.172 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.172 INFO:teuthology.orchestra.run.smithi077.stdout:5150 read 0x5087998 thru 0x50888ed (0xf56 bytes) 2024-04-23T23:39:11.172 INFO:teuthology.orchestra.run.smithi077.stdout:5151 write 0xb17b0ce thru 0xb180582 (0x54b5 bytes) 2024-04-23T23:39:11.176 INFO:teuthology.orchestra.run.smithi077.stdout:5152 punch from 0x49f77c0 to 0x49f98ab, (0x20eb bytes) 2024-04-23T23:39:11.176 INFO:teuthology.orchestra.run.smithi077.stdout:5153 read 0xb75a39f thru 0xb760d10 (0x6972 bytes) 2024-04-23T23:39:11.176 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.182 INFO:teuthology.orchestra.run.smithi077.stdout:5155 trunc from 0xec9b591 to 0x9345a4b 2024-04-23T23:39:11.198 INFO:teuthology.orchestra.run.smithi077.stdout:5159 read 0x86b728e thru 0x86c4731 (0xd4a4 bytes) 2024-04-23T23:39:11.198 INFO:teuthology.orchestra.run.smithi077.stdout:5160 writesame 0x46052be thru 0x460cd1e data_size 0x9(0x7a61 bytes) 2024-04-23T23:39:11.203 INFO:teuthology.orchestra.run.smithi077.stdout:5162 write 0x83cb8bf thru 0x83ce75f (0x2ea1 bytes) 2024-04-23T23:39:11.207 INFO:teuthology.orchestra.run.smithi077.stdout:5163 read 0x8462c2f thru 0x84662cf (0x36a1 bytes) 2024-04-23T23:39:11.215 INFO:teuthology.orchestra.run.smithi077.stdout:5168 write 0xb676a0c thru 0xb676c10 (0x205 bytes) 2024-04-23T23:39:11.219 INFO:teuthology.orchestra.run.smithi077.stdout:5169 read 0x4839bd7 thru 0x48498b1 (0xfcdb bytes) 2024-04-23T23:39:11.220 INFO:teuthology.orchestra.run.smithi077.stdout:5170 punch from 0x4982212 to 0x498fb0f, (0xd8fd bytes) 2024-04-23T23:39:11.220 INFO:teuthology.orchestra.run.smithi077.stdout:5171 punch from 0x36d5247 to 0x36de351, (0x910a bytes) 2024-04-23T23:39:11.220 INFO:teuthology.orchestra.run.smithi077.stdout:5172 read 0x26b6095 thru 0x26b7371 (0x12dd bytes) 2024-04-23T23:39:11.220 INFO:teuthology.orchestra.run.smithi077.stdout:5173 read 0x1c50af8 thru 0x1c5f68a (0xeb93 bytes) 2024-04-23T23:39:11.227 INFO:teuthology.orchestra.run.smithi077.stdout:5174 write 0xcd95e47 thru 0xcda09ab (0xab65 bytes) 2024-04-23T23:39:11.232 INFO:teuthology.orchestra.run.smithi077.stdout:5176 writesame 0x185c7b1 thru 0x1864cc4 data_size 0x66(0x8514 bytes) 2024-04-23T23:39:11.247 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:11.258+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:11.249 INFO:teuthology.orchestra.run.smithi077.stdout:5181 trunc from 0xcda09ac to 0x1edfc42 2024-04-23T23:39:11.258 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.258 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.267 INFO:teuthology.orchestra.run.smithi077.stdout:5183 punch from 0x126bb08 to 0x1271b6f, (0x6067 bytes) 2024-04-23T23:39:11.268 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:11.284 INFO:teuthology.orchestra.run.smithi077.stdout:5184 writesame 0xb286a32 thru 0xb28dc0f data_size 0x6a(0x71de bytes) 2024-04-23T23:39:11.285 INFO:teuthology.orchestra.run.smithi077.stdout:5185 read 0x86d78e0 thru 0x86e5acc (0xe1ed bytes) 2024-04-23T23:39:11.292 INFO:teuthology.orchestra.run.smithi077.stdout:5186 writesame 0xc3b0e70 thru 0xc3b7511 data_size 0x3a(0x66a2 bytes) 2024-04-23T23:39:11.292 INFO:teuthology.orchestra.run.smithi077.stdout:5188 read 0x8dced98 thru 0x8dd09af (0x1c18 bytes) 2024-04-23T23:39:11.301 INFO:teuthology.orchestra.run.smithi077.stdout:5189 trunc from 0xc3b7512 to 0x403ca0b 2024-04-23T23:39:11.316 INFO:teuthology.orchestra.run.smithi077.stdout:5191 trunc from 0x403ca0b to 0xc06b3ee 2024-04-23T23:39:11.323 INFO:teuthology.orchestra.run.smithi077.stdout:5192 write 0x6a76a3c thru 0x6a79e75 (0x343a bytes) 2024-04-23T23:39:11.327 INFO:teuthology.orchestra.run.smithi077.stdout:5193 write 0x324fa2f thru 0x3254f16 (0x54e8 bytes) 2024-04-23T23:39:11.341 INFO:teuthology.orchestra.run.smithi077.stdout:5194 write 0xea237d4 thru 0xea2a4d0 (0x6cfd bytes) 2024-04-23T23:39:11.345 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.346 INFO:teuthology.orchestra.run.smithi077.stdout:5199 write 0x39d60f0 thru 0x39dfe54 (0x9d65 bytes) 2024-04-23T23:39:11.348 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:11.360+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:11.351 INFO:teuthology.orchestra.run.smithi077.stdout:5200 read 0x293bdf9 thru 0x29469a9 (0xabb1 bytes) 2024-04-23T23:39:11.351 INFO:teuthology.orchestra.run.smithi077.stdout:5201 writesame 0x484b5be thru 0x485731c data_size 0x1(0xbd5f bytes) 2024-04-23T23:39:11.387 INFO:teuthology.orchestra.run.smithi077.stdout:5202 writesame 0xeb0e978 thru 0xeb0fb5a data_size 0x1(0x11e3 bytes) 2024-04-23T23:39:11.387 INFO:teuthology.orchestra.run.smithi077.stdout:5203 read 0xa9974ad thru 0xa999213 (0x1d67 bytes) 2024-04-23T23:39:11.387 INFO:teuthology.orchestra.run.smithi077.stdout:5205 punch from 0xad9de8c to 0xad9e3f1, (0x565 bytes) 2024-04-23T23:39:11.387 INFO:teuthology.orchestra.run.smithi077.stdout:5207 write 0xdffb569 thru 0xdffbf92 (0xa2a bytes) 2024-04-23T23:39:11.390 INFO:teuthology.orchestra.run.smithi077.stdout:5210 writesame 0x9a11fe7 thru 0x9a167a9 data_size 0x1(0x47c3 bytes) 2024-04-23T23:39:11.399 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:11.399 INFO:teuthology.orchestra.run.smithi077.stdout:5212 punch from 0x9205bb0 to 0x920f5a2, (0x99f2 bytes) 2024-04-23T23:39:11.399 INFO:teuthology.orchestra.run.smithi077.stdout:5214 read 0x21dc81b thru 0x21ebcd7 (0xf4bd bytes) 2024-04-23T23:39:11.400 INFO:teuthology.orchestra.run.smithi077.stdout:5215 trunc from 0xeb0fb5b to 0xe47e76e 2024-04-23T23:39:11.411 INFO:teuthology.orchestra.run.smithi077.stdout:5216 clone 44 order 20 su 262144 sc 15 2024-04-23T23:39:11.427 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.427 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.436 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:11.449 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:11.462+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:11.539 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.539 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.548 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:11.549 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:11.562+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:11.650 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:11.661+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:11.651 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.651 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.660 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:11.750 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:11.762+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:11.803 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.803 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.812 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:11.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:39:11.859 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:11.871+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:11.914 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:11.914 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:11.923 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:11.968 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:11.980+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:12.032 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone43 intact 2024-04-23T23:39:12.033 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.033 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:12.053 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:12.065+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:12.154 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:12.166+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:12.189 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.189 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.198 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:12.254 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-04-23T23:39:12.254 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:12.266+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:12.262 INFO:teuthology.orchestra.run.smithi077.stdout:5217 read 0xbb2514b thru 0xbb292cf (0x4185 bytes) 2024-04-23T23:39:12.263 INFO:teuthology.orchestra.run.smithi077.stdout:5218 writesame 0x393cd68 thru 0x393cdd9 data_size 0x3(0x72 bytes) 2024-04-23T23:39:12.270 INFO:teuthology.orchestra.run.smithi077.stdout:5219 write 0x29d3bac thru 0x29d73df (0x3834 bytes) 2024-04-23T23:39:12.273 INFO:teuthology.orchestra.run.smithi077.stdout:5220 read 0x442d9ec thru 0x44306cd (0x2ce2 bytes) 2024-04-23T23:39:12.273 INFO:teuthology.orchestra.run.smithi077.stdout:5221 read 0x58cff1e thru 0x58d2630 (0x2713 bytes) 2024-04-23T23:39:12.273 INFO:teuthology.orchestra.run.smithi077.stdout:5222 write 0x192df92 thru 0x1930cbd (0x2d2c bytes) 2024-04-23T23:39:12.276 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:12.276 INFO:teuthology.orchestra.run.smithi077.stdout:5224 write 0x2d6fd4e thru 0x2d78581 (0x8834 bytes) 2024-04-23T23:39:12.278 INFO:teuthology.orchestra.run.smithi077.stdout:5225 writesame 0x402d060 thru 0x40381bd data_size 0x2(0xb15e bytes) 2024-04-23T23:39:12.306 INFO:teuthology.orchestra.run.smithi077.stdout:5226 trunc from 0xe47e76e to 0x51af90d 2024-04-23T23:39:12.340 INFO:teuthology.orchestra.run.smithi077.stdout:5228 write 0xafb40c3 thru 0xafbef69 (0xaea7 bytes) 2024-04-23T23:39:12.344 INFO:teuthology.orchestra.run.smithi077.stdout:5229 punch from 0x496c3e1 to 0x4978900, (0xc51f bytes) 2024-04-23T23:39:12.344 INFO:teuthology.orchestra.run.smithi077.stdout:5230 read 0x7883265 thru 0x7884009 (0xda5 bytes) 2024-04-23T23:39:12.344 INFO:teuthology.orchestra.run.smithi077.stdout:5231 write 0x1377a33 thru 0x138458e (0xcb5c bytes) 2024-04-23T23:39:12.348 INFO:teuthology.orchestra.run.smithi077.stdout:5232 writesame 0x4eb7bae thru 0x4ec08ce data_size 0x1(0x8d21 bytes) 2024-04-23T23:39:12.355 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:12.368+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:12.356 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.356 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.367 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:12.368 INFO:teuthology.orchestra.run.smithi077.stdout:5233 write 0x65bf1b9 thru 0x65bf4d6 (0x31e bytes) 2024-04-23T23:39:12.372 INFO:teuthology.orchestra.run.smithi077.stdout:5234 write 0x873b0c5 thru 0x8744c9e (0x9bda bytes) 2024-04-23T23:39:12.376 INFO:teuthology.orchestra.run.smithi077.stdout:5235 read 0xa3423c0 thru 0xa350e93 (0xead4 bytes) 2024-04-23T23:39:12.376 INFO:teuthology.orchestra.run.smithi077.stdout:5237 punch from 0x918b897 to 0x9196a4d, (0xb1b6 bytes) 2024-04-23T23:39:12.376 INFO:teuthology.orchestra.run.smithi077.stdout:5239 clone 45 order 23 su 131072 sc 12 2024-04-23T23:39:12.456 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:12.468+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:12.470 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.470 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.479 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:12.563 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:12.575+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:12.621 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.621 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.630 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:12.671 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:12.684+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:12.759 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:12.771+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:12.771 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.771 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:12.860 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:12.873+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:12.885 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:12.885 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:12.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:12.943 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:39:12.961 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:12.973+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:13.003 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:13.003 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:13.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:13.036 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone44 from 0xafbef6a (overlap 0x51af90d) to 0x82b281 2024-04-23T23:39:13.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:13.081 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:13.093+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:13.163 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:13.175+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:13.165 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:13.165 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:13.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:13.217 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:13.237 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:13.237 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:13.254 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:13.255 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:13.261 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-04-23T23:39:13.264 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:13.277+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:13.286 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:13.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:13.323 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:13.348 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:13.348 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:13.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.348 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119568 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341556+0000", 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0072611519999999999, 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072854080000000002, 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119568 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.349 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341556+0000", 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341556+0000", 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341557+0000", 2024-04-23T23:39:13.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341559+0000", 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9920000000000002e-06 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341565+0000", 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9429999999999997e-06 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341569+0000", 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4240000000000003e-06 2024-04-23T23:39:13.351 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119609 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342450+0000", 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0063677270000000001, 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0064519529999999999, 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119609 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.352 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342450+0000", 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342450+0000", 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342450+0000", 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342452+0000", 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342460+0000", 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4630000000000004e-06 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342465+0000", 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1390000000000003e-06 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119698 3.0 3.99e18b60 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343912+0000", 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0049058519999999996, 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0050540890000000003, 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119698 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343912+0000", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343912+0000", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343912+0000", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9599999999999999e-07 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343915+0000", 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.243e-06 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343921+0000", 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5869999999999998e-06 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343926+0000", 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1229999999999999e-06 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119760 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344669+0000", 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0041483910000000004, 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0043515480000000002, 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119760 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344669+0000", 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344669+0000", 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344670+0000", 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344672+0000", 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344677+0000", 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5799999999999999e-06 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344682+0000", 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-06 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119806 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345396+0000", 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0034220190000000001, 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036803579999999999, 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119806 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345396+0000", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345396+0000", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345396+0000", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6899999999999998e-07 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345398+0000", 2024-04-23T23:39:13.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9580000000000001e-06 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345404+0000", 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3110000000000002e-06 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345409+0000", 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8720000000000001e-06 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119838 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346152+0000", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0026658670000000001, 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0029680700000000002, 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119838 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346152+0000", 2024-04-23T23:39:13.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346152+0000", 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346152+0000", 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9900000000000001e-07 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346162+0000", 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9629999999999993e-06 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346170+0000", 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6790000000000005e-06 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346173+0000", 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2650000000000001e-06 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119529 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340872+0000", 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0079452159999999997, 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083032169999999999, 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119529 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.367 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340872+0000", 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340872+0000", 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340873+0000", 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340875+0000", 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3410000000000001e-06 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340881+0000", 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1249999999999998e-06 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340886+0000", 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9350000000000002e-06 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119569 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341575+0000", 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0072427500000000001, 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076474799999999999, 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119569 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341575+0000", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341575+0000", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341575+0000", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341577+0000", 2024-04-23T23:39:13.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8810000000000001e-06 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341583+0000", 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5389999999999998e-06 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341587+0000", 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.707e-06 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.372 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119611 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342471+0000", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.006347086, 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.006803346, 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119611 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342471+0000", 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342471+0000", 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342471+0000", 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342473+0000", 2024-04-23T23:39:13.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.114e-06 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342479+0000", 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1550000000000004e-06 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342485+0000", 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4659999999999998e-06 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.375 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119761 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344688+0000", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0041297879999999997, 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0046338459999999996, 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119761 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344688+0000", 2024-04-23T23:39:13.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344688+0000", 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344688+0000", 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344690+0000", 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.069e-06 2024-04-23T23:39:13.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344697+0000", 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.421e-06 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344701+0000", 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.729e-06 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119807 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.378 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345415+0000", 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0034022869999999999, 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0039634279999999997, 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119807 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345415+0000", 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345415+0000", 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345416+0000", 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.27e-07 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345418+0000", 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1660000000000001e-06 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345425+0000", 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7519999999999999e-06 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345429+0000", 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7620000000000003e-06 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119839 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346179+0000", 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0026387110000000002, 2024-04-23T23:39:13.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0032546960000000001, 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119839 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346179+0000", 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346179+0000", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346179+0000", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6800000000000001e-07 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346181+0000", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0370000000000001e-06 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346188+0000", 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3489999999999997e-06 2024-04-23T23:39:13.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346192+0000", 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3089999999999997e-06 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119530 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340893+0000", 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0079247120000000004, 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085947980000000007, 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.384 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119530 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340893+0000", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340893+0000", 2024-04-23T23:39:13.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340893+0000", 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3299999999999998e-07 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340895+0000", 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.069e-06 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340901+0000", 2024-04-23T23:39:13.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340906+0000", 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3299999999999998e-06 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119570 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341594+0000", 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0072235440000000001, 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0079568799999999995, 2024-04-23T23:39:13.387 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119570 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341594+0000", 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341594+0000", 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341594+0000", 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341596+0000", 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.99e-06 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341602+0000", 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7420000000000003e-06 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341607+0000", 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8640000000000004e-06 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119612 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342490+0000", 2024-04-23T23:39:13.390 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0063272700000000003, 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0070890559999999998, 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119612 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342490+0000", 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342490+0000", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342491+0000", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342493+0000", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342499+0000", 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.224e-06 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342505+0000", 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119705 3.18 3.b7ee91d8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343961+0000", 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.004856483, 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056469679999999996, 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.393 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119705 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343961+0000", 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343961+0000", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343962+0000", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343964+0000", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343977+0000", 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3793e-05 2024-04-23T23:39:13.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343986+0000", 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8959999999999992e-06 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119762 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344708+0000", 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0041099179999999997, 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0049376690000000004, 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119762 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344708+0000", 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344708+0000", 2024-04-23T23:39:13.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344708+0000", 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6899999999999998e-07 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344710+0000", 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.979e-06 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344716+0000", 2024-04-23T23:39:13.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344726+0000", 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4499999999999993e-06 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119808 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345435+0000", 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.003382361, 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0042466350000000003, 2024-04-23T23:39:13.399 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119808 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345435+0000", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345435+0000", 2024-04-23T23:39:13.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345436+0000", 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-07 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345437+0000", 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.821e-06 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345443+0000", 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345451+0000", 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7640000000000005e-06 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119840 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346197+0000", 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0026204079999999999, 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035171299999999998, 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.402 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119840 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346197+0000", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346197+0000", 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346198+0000", 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346199+0000", 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8020000000000001e-06 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346204+0000", 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3800000000000004e-06 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346211+0000", 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.81e-06 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119532 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340914+0000", 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0079039680000000008, 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0088360680000000007, 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.405 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119532 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340914+0000", 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340914+0000", 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340914+0000", 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340916+0000", 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2510000000000001e-06 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340922+0000", 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6919999999999999e-06 2024-04-23T23:39:13.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340927+0000", 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5000000000000001e-06 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119571 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341613+0000", 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0072051099999999998, 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0081658600000000005, 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.410 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119571 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341613+0000", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341613+0000", 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341613+0000", 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341615+0000", 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0389999999999999e-06 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341621+0000", 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2439999999999998e-06 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341626+0000", 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9010000000000002e-06 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119614 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342511+0000", 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0063065619999999999, 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072948739999999998, 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.413 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119614 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342511+0000", 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342511+0000", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342511+0000", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342517+0000", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7139999999999998e-06 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342535+0000", 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7411e-05 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342541+0000", 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4060000000000002e-06 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119763 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344732+0000", 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0040860059999999997, 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0051066970000000003, 2024-04-23T23:39:13.416 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119763 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344732+0000", 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344732+0000", 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344732+0000", 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8500000000000002e-07 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344738+0000", 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6450000000000002e-06 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344744+0000", 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2670000000000003e-06 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344749+0000", 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6700000000000002e-06 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119809 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345457+0000", 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0033609719999999998, 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0044110879999999996, 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119809 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345457+0000", 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345457+0000", 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345457+0000", 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.39e-07 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345463+0000", 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8619999999999999e-06 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345470+0000", 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5780000000000001e-06 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345475+0000", 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7910000000000004e-06 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119841 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346216+0000", 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002601328, 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036786869999999999, 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119841 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346216+0000", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346216+0000", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346217+0000", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5199999999999998e-07 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346221+0000", 2024-04-23T23:39:13.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7639999999999996e-06 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346227+0000", 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346231+0000", 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.236e-06 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119533 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.425 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340932+0000", 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0078851489999999993, 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0089898800000000004, 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119533 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340932+0000", 2024-04-23T23:39:13.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340932+0000", 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340933+0000", 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340935+0000", 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0320000000000002e-06 2024-04-23T23:39:13.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340941+0000", 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8690000000000001e-06 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340945+0000", 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3769999999999998e-06 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119572 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341632+0000", 2024-04-23T23:39:13.428 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0071857420000000002, 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083191759999999993, 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119572 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341632+0000", 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341632+0000", 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341632+0000", 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.96e-07 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341634+0000", 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341640+0000", 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9730000000000002e-06 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341645+0000", 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6920000000000001e-06 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.431 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119764 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344755+0000", 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0040630400000000004, 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0052489579999999997, 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119764 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344755+0000", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344755+0000", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344755+0000", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.58e-07 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344757+0000", 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:39:13.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344763+0000", 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9279999999999998e-06 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344767+0000", 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5630000000000002e-06 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.434 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119810 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345481+0000", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0033367649999999998, 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045681380000000002, 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119810 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345481+0000", 2024-04-23T23:39:13.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345481+0000", 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345481+0000", 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345483+0000", 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8560000000000001e-06 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345492+0000", 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1349999999999998e-06 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345497+0000", 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6940000000000003e-06 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119842 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346234+0000", 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0025836269999999998, 2024-04-23T23:39:13.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003843515, 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119842 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346234+0000", 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346234+0000", 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346234+0000", 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4999999999999999e-07 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346236+0000", 2024-04-23T23:39:13.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3999999999999999e-06 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346241+0000", 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6509999999999998e-06 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346246+0000", 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119535 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340951+0000", 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0078668869999999995, 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0091545740000000004, 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119535 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340951+0000", 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340951+0000", 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340951+0000", 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340953+0000", 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.874e-06 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340959+0000", 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4360000000000001e-06 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340963+0000", 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0339999999999998e-06 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.443 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119574 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341651+0000", 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0071670529999999996, 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085114630000000004, 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119574 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.444 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341651+0000", 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341651+0000", 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341651+0000", 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5199999999999998e-07 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341656+0000", 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3820000000000003e-06 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341662+0000", 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8560000000000003e-06 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341667+0000", 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3880000000000002e-06 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.446 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119765 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344779+0000", 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0040383010000000002, 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0054180219999999998, 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119765 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344779+0000", 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344779+0000", 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344780+0000", 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344782+0000", 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1569999999999998e-06 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344788+0000", 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4500000000000001e-06 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344793+0000", 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8160000000000001e-06 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119811 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345503+0000", 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0033151220000000002, 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047220259999999998, 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119811 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345503+0000", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345503+0000", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345503+0000", 2024-04-23T23:39:13.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3200000000000001e-07 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345505+0000", 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345511+0000", 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2430000000000002e-06 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345516+0000", 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5379999999999996e-06 2024-04-23T23:39:13.452 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119843 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346251+0000", 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0025664239999999999, 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0040424069999999996, 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119843 2024-04-23T23:39:13.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346251+0000", 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346251+0000", 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346252+0000", 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:13.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346253+0000", 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.708e-06 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346266+0000", 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2859e-05 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346272+0000", 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.463e-06 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.455 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119536 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340969+0000", 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0078488729999999993, 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0093537020000000002, 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119536 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.456 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340969+0000", 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340969+0000", 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340977+0000", 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0819999999999999e-06 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340980+0000", 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6979999999999998e-06 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340986+0000", 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2750000000000001e-06 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340990+0000", 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5839999999999996e-06 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.458 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119637 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342621+0000", 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0061966479999999999, 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0077324070000000002, 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119637 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342621+0000", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342621+0000", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342621+0000", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342624+0000", 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342635+0000", 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1552999999999999e-05 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342645+0000", 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8120000000000002e-06 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.461 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119766 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344799+0000", 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0040185899999999998, 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055890560000000002, 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119766 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344799+0000", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344799+0000", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344799+0000", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344801+0000", 2024-04-23T23:39:13.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.886e-06 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344807+0000", 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1360000000000002e-06 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344812+0000", 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4190000000000004e-06 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119812 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.464 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345521+0000", 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.003296574, 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0049122189999999998, 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119812 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345521+0000", 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345521+0000", 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345521+0000", 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345523+0000", 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7910000000000001e-06 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345532+0000", 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4409999999999993e-06 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345536+0000", 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3039999999999998e-06 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119844 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346278+0000", 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002539847, 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0041851759999999997, 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119844 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.468 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346278+0000", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346278+0000", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346278+0000", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346281+0000", 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3309999999999998e-06 2024-04-23T23:39:13.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346290+0000", 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9459999999999993e-06 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346294+0000", 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4369999999999999e-06 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119537 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.470 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.340998+0000", 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0078196979999999999, 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0094931960000000006, 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119537 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340998+0000", 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340998+0000", 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.340998+0000", 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341000+0000", 2024-04-23T23:39:13.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0710000000000002e-06 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341006+0000", 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5740000000000003e-06 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341011+0000", 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6979999999999997e-06 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119576 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.473 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341811+0000", 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0070069269999999996, 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0087131670000000008, 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119576 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341811+0000", 2024-04-23T23:39:13.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341811+0000", 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341811+0000", 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4899999999999995e-07 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341814+0000", 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9529999999999999e-06 2024-04-23T23:39:13.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341821+0000", 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341827+0000", 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1279999999999996e-06 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119639 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.476 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342658+0000", 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0061595139999999996, 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0078936990000000005, 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119639 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342658+0000", 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342658+0000", 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342659+0000", 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342661+0000", 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2189999999999998e-06 2024-04-23T23:39:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342667+0000", 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.613e-06 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342673+0000", 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1649999999999997e-06 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119720 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.479 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344137+0000", 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0046810410000000004, 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.006444249, 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119720 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344137+0000", 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344137+0000", 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344137+0000", 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6199999999999998e-07 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344139+0000", 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1289999999999999e-06 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344146+0000", 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0119999999999999e-06 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344151+0000", 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.904e-06 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119767 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344817+0000", 2024-04-23T23:39:13.482 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.004000483, 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.005791951, 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119767 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344817+0000", 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.483 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344817+0000", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344818+0000", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344820+0000", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.086e-06 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.484 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344826+0000", 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344831+0000", 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.69e-06 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119813 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345542+0000", 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0032755140000000002, 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0050971549999999999, 2024-04-23T23:39:13.485 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119813 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345542+0000", 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.486 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345542+0000", 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345543+0000", 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7e-07 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345545+0000", 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.487 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345551+0000", 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4130000000000003e-06 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345556+0000", 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8069999999999999e-06 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119845 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346298+0000", 2024-04-23T23:39:13.488 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0025198600000000001, 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.004368696, 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119845 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346298+0000", 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346298+0000", 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346298+0000", 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6600000000000003e-07 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.490 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346300+0000", 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.809e-06 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346306+0000", 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.891e-06 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346310+0000", 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119538 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341017+0000", 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0078005990000000001, 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0096780640000000001, 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119538 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.492 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341017+0000", 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341017+0000", 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341018+0000", 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4499999999999997e-07 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.493 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341020+0000", 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341026+0000", 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8730000000000004e-06 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341030+0000", 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6800000000000001e-06 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119577 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341836+0000", 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0069818140000000002, 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0088866829999999994, 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119577 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341836+0000", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341836+0000", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341836+0000", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.496 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341838+0000", 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1129999999999999e-06 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341844+0000", 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8209999999999998e-06 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341849+0000", 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8799999999999999e-06 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119641 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342684+0000", 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0061338720000000003, 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0080670749999999999, 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119641 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.498 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342684+0000", 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342684+0000", 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342684+0000", 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:39:13.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342686+0000", 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1050000000000002e-06 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342910+0000", 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00022379499999999999 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342917+0000", 2024-04-23T23:39:13.500 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6189999999999996e-06 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119722 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344158+0000", 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0046600299999999999, 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0066250989999999997, 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.501 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119722 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344158+0000", 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344158+0000", 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.502 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344158+0000", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344160+0000", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.12e-06 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344166+0000", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3570000000000003e-06 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344171+0000", 2024-04-23T23:39:13.503 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9089999999999999e-06 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119768 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344850+0000", 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0039675229999999997, 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0059618880000000003, 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.504 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119768 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344850+0000", 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344850+0000", 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344851+0000", 2024-04-23T23:39:13.505 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.82e-07 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344853+0000", 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.379e-06 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344860+0000", 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0149999999999998e-06 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344865+0000", 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.977e-06 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119814 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345561+0000", 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0032562300000000001, 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0052778720000000003, 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.507 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119814 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345561+0000", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345561+0000", 2024-04-23T23:39:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345562+0000", 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345567+0000", 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9409999999999998e-06 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345572+0000", 2024-04-23T23:39:13.509 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5990000000000001e-06 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345577+0000", 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.087e-06 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119846 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346315+0000", 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002502289, 2024-04-23T23:39:13.510 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0045521229999999999, 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119846 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346315+0000", 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.511 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346315+0000", 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346316+0000", 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346318+0000", 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.922e-06 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346325+0000", 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7230000000000004e-06 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346328+0000", 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999999e-06 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119539 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341036+0000", 2024-04-23T23:39:13.513 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.007781802, 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098590180000000006, 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119539 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341036+0000", 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341036+0000", 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341036+0000", 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5699999999999998e-07 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341038+0000", 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0949999999999998e-06 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341044+0000", 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8490000000000002e-06 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341049+0000", 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2789999999999998e-06 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.516 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119579 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341873+0000", 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0069447229999999999, 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0090501639999999994, 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119579 2024-04-23T23:39:13.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341873+0000", 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341873+0000", 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341874+0000", 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4399999999999999e-07 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341878+0000", 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5789999999999997e-06 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341894+0000", 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5803000000000001e-05 2024-04-23T23:39:13.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341903+0000", 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9129999999999992e-06 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119724 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344178+0000", 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0046400219999999997, 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0067735879999999997, 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.520 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119724 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344178+0000", 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344178+0000", 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344178+0000", 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0299999999999999e-07 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344180+0000", 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0839999999999999e-06 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344187+0000", 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1940000000000001e-06 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344193+0000", 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1329999999999998e-06 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119769 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344871+0000", 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0039463320000000003, 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0061126389999999996, 2024-04-23T23:39:13.523 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119769 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344871+0000", 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344871+0000", 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344872+0000", 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.58e-07 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344874+0000", 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8920000000000001e-06 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344880+0000", 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7499999999999997e-06 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344885+0000", 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5639999999999998e-06 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119815 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345582+0000", 2024-04-23T23:39:13.526 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0032357359999999999, 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0054411650000000004, 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119815 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345582+0000", 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345582+0000", 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345582+0000", 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345584+0000", 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.649e-06 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345589+0000", 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.135e-06 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345594+0000", 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.639e-06 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119847 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346333+0000", 2024-04-23T23:39:13.529 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002484638, 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0047310720000000002, 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119847 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346333+0000", 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346333+0000", 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346334+0000", 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2099999999999997e-07 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346335+0000", 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:13.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346342+0000", 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1299999999999998e-06 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346345+0000", 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8619999999999996e-06 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119540 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341055+0000", 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0077622189999999999, 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010039498000000001, 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119540 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341055+0000", 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341055+0000", 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341056+0000", 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:13.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341058+0000", 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0600000000000002e-06 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341064+0000", 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3910000000000003e-06 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341069+0000", 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.673e-06 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.535 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119580 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341917+0000", 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0069005400000000001, 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0092150359999999994, 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119580 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341917+0000", 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341917+0000", 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341918+0000", 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7299999999999995e-07 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341921+0000", 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.146e-06 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341930+0000", 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7760000000000003e-06 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341939+0000", 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4409999999999999e-06 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.538 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119644 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343007+0000", 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0058105969999999998, 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0081583650000000008, 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119644 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343007+0000", 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343007+0000", 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343008+0000", 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6700000000000003e-07 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343092+0000", 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4099999999999998e-05 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343132+0000", 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0197999999999997e-05 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343138+0000", 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3720000000000001e-06 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119770 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344891+0000", 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0039270709999999999, 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063022290000000003, 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.542 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119770 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344891+0000", 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344891+0000", 2024-04-23T23:39:13.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344891+0000", 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344893+0000", 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9099999999999999e-06 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344899+0000", 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0889999999999996e-06 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344903+0000", 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119816 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345600+0000", 2024-04-23T23:39:13.545 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0032177920000000001, 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056212739999999999, 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119816 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345600+0000", 2024-04-23T23:39:13.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345600+0000", 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345600+0000", 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7500000000000001e-07 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345602+0000", 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7400000000000001e-06 2024-04-23T23:39:13.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345607+0000", 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4029999999999998e-06 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345611+0000", 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8800000000000001e-06 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.548 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119848 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346351+0000", 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0024667999999999999, 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0048972970000000001, 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119848 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346351+0000", 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346351+0000", 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346351+0000", 2024-04-23T23:39:13.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7599999999999998e-07 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346352+0000", 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1799999999999999e-06 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346357+0000", 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4560000000000002e-06 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346361+0000", 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.827e-06 2024-04-23T23:39:13.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119542 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341075+0000", 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0077426739999999997, 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010201636, 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.552 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119542 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341075+0000", 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341075+0000", 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341075+0000", 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9200000000000002e-07 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341081+0000", 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5860000000000004e-06 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341087+0000", 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341092+0000", 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5719999999999996e-06 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119582 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341947+0000", 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0068707569999999999, 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0093574069999999999, 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.555 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119582 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341947+0000", 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341947+0000", 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341947+0000", 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341952+0000", 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2400000000000001e-06 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341960+0000", 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3760000000000008e-06 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341981+0000", 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1307000000000001e-05 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119646 3.18 3.13b0a438 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343148+0000", 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0056693969999999996, 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0082027520000000007, 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.558 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119646 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343148+0000", 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343148+0000", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343149+0000", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343152+0000", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.881e-06 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343159+0000", 2024-04-23T23:39:13.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5190000000000003e-06 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343165+0000", 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5890000000000002e-06 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119726 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344219+0000", 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0045984609999999999, 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0071600029999999999, 2024-04-23T23:39:13.561 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119726 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344219+0000", 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344219+0000", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344220+0000", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.84e-07 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344222+0000", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0499999999999999e-06 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344228+0000", 2024-04-23T23:39:13.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5699999999999998e-06 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344233+0000", 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8579999999999999e-06 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119771 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344909+0000", 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0039087649999999998, 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0064983569999999997, 2024-04-23T23:39:13.564 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119771 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344909+0000", 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344909+0000", 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344909+0000", 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2300000000000002e-07 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344911+0000", 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344918+0000", 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4059999999999999e-06 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344923+0000", 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5859999999999998e-06 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119817 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345617+0000", 2024-04-23T23:39:13.567 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0032011349999999999, 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0058184980000000001, 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119817 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345617+0000", 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345617+0000", 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345617+0000", 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.39e-07 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345619+0000", 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7209999999999999e-06 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345624+0000", 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5400000000000003e-06 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345628+0000", 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0040000000000001e-06 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.570 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119849 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346366+0000", 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0024516659999999999, 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0050964950000000004, 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119849 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346366+0000", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346366+0000", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346366+0000", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346368+0000", 2024-04-23T23:39:13.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7719999999999999e-06 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346374+0000", 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.998e-06 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346378+0000", 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9890000000000003e-06 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.573 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119543 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341098+0000", 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.007719386, 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010392327, 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119543 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341098+0000", 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341098+0000", 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341099+0000", 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341101+0000", 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.04e-06 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341106+0000", 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7300000000000002e-06 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341111+0000", 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7679999999999999e-06 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.576 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119583 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341990+0000", 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0068277870000000001, 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0095287519999999997, 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119583 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.577 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341990+0000", 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341990+0000", 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341990+0000", 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1799999999999995e-07 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341993+0000", 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7800000000000001e-06 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342001+0000", 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3119999999999994e-06 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342007+0000", 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6250000000000004e-06 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.579 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119648 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343174+0000", 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0056433380000000003, 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083728780000000003, 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119648 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.580 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343174+0000", 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343174+0000", 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343175+0000", 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.08e-07 2024-04-23T23:39:13.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343177+0000", 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343183+0000", 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5139999999999998e-06 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343188+0000", 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8999999999999997e-06 2024-04-23T23:39:13.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119728 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344240+0000", 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0045776419999999998, 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0073392309999999999, 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119728 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.583 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344240+0000", 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344240+0000", 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344241+0000", 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7599999999999997e-07 2024-04-23T23:39:13.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344243+0000", 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.95e-06 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344249+0000", 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4160000000000001e-06 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344255+0000", 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7069999999999997e-06 2024-04-23T23:39:13.585 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119772 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344929+0000", 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0038889150000000002, 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0066788209999999997, 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.586 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119772 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344929+0000", 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344929+0000", 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344929+0000", 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344931+0000", 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9319999999999999e-06 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344937+0000", 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0610000000000001e-06 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344943+0000", 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8109999999999999e-06 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119818 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345633+0000", 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0031845710000000002, 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0060017999999999998, 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.589 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119818 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345633+0000", 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345633+0000", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345633+0000", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3500000000000002e-07 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345635+0000", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6700000000000001e-06 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345640+0000", 2024-04-23T23:39:13.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2739999999999998e-06 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345644+0000", 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9659999999999998e-06 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119850 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346385+0000", 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002432928, 2024-04-23T23:39:13.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0052774800000000002, 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119850 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346385+0000", 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346385+0000", 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346385+0000", 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0600000000000001e-07 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346392+0000", 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5119999999999997e-06 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346398+0000", 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4629999999999998e-06 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346404+0000", 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.789e-06 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119544 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341131+0000", 2024-04-23T23:39:13.595 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0076870159999999996, 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010559018, 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119544 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341131+0000", 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341131+0000", 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341131+0000", 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341133+0000", 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:39:13.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341139+0000", 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.913e-06 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341144+0000", 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6949999999999999e-06 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.598 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119584 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342014+0000", 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0068041320000000001, 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0097038000000000003, 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119584 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342014+0000", 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342014+0000", 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342014+0000", 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0200000000000003e-07 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342016+0000", 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2979999999999999e-06 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342024+0000", 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7060000000000004e-06 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342028+0000", 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5739999999999997e-06 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119650 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343206+0000", 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0056118929999999997, 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085389760000000002, 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119650 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343206+0000", 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343206+0000", 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343206+0000", 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1399999999999997e-07 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343209+0000", 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3070000000000001e-06 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343216+0000", 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343221+0000", 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1449999999999999e-06 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119729 3.8 3.c4ffc2e8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344277+0000", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0045406689999999998, 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074949489999999999, 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119729 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344277+0000", 2024-04-23T23:39:13.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344277+0000", 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344278+0000", 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344283+0000", 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5999999999999997e-06 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344290+0000", 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9539999999999998e-06 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344295+0000", 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1869999999999996e-06 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.607 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119773 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344948+0000", 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0038692039999999998, 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0068505390000000001, 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119773 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344948+0000", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344948+0000", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344949+0000", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.39e-07 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344951+0000", 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.885e-06 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344956+0000", 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344961+0000", 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.403e-06 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119819 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345649+0000", 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0031684880000000001, 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0061816919999999999, 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119819 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345649+0000", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345649+0000", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345649+0000", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0100000000000001e-07 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345651+0000", 2024-04-23T23:39:13.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7e-06 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345657+0000", 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4330000000000003e-06 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345661+0000", 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.002e-06 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.613 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119851 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346409+0000", 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0024083609999999999, 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0054499020000000004, 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119851 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346409+0000", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346409+0000", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346410+0000", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346411+0000", 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.801e-06 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346417+0000", 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0690000000000001e-06 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346419+0000", 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5950000000000001e-06 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.616 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119545 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341200+0000", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0076174779999999996, 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010686370000000001, 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119545 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341200+0000", 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341200+0000", 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341201+0000", 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341204+0000", 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:39:13.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341211+0000", 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.165e-06 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341217+0000", 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119585 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342036+0000", 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0067817859999999997, 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098781049999999999, 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119585 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342036+0000", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342036+0000", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342036+0000", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.89e-07 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342039+0000", 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.441e-06 2024-04-23T23:39:13.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342047+0000", 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8050000000000007e-06 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342052+0000", 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2809999999999999e-06 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119652 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.622 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343229+0000", 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0055885850000000001, 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0087120359999999994, 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119652 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343229+0000", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343229+0000", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343229+0000", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343232+0000", 2024-04-23T23:39:13.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.103e-06 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343238+0000", 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.336e-06 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343243+0000", 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8860000000000003e-06 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119730 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.625 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344303+0000", 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0045151180000000003, 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076658869999999997, 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119730 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344303+0000", 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344303+0000", 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344303+0000", 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6899999999999998e-07 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344305+0000", 2024-04-23T23:39:13.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9069999999999999e-06 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344311+0000", 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0689999999999998e-06 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344316+0000", 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5929999999999999e-06 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119774 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.628 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344980+0000", 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0038380229999999999, 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0070202499999999996, 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119774 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344980+0000", 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344980+0000", 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344980+0000", 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344983+0000", 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.537e-06 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344990+0000", 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7300000000000005e-06 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344996+0000", 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119820 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345666+0000", 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0031518029999999999, 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.006361121, 2024-04-23T23:39:13.631 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119820 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345666+0000", 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345666+0000", 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345666+0000", 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3500000000000002e-07 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345668+0000", 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.841e-06 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345674+0000", 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5289999999999999e-06 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345678+0000", 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2760000000000002e-06 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119852 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346425+0000", 2024-04-23T23:39:13.634 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002393049, 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056342049999999998, 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119852 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346425+0000", 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346425+0000", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346425+0000", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6600000000000002e-07 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346427+0000", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.855e-06 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346433+0000", 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4060000000000002e-06 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346437+0000", 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9349999999999996e-06 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119546 3.18 3.33474fb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341225+0000", 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0075924010000000004, 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010861513, 2024-04-23T23:39:13.637 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119546 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341225+0000", 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341225+0000", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341226+0000", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.65e-07 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341228+0000", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3e-06 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341234+0000", 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6200000000000004e-06 2024-04-23T23:39:13.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341238+0000", 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119586 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342059+0000", 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0067589160000000002, 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010055853999999999, 2024-04-23T23:39:13.640 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119586 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342059+0000", 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342059+0000", 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342059+0000", 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342062+0000", 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.672e-06 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342070+0000", 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.943e-06 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342075+0000", 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2140000000000004e-06 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119656 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343249+0000", 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0055688339999999999, 2024-04-23T23:39:13.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0088937489999999994, 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119656 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343249+0000", 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343249+0000", 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343249+0000", 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1399999999999997e-07 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343251+0000", 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.182e-06 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343259+0000", 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.537e-06 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343264+0000", 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6090000000000003e-06 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119732 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344321+0000", 2024-04-23T23:39:13.646 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0044961569999999998, 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0078488340000000007, 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119732 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344321+0000", 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344321+0000", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344322+0000", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344324+0000", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0229999999999999e-06 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344330+0000", 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1399999999999997e-06 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344335+0000", 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5929999999999999e-06 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119775 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345003+0000", 2024-04-23T23:39:13.649 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.00381504, 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0071963080000000002, 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119775 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345003+0000", 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345003+0000", 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345003+0000", 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5699999999999998e-07 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345005+0000", 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.136e-06 2024-04-23T23:39:13.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345011+0000", 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0870000000000003e-06 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345016+0000", 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6e-06 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119821 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.652 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345683+0000", 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0031348890000000001, 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065437239999999999, 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119821 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345683+0000", 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345683+0000", 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345683+0000", 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345685+0000", 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0789999999999999e-06 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345691+0000", 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5280000000000003e-06 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345695+0000", 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0180000000000003e-06 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119853 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346442+0000", 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0023753670000000002, 2024-04-23T23:39:13.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0058119599999999997, 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119853 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346442+0000", 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346442+0000", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346443+0000", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6399999999999998e-07 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346444+0000", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3829999999999999e-06 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346447+0000", 2024-04-23T23:39:13.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5219999999999999e-06 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346451+0000", 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.506e-06 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119547 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341244+0000", 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0075734740000000002, 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011037829000000001, 2024-04-23T23:39:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119547 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341244+0000", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341244+0000", 2024-04-23T23:39:13.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341245+0000", 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341247+0000", 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9870000000000002e-06 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341252+0000", 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5339999999999999e-06 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341257+0000", 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6979999999999997e-06 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119587 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342081+0000", 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0067361599999999997, 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010232677000000001, 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119587 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342081+0000", 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342081+0000", 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342082+0000", 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342084+0000", 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1600000000000001e-06 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342091+0000", 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3590000000000002e-06 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342096+0000", 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9060000000000001e-06 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119658 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343270+0000", 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0055481209999999996, 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0090724440000000007, 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.664 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119658 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343270+0000", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343270+0000", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343270+0000", 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343272+0000", 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0899999999999999e-06 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343278+0000", 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4110000000000001e-06 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343284+0000", 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1510000000000003e-06 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119734 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344340+0000", 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0044775220000000003, 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0080299929999999992, 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.667 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119734 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344340+0000", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344340+0000", 2024-04-23T23:39:13.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344340+0000", 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5400000000000002e-07 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344342+0000", 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9350000000000001e-06 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344348+0000", 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344353+0000", 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7430000000000002e-06 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119776 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345021+0000", 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0037961900000000001, 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.007376344, 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119776 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345021+0000", 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345021+0000", 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345022+0000", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2899999999999999e-07 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345027+0000", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.327e-06 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345039+0000", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1887e-05 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345044+0000", 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4929999999999998e-06 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119822 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345700+0000", 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0031174929999999998, 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.006726213, 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.673 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119822 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345700+0000", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345700+0000", 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345701+0000", 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5400000000000001e-07 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345703+0000", 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.815e-06 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345708+0000", 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7860000000000002e-06 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345712+0000", 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.121e-06 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119854 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346456+0000", 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.00236199, 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0059982450000000001, 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.676 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119854 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346456+0000", 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346456+0000", 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346456+0000", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346458+0000", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.897e-06 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346464+0000", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0229999999999998e-06 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346468+0000", 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9580000000000001e-06 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119549 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341263+0000", 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0075549450000000004, 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011219019, 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.679 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119549 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341263+0000", 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341263+0000", 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341263+0000", 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:13.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341265+0000", 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9970000000000001e-06 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341271+0000", 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4500000000000003e-06 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341275+0000", 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6530000000000002e-06 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119589 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342102+0000", 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0067155679999999999, 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010407599, 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119589 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.682 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342102+0000", 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342102+0000", 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342102+0000", 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342109+0000", 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2530000000000001e-06 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342116+0000", 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4989999999999997e-06 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342121+0000", 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0799999999999996e-06 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119662 3.8 3.4b6e88e8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343290+0000", 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0055278999999999997, 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0092518700000000006, 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119662 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343290+0000", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343290+0000", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343290+0000", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7500000000000001e-07 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343292+0000", 2024-04-23T23:39:13.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2910000000000002e-06 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343299+0000", 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.392e-06 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343303+0000", 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6619999999999996e-06 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119736 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344359+0000", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0044589800000000004, 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0082112379999999992, 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119736 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344359+0000", 2024-04-23T23:39:13.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344359+0000", 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344359+0000", 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344361+0000", 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.756e-06 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344367+0000", 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8100000000000003e-06 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344372+0000", 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.994e-06 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119777 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345051+0000", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.003766658, 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.007545937, 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119777 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345051+0000", 2024-04-23T23:39:13.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345051+0000", 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345051+0000", 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345054+0000", 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1390000000000002e-06 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345060+0000", 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0900000000000001e-06 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345064+0000", 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5820000000000003e-06 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119823 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345731+0000", 2024-04-23T23:39:13.693 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0030865459999999999, 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0068960829999999999, 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119823 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345731+0000", 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345731+0000", 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345732+0000", 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345734+0000", 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345740+0000", 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.72e-06 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345745+0000", 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9919999999999998e-06 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119855 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346473+0000", 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0023446370000000001, 2024-04-23T23:39:13.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0061849009999999996, 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119855 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346473+0000", 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346473+0000", 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346473+0000", 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.58e-07 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346475+0000", 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.559e-06 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346480+0000", 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346482+0000", 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.689e-06 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119551 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341281+0000", 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0075368789999999998, 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011404589, 2024-04-23T23:39:13.699 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119551 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341281+0000", 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341281+0000", 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341281+0000", 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.46e-07 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341283+0000", 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0059999999999999e-06 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341288+0000", 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1850000000000003e-06 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341293+0000", 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7430000000000002e-06 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119591 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342133+0000", 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0066846340000000001, 2024-04-23T23:39:13.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010592371, 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119591 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342133+0000", 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342133+0000", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342133+0000", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342136+0000", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0849999999999999e-06 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342143+0000", 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3170000000000004e-06 2024-04-23T23:39:13.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342148+0000", 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0499999999999999e-06 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119738 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344378+0000", 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0044399540000000003, 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083752719999999996, 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119738 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344378+0000", 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344378+0000", 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344378+0000", 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344380+0000", 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.029e-06 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344387+0000", 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2509999999999997e-06 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344392+0000", 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6949999999999999e-06 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119778 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345070+0000", 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0037479840000000002, 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0077155310000000003, 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.708 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119778 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345070+0000", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345070+0000", 2024-04-23T23:39:13.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345070+0000", 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5900000000000003e-07 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345072+0000", 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8339999999999999e-06 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345078+0000", 2024-04-23T23:39:13.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0100000000000001e-06 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345082+0000", 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.527e-06 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119824 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345751+0000", 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0030664070000000002, 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0070618950000000003, 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.711 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119824 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345751+0000", 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345751+0000", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345752+0000", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8699999999999995e-07 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345754+0000", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9300000000000002e-06 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345759+0000", 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7520000000000002e-06 2024-04-23T23:39:13.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345763+0000", 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9400000000000004e-06 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119856 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346486+0000", 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0023311510000000001, 2024-04-23T23:39:13.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0063543469999999998, 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119856 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346486+0000", 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346486+0000", 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346487+0000", 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3000000000000002e-07 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346488+0000", 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5939999999999999e-06 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346502+0000", 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3526999999999999e-05 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346507+0000", 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7709999999999997e-06 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119552 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341299+0000", 2024-04-23T23:39:13.717 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0075184129999999998, 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011570736, 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119552 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341299+0000", 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341299+0000", 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341300+0000", 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341302+0000", 2024-04-23T23:39:13.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0650000000000001e-06 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341307+0000", 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341312+0000", 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7729999999999999e-06 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119592 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.720 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342154+0000", 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0066638950000000004, 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010746531, 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119592 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342154+0000", 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342154+0000", 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342154+0000", 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342156+0000", 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9640000000000002e-06 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342163+0000", 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1550000000000001e-06 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342168+0000", 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9389999999999996e-06 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119667 3.18 3.1db8edb8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343341+0000", 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.005476252, 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0095861929999999998, 2024-04-23T23:39:13.723 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119667 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343341+0000", 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343341+0000", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343342+0000", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343344+0000", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1629999999999999e-06 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343351+0000", 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0910000000000004e-06 2024-04-23T23:39:13.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343365+0000", 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3439e-05 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119740 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344399+0000", 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0044188860000000003, 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085562899999999994, 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.726 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119740 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344399+0000", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344399+0000", 2024-04-23T23:39:13.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344399+0000", 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.01e-07 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344401+0000", 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0590000000000001e-06 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344408+0000", 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5169999999999996e-06 2024-04-23T23:39:13.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344413+0000", 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7999999999999998e-06 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119779 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345088+0000", 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0037296460000000001, 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0078976689999999995, 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.729 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119779 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345088+0000", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345088+0000", 2024-04-23T23:39:13.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345088+0000", 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.84e-07 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345090+0000", 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8449999999999999e-06 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345101+0000", 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0443e-05 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345105+0000", 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5800000000000002e-06 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119825 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345769+0000", 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0030487349999999999, 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072489529999999998, 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.732 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119825 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345769+0000", 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345769+0000", 2024-04-23T23:39:13.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345769+0000", 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345771+0000", 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7719999999999999e-06 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345778+0000", 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2049999999999996e-06 2024-04-23T23:39:13.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345783+0000", 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1109999999999999e-06 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119857 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346510+0000", 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0023071620000000002, 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0065352129999999998, 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119857 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346510+0000", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346510+0000", 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346511+0000", 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6399999999999998e-07 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346512+0000", 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3260000000000001e-06 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346517+0000", 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2789999999999998e-06 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346524+0000", 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3640000000000004e-06 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119553 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341318+0000", 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0074999139999999999, 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011755613999999999, 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.738 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119553 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341318+0000", 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341318+0000", 2024-04-23T23:39:13.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341318+0000", 2024-04-23T23:39:13.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.84e-07 2024-04-23T23:39:13.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341320+0000", 2024-04-23T23:39:13.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8929999999999999e-06 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341325+0000", 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4040000000000003e-06 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341330+0000", 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5290000000000002e-06 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119594 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342174+0000", 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0066436799999999999, 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010926869000000001, 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119594 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342174+0000", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342174+0000", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342174+0000", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.65e-07 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342176+0000", 2024-04-23T23:39:13.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9530000000000002e-06 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342183+0000", 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1890000000000001e-06 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342188+0000", 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8629999999999999e-06 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119742 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344418+0000", 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0043993330000000001, 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0087144839999999998, 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119742 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344418+0000", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344418+0000", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344419+0000", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5699999999999998e-07 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344420+0000", 2024-04-23T23:39:13.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8020000000000001e-06 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344427+0000", 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0290000000000002e-06 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344431+0000", 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6859999999999997e-06 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.748 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119780 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345112+0000", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0037061429999999999, 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0080490430000000005, 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119780 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345112+0000", 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345112+0000", 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345112+0000", 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345114+0000", 2024-04-23T23:39:13.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.091e-06 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345122+0000", 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3480000000000004e-06 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345127+0000", 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9080000000000003e-06 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119826 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345789+0000", 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0030283580000000001, 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0073990089999999998, 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119826 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.752 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345789+0000", 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345789+0000", 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345790+0000", 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0200000000000003e-07 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345799+0000", 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4460000000000007e-06 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345806+0000", 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6220000000000003e-06 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345811+0000", 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119858 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346529+0000", 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0022884089999999999, 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0066870929999999999, 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119858 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346529+0000", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346529+0000", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346530+0000", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346531+0000", 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7999999999999999e-06 2024-04-23T23:39:13.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346538+0000", 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346541+0000", 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6510000000000001e-06 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.757 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119554 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341335+0000", 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0074824280000000002, 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011912298, 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119554 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341335+0000", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341335+0000", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341336+0000", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4200000000000002e-07 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341337+0000", 2024-04-23T23:39:13.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.888e-06 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341343+0000", 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4519999999999996e-06 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341347+0000", 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3819999999999997e-06 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119595 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.760 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342195+0000", 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0066230220000000001, 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0110805, 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119595 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342195+0000", 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342195+0000", 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342195+0000", 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2199999999999999e-07 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342197+0000", 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2749999999999998e-06 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342205+0000", 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8140000000000001e-06 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342210+0000", 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0509999999999996e-06 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119674 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343531+0000", 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0052869249999999996, 2024-04-23T23:39:13.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0097979030000000002, 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119674 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343531+0000", 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343531+0000", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343531+0000", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9200000000000001e-07 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343538+0000", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1690000000000003e-06 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343546+0000", 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9990000000000008e-06 2024-04-23T23:39:13.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343553+0000", 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4409999999999998e-06 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119744 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344437+0000", 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0043801910000000003, 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0089241370000000004, 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.766 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119744 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344437+0000", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344437+0000", 2024-04-23T23:39:13.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344438+0000", 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3099999999999998e-07 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344440+0000", 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344446+0000", 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1789999999999996e-06 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344451+0000", 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7160000000000002e-06 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119781 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345134+0000", 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0036840839999999998, 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0082555879999999995, 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.769 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119781 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345134+0000", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345134+0000", 2024-04-23T23:39:13.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345134+0000", 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7099999999999997e-07 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345136+0000", 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0710000000000002e-06 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345142+0000", 2024-04-23T23:39:13.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2400000000000004e-06 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345147+0000", 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1460000000000004e-06 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119827 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345817+0000", 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0030002060000000001, 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0075989320000000001, 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.772 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119827 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345817+0000", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345817+0000", 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345818+0000", 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345820+0000", 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.114e-06 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345829+0000", 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5650000000000002e-06 2024-04-23T23:39:13.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345833+0000", 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.583e-06 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119859 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346545+0000", 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0022729429999999999, 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0069000099999999998, 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.775 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119859 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346545+0000", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346545+0000", 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346545+0000", 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346547+0000", 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8250000000000001e-06 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346554+0000", 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3760000000000002e-06 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346559+0000", 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3420000000000001e-06 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119555 3.8 3:13cc187f:::rbd_data.1194c20c5cbf.0000000000000000:2d [read 335872~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.341353+0000", 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0074648500000000003, 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012128534, 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.778 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119555 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341353+0000", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341353+0000", 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341353+0000", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0400000000000002e-07 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341355+0000", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.795e-06 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341362+0000", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8850000000000001e-06 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.341367+0000", 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7280000000000003e-06 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.353440+0000", 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012073501 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.353475+0000", 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5188000000000003e-05 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.781 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119597 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342217+0000", 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0066007089999999997, 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011298602, 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119597 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342217+0000", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342217+0000", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342217+0000", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342220+0000", 2024-04-23T23:39:13.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.323e-06 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342227+0000", 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5900000000000002e-06 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342232+0000", 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9479999999999999e-06 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119746 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.784 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344457+0000", 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0043610819999999996, 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0090879210000000005, 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119746 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344457+0000", 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344457+0000", 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344457+0000", 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5699999999999998e-07 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344459+0000", 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344465+0000", 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1600000000000003e-06 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344470+0000", 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7339999999999999e-06 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119782 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345168+0000", 2024-04-23T23:39:13.787 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0036496229999999998, 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0084083170000000002, 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119782 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345168+0000", 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345168+0000", 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345169+0000", 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.68e-07 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345171+0000", 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1550000000000001e-06 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345182+0000", 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1493e-05 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345188+0000", 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0800000000000002e-06 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119828 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.790 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345840+0000", 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0029777979999999998, 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0077639680000000004, 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119828 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345840+0000", 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345840+0000", 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345840+0000", 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345843+0000", 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2309999999999999e-06 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345852+0000", 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0159999999999997e-06 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345856+0000", 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-06 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119860 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346564+0000", 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002253878, 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0070679150000000001, 2024-04-23T23:39:13.793 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119860 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346564+0000", 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346564+0000", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346564+0000", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6899999999999998e-07 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346566+0000", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8309999999999999e-06 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346570+0000", 2024-04-23T23:39:13.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346573+0000", 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4350000000000001e-06 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119599 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342238+0000", 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0065797110000000002, 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011422589, 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119599 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342238+0000", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342238+0000", 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342238+0000", 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342240+0000", 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.007e-06 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342248+0000", 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1620000000000002e-06 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342253+0000", 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8869999999999997e-06 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119676 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343589+0000", 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0052289679999999996, 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010103048999999999, 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119676 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343589+0000", 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343589+0000", 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343589+0000", 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343591+0000", 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2050000000000001e-06 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343598+0000", 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7710000000000001e-06 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343603+0000", 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119748 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344475+0000", 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0043422809999999999, 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0092450290000000001, 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.802 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119748 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344475+0000", 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344475+0000", 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344476+0000", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3799999999999998e-07 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344478+0000", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.827e-06 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344484+0000", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7630000000000003e-06 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344489+0000", 2024-04-23T23:39:13.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6890000000000003e-06 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119783 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345195+0000", 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0036223370000000002, 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085527450000000005, 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.805 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119783 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345195+0000", 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345195+0000", 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345196+0000", 2024-04-23T23:39:13.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345198+0000", 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345205+0000", 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3429999999999998e-06 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345210+0000", 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1390000000000003e-06 2024-04-23T23:39:13.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119829 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345863+0000", 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002954646, 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0079126950000000008, 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119829 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345863+0000", 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345863+0000", 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345863+0000", 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1399999999999997e-07 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345865+0000", 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.922e-06 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345872+0000", 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3990000000000001e-06 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345877+0000", 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1479999999999997e-06 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119861 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346596+0000", 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0022215609999999999, 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0072106180000000002, 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.811 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119861 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346596+0000", 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346596+0000", 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346597+0000", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346599+0000", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.029e-06 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346605+0000", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0549999999999996e-06 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346609+0000", 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5059999999999997e-06 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119600 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342259+0000", 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0065585519999999996, 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011575960999999999, 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.814 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119600 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342259+0000", 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342259+0000", 2024-04-23T23:39:13.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342259+0000", 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7800000000000002e-07 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342261+0000", 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.973e-06 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342268+0000", 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342273+0000", 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119678 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343610+0000", 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0052081200000000001, 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010252983, 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.817 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119678 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343610+0000", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343610+0000", 2024-04-23T23:39:13.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343610+0000", 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-07 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343612+0000", 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.933e-06 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343618+0000", 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.105e-06 2024-04-23T23:39:13.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343623+0000", 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8940000000000001e-06 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119749 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344495+0000", 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.004322345, 2024-04-23T23:39:13.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.009395479, 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119749 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344495+0000", 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344495+0000", 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344496+0000", 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344498+0000", 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344504+0000", 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0569999999999998e-06 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344508+0000", 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5719999999999996e-06 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119784 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345217+0000", 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0036003509999999999, 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0087040079999999992, 2024-04-23T23:39:13.823 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119784 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345217+0000", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345217+0000", 2024-04-23T23:39:13.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345218+0000", 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345220+0000", 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345230+0000", 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0749e-05 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345235+0000", 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6619999999999996e-06 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119830 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345883+0000", 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002934388, 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0080654790000000004, 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119830 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345883+0000", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345883+0000", 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345884+0000", 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7099999999999997e-07 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345886+0000", 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1600000000000001e-06 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345909+0000", 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3484000000000001e-05 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345915+0000", 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8309999999999997e-06 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119862 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346615+0000", 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0022026509999999999, 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0073675959999999997, 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.829 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119862 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346615+0000", 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346615+0000", 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346615+0000", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6800000000000001e-07 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346640+0000", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4267999999999999e-05 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346646+0000", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4350000000000002e-06 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346651+0000", 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119601 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342280+0000", 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0065375900000000002, 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011730177, 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.832 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119601 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342280+0000", 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342280+0000", 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342280+0000", 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4799999999999999e-07 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342282+0000", 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0389999999999999e-06 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342290+0000", 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0690000000000004e-06 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342295+0000", 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5110000000000003e-06 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119680 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343629+0000", 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0051890699999999996, 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01041418, 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119680 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343629+0000", 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343629+0000", 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343629+0000", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343631+0000", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.72e-06 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343637+0000", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8579999999999996e-06 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343641+0000", 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6410000000000001e-06 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119750 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344514+0000", 2024-04-23T23:39:13.838 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0043038260000000002, 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0095568979999999994, 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.839 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119750 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344514+0000", 2024-04-23T23:39:13.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344514+0000", 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344514+0000", 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1399999999999998e-07 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344519+0000", 2024-04-23T23:39:13.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.254e-06 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344526+0000", 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5529999999999998e-06 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344531+0000", 2024-04-23T23:39:13.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8300000000000003e-06 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119785 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345243+0000", 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0035746279999999998, 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0088559009999999994, 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.843 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119785 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345243+0000", 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345243+0000", 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345243+0000", 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345246+0000", 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.17e-06 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345252+0000", 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5980000000000002e-06 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345257+0000", 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0699999999999997e-06 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119831 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345923+0000", 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0028949169999999999, 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0082038370000000003, 2024-04-23T23:39:13.846 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119831 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345923+0000", 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345923+0000", 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345923+0000", 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345926+0000", 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5000000000000002e-06 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345933+0000", 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8190000000000003e-06 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345937+0000", 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7870000000000001e-06 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119863 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.849 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346659+0000", 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0021590929999999999, 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0074994909999999996, 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119863 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346659+0000", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346659+0000", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346659+0000", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346661+0000", 2024-04-23T23:39:13.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8360000000000001e-06 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346667+0000", 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1630000000000001e-06 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346671+0000", 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.34e-06 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.852 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119602 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342302+0000", 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0065159559999999998, 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011884316000000001, 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119602 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.853 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342302+0000", 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342302+0000", 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342302+0000", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.53e-07 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342304+0000", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.052e-06 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342311+0000", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9829999999999999e-06 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342316+0000", 2024-04-23T23:39:13.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6999999999999999e-06 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119681 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343648+0000", 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0051698550000000001, 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010566274, 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.856 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119681 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343648+0000", 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343648+0000", 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343648+0000", 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000001e-07 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343650+0000", 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1519999999999999e-06 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343657+0000", 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:13.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343662+0000", 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0459999999999996e-06 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119752 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344538+0000", 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0042800429999999999, 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0097043000000000008, 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.859 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119752 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344538+0000", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344538+0000", 2024-04-23T23:39:13.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344538+0000", 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5199999999999998e-07 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344540+0000", 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9740000000000001e-06 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344546+0000", 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4049999999999997e-06 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344551+0000", 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6859999999999997e-06 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119786 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345264+0000", 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0035535649999999998, 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0090103370000000002, 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.862 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119786 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345264+0000", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345264+0000", 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345265+0000", 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345267+0000", 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.097e-06 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345273+0000", 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1670000000000004e-06 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345277+0000", 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6720000000000003e-06 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119832 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345944+0000", 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0028733119999999998, 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0083578479999999993, 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.865 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119832 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345944+0000", 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345944+0000", 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345945+0000", 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345947+0000", 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2010000000000002e-06 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345954+0000", 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6499999999999999e-06 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345959+0000", 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0019999999999997e-06 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119864 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346678+0000", 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0021395839999999999, 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0076525789999999996, 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119864 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346678+0000", 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346678+0000", 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346678+0000", 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346680+0000", 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8560000000000001e-06 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346686+0000", 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4650000000000002e-06 2024-04-23T23:39:13.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346690+0000", 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5889999999999996e-06 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119603 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342321+0000", 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0064962570000000001, 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012037855, 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.871 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119603 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342321+0000", 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342321+0000", 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342322+0000", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.34e-07 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342324+0000", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9860000000000001e-06 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342331+0000", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0589999999999997e-06 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.873 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342336+0000", 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8439999999999997e-06 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119684 3.18 3.51fce938 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343672+0000", 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0051454159999999999, 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010718442999999999, 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.874 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119684 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343672+0000", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343672+0000", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343673+0000", 2024-04-23T23:39:13.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343675+0000", 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343683+0000", 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4139999999999994e-06 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343688+0000", 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1359999999999996e-06 2024-04-23T23:39:13.876 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119754 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344558+0000", 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0042599930000000001, 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0098605919999999996, 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119754 2024-04-23T23:39:13.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344558+0000", 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344558+0000", 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344558+0000", 2024-04-23T23:39:13.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5999999999999999e-07 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344560+0000", 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0880000000000002e-06 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344567+0000", 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3389999999999998e-06 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344571+0000", 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6619999999999996e-06 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.879 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119801 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345283+0000", 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0035343179999999998, 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0091625249999999995, 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119801 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.880 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345283+0000", 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345283+0000", 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345284+0000", 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.72e-07 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.881 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345285+0000", 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.767e-06 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345295+0000", 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7200000000000001e-06 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345300+0000", 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7740000000000004e-06 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.882 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119833 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345965+0000", 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0028527639999999998, 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085085300000000003, 2024-04-23T23:39:13.883 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119833 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345965+0000", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345965+0000", 2024-04-23T23:39:13.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345965+0000", 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345967+0000", 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9970000000000001e-06 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345981+0000", 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4019000000000001e-05 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345989+0000", 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119604 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342342+0000", 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0064758580000000001, 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01216363, 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.886 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119604 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342342+0000", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342342+0000", 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342342+0000", 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342344+0000", 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1840000000000002e-06 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342353+0000", 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9660000000000002e-06 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342359+0000", 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.203e-06 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119756 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344577+0000", 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.004240682, 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0099565049999999992, 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.889 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119756 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344577+0000", 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344577+0000", 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344577+0000", 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344579+0000", 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7990000000000001e-06 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344585+0000", 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0039999999999996e-06 2024-04-23T23:39:13.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344590+0000", 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5460000000000002e-06 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119802 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345306+0000", 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0035117870000000002, 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0092552829999999996, 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.892 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119802 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345306+0000", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345306+0000", 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345306+0000", 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6600000000000002e-07 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345311+0000", 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345319+0000", 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5410000000000003e-06 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345324+0000", 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7489999999999998e-06 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119834 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345996+0000", 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0028212409999999999, 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0085923449999999995, 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.895 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119834 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345996+0000", 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345996+0000", 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.896 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345997+0000", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.82e-07 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345999+0000", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346006+0000", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.827e-06 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346012+0000", 2024-04-23T23:39:13.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.772e-06 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119605 3.0 3.b7192800 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342366+0000", 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0064517639999999996, 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012254597000000001, 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.898 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119605 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342366+0000", 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342366+0000", 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342366+0000", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.75e-07 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342371+0000", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9509999999999997e-06 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342379+0000", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8550000000000002e-06 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342388+0000", 2024-04-23T23:39:13.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7870000000000007e-06 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119757 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344597+0000", 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0042208230000000003, 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010051101, 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119757 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344597+0000", 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344597+0000", 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344597+0000", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5699999999999998e-07 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344599+0000", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7999999999999999e-06 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344605+0000", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.207e-06 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344618+0000", 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2754e-05 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119803 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345330+0000", 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.003488133, 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.009345964, 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.904 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119803 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345330+0000", 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345330+0000", 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345330+0000", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.84e-07 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345332+0000", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.978e-06 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345340+0000", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9030000000000004e-06 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345349+0000", 2024-04-23T23:39:13.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9299999999999992e-06 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119835 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346048+0000", 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0027694239999999999, 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0086549049999999992, 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.907 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119835 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346048+0000", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346048+0000", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346049+0000", 2024-04-23T23:39:13.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3099999999999997e-07 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346053+0000", 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3420000000000001e-06 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346063+0000", 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2620000000000004e-06 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346074+0000", 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1093e-05 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119606 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342406+0000", 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0064119789999999999, 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012330498, 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.910 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119606 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342406+0000", 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342406+0000", 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342406+0000", 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1399999999999997e-07 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342409+0000", 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5380000000000001e-06 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342417+0000", 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5320000000000006e-06 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342423+0000", 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2809999999999999e-06 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119758 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344630+0000", 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0041875799999999998, 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010133448999999999, 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.913 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119758 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344630+0000", 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344630+0000", 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344630+0000", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344633+0000", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.03e-06 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344640+0000", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344645+0000", 2024-04-23T23:39:13.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2850000000000002e-06 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119804 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345355+0000", 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0034627109999999998, 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0094361110000000005, 2024-04-23T23:39:13.916 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119804 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345355+0000", 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345355+0000", 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345355+0000", 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5799999999999999e-07 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345357+0000", 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345365+0000", 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7680000000000008e-06 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345370+0000", 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8670000000000002e-06 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119836 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346086+0000", 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0027313110000000002, 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0087360679999999996, 2024-04-23T23:39:13.919 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119836 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346086+0000", 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346086+0000", 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346087+0000", 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5499999999999998e-07 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346089+0000", 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5349999999999999e-06 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346095+0000", 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8100000000000003e-06 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346100+0000", 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9869999999999999e-06 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119608 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.922 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.342429+0000", 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.006388487, 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012420924, 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119608 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342429+0000", 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342429+0000", 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342430+0000", 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342432+0000", 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0590000000000001e-06 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342438+0000", 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.066e-06 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.342443+0000", 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5899999999999998e-06 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119696 3.8 3.e4119aa8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.925 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.343884+0000", 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0049338630000000001, 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010994478, 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119696 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343884+0000", 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343884+0000", 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343884+0000", 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9299999999999997e-07 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343888+0000", 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0589999999999998e-06 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343896+0000", 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2449999999999998e-06 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.343902+0000", 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.928 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119759 3.8 3.d438f148 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.344651+0000", 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0041668190000000004, 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010255185, 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119759 2024-04-23T23:39:13.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344651+0000", 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344651+0000", 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344651+0000", 2024-04-23T23:39:13.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2499999999999995e-07 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344653+0000", 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.866e-06 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344659+0000", 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9880000000000001e-06 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.344664+0000", 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6419999999999998e-06 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119805 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.345376+0000", 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.003441913, 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0095610520000000004, 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.932 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119805 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345376+0000", 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345376+0000", 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345376+0000", 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4299999999999999e-07 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345378+0000", 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0080000000000001e-06 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345385+0000", 2024-04-23T23:39:13.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.345389+0000", 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000001e-06 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:119837 3.8 3.fe1833c8 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:13.346130+0000", 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0026876539999999998, 2024-04-23T23:39:13.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0088355359999999997, 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 119837 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346130+0000", 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346130+0000", 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346131+0000", 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346133+0000", 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5959999999999998e-06 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346140+0000", 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2370000000000003e-06 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:13.346145+0000", 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1849999999999997e-06 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 193 2024-04-23T23:39:13.938 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:13.939 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:13.939 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:13.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:13.941 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:13.941 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:13.942 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:13.942 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:13.945 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:13.951+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:13.948 INFO:teuthology.orchestra.run.smithi077.stdout:5240 read 0x2a45b1a thru 0x2a48543 (0x2a2a bytes) 2024-04-23T23:39:13.948 INFO:teuthology.orchestra.run.smithi077.stdout:5241 writesame 0xcee6eb6 thru 0xcee78f8 data_size 0x1(0xa43 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5242 punch from 0xb764d4f to 0xb768a17, (0x3cc8 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5244 write 0x58c521d thru 0x58d0e3e (0xbc22 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5245 write 0x2b80c3e thru 0x2b895b1 (0x8974 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5248 write 0x70152de thru 0x701b18e (0x5eb1 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5249 read 0x61266d8 thru 0x61296fa (0x3023 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5250 writesame 0x1d256ff thru 0x1d3123d data_size 0x1(0xbb3f bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5251 writesame 0x9751f20 thru 0x975b49f data_size 0x80(0x9580 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5252 writesame 0xbdee9b thru 0xbe00af data_size 0x1(0x1215 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5253 punch from 0xc0062e8 to 0xc0158d8, (0xf5f0 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5254 punch from 0x93c0f54 to 0x93ce46f, (0xd51b bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5260 punch from 0x2939bf9 to 0x2948680, (0xea87 bytes) 2024-04-23T23:39:13.949 INFO:teuthology.orchestra.run.smithi077.stdout:5261 writesame 0x1741218 thru 0x174787d data_size 0x11(0x6666 bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5262 write 0x9c74e42 thru 0x9c7e00d (0x91cc bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5263 write 0x9b4d696 thru 0x9b565c8 (0x8f33 bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5264 write 0x2a8f614 thru 0x2a94a06 (0x53f3 bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5266 write 0x762c494 thru 0x762e7dd (0x234a bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5267 write 0x7644a54 thru 0x764ef85 (0xa532 bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5268 read 0xa344023 thru 0xa350446 (0xc424 bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5269 read 0xb30277f thru 0xb30c315 (0x9b97 bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5270 write 0x8247f0 thru 0x83280a (0xe01b bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5271 write 0xc827d50 thru 0xc83091c (0x8bcd bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5272 trunc from 0xcee78f9 to 0xcc31edf 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5275 read 0x4738626 thru 0x473f970 (0x734b bytes) 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.950 INFO:teuthology.orchestra.run.smithi077.stdout:5279 write 0xdaefbeb thru 0xdafeba1 (0xefb7 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5280 read 0x5c1ad8e thru 0x5c20365 (0x55d8 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5281 write 0x5ee57a0 thru 0x5ef5051 (0xf8b2 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5282 trunc from 0xdafeba2 to 0x1923103 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5283 trunc from 0x1923103 to 0x531540c 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5284 read 0x28fa06b thru 0x2908dde (0xed74 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5287 writesame 0x2c9fd4c thru 0x2cacfae data_size 0xd(0xd263 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5289 writesame 0xd66df40 thru 0xd676e0d data_size 0x1b(0x8ece bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5291 write 0x8da92e5 thru 0x8dad6db (0x43f7 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5292 write 0x38636eb thru 0x3873032 (0xf948 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5294 write 0xb1b9d44 thru 0xb1c0bca (0x6e87 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5295 read 0x8379504 thru 0x837f5fa (0x60f7 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5296 read 0x5543f1a thru 0x554dddf (0x9ec6 bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5297 writesame 0xab1c61e thru 0xab29157 data_size 0x8a(0xcb3a bytes) 2024-04-23T23:39:13.951 INFO:teuthology.orchestra.run.smithi077.stdout:5298 read 0x4267277 thru 0x426f6de (0x8468 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5300 read 0x1cc473e thru 0x1cc9d33 (0x55f6 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5301 write 0xcc084e thru 0xcc5e58 (0x560b bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5302 trunc from 0xd676e0e to 0xd5b6b6a 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5304 read 0xa17bb10 thru 0xa1841d4 (0x86c5 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5305 punch from 0xbf65756 to 0xbf6a13d, (0x49e7 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5306 punch from 0x156bdfb to 0x157923e, (0xd443 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5307 punch from 0x8221ddd to 0x8231974, (0xfb97 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5308 read 0x239d480 thru 0x23a8fe9 (0xbb6a bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5310 write 0x68774e5 thru 0x687e0f2 (0x6c0e bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5311 write 0x47e0677 thru 0x47e21a4 (0x1b2e bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5314 write 0xc0855c9 thru 0xc08c300 (0x6d38 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5317 read 0x1c4c10b thru 0x1c556cf (0x95c5 bytes) 2024-04-23T23:39:13.952 INFO:teuthology.orchestra.run.smithi077.stdout:5319 trunc from 0xd5b6b6a to 0x642dcea 2024-04-23T23:39:13.953 INFO:teuthology.orchestra.run.smithi077.stdout:5320 punch from 0x5d0765f to 0x5d0d781, (0x6122 bytes) 2024-04-23T23:39:13.953 INFO:teuthology.orchestra.run.smithi077.stdout:5322 read 0x1179e7b thru 0x1183cf1 (0x9e77 bytes) 2024-04-23T23:39:13.953 INFO:teuthology.orchestra.run.smithi077.stdout:5323 read 0x3097a3f thru 0x309afad (0x356f bytes) 2024-04-23T23:39:13.953 INFO:teuthology.orchestra.run.smithi077.stdout:5324 read 0xad2800 thru 0xad9a91 (0x7292 bytes) 2024-04-23T23:39:13.953 INFO:teuthology.orchestra.run.smithi077.stdout:5325 read 0x564c395 thru 0x5659a16 (0xd682 bytes) 2024-04-23T23:39:13.953 INFO:teuthology.orchestra.run.smithi077.stdout:5326 trunc from 0x642dcea to 0x5f8101c 2024-04-23T23:39:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:5330 read 0x38fb4a1 thru 0x3901158 (0x5cb8 bytes) 2024-04-23T23:39:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:5331 read 0xa0fe17 thru 0xa1b404 (0xb5ee bytes) 2024-04-23T23:39:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.954 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:13.964 INFO:teuthology.orchestra.run.smithi077.stdout:5338 write 0xb2f34b0 thru 0xb2f6087 (0x2bd8 bytes) 2024-04-23T23:39:13.967 INFO:teuthology.orchestra.run.smithi077.stdout:5339 write 0xae1984c thru 0xae29349 (0xfafe bytes) 2024-04-23T23:39:13.970 INFO:teuthology.orchestra.run.smithi077.stdout:5340 writesame 0x394f022 thru 0x395e0b7 data_size 0xf(0xf096 bytes) 2024-04-23T23:39:13.975 INFO:teuthology.orchestra.run.smithi077.stdout:5344 trunc from 0xb2f6088 to 0x947eeb8 2024-04-23T23:39:13.982 INFO:teuthology.orchestra.run.smithi077.stdout:5346 punch from 0x59c329d to 0x59c413f, (0xea2 bytes) 2024-04-23T23:39:13.982 INFO:teuthology.orchestra.run.smithi077.stdout:5347 write 0x77a7b01 thru 0x77b12b1 (0x97b1 bytes) 2024-04-23T23:39:13.984 INFO:teuthology.orchestra.run.smithi077.stdout:5348 read 0x4859c1b thru 0x486203c (0x8422 bytes) 2024-04-23T23:39:13.985 INFO:teuthology.orchestra.run.smithi077.stdout:5349 writesame 0x7177b4e thru 0x7181e3f data_size 0x1(0xa2f2 bytes) 2024-04-23T23:39:14.002 INFO:teuthology.orchestra.run.smithi077.stdout:5351 read 0x300cd36 thru 0x30191c5 (0xc490 bytes) 2024-04-23T23:39:14.003 INFO:teuthology.orchestra.run.smithi077.stdout:5352 read 0xd563bb thru 0xd62e3f (0xca85 bytes) 2024-04-23T23:39:14.003 INFO:teuthology.orchestra.run.smithi077.stdout:5353 read 0x18c0017 thru 0x18ce098 (0xe082 bytes) 2024-04-23T23:39:14.004 INFO:teuthology.orchestra.run.smithi077.stdout:5354 write 0x627401f thru 0x627a76d (0x674f bytes) 2024-04-23T23:39:14.005 INFO:teuthology.orchestra.run.smithi077.stdout:5355 write 0x3985016 thru 0x398f910 (0xa8fb bytes) 2024-04-23T23:39:14.009 INFO:teuthology.orchestra.run.smithi077.stdout:5356 trunc from 0x947eeb8 to 0xaa18bc9 2024-04-23T23:39:14.014 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.014 INFO:teuthology.orchestra.run.smithi077.stdout:5360 punch from 0x2b5294f to 0x2b5fccb, (0xd37c bytes) 2024-04-23T23:39:14.014 INFO:teuthology.orchestra.run.smithi077.stdout:5361 punch from 0x11ac9ed to 0x11acf22, (0x535 bytes) 2024-04-23T23:39:14.014 INFO:teuthology.orchestra.run.smithi077.stdout:5362 read 0x48b7ada thru 0x48c3c45 (0xc16c bytes) 2024-04-23T23:39:14.015 INFO:teuthology.orchestra.run.smithi077.stdout:5364 trunc from 0xaa18bc9 to 0xb88ace9 2024-04-23T23:39:14.021 INFO:teuthology.orchestra.run.smithi077.stdout:5366 writesame 0x471cd93 thru 0x471e910 data_size 0x22(0x1b7e bytes) 2024-04-23T23:39:14.022 INFO:teuthology.orchestra.run.smithi077.stdout:5368 read 0x9b1c902 thru 0x9b26c07 (0xa306 bytes) 2024-04-23T23:39:14.022 INFO:teuthology.orchestra.run.smithi077.stdout:5371 read 0x29996c1 thru 0x299be4c (0x278c bytes) 2024-04-23T23:39:14.025 INFO:teuthology.orchestra.run.smithi077.stdout:5372 trunc from 0xb88ace9 to 0x8edf84a 2024-04-23T23:39:14.034 INFO:teuthology.orchestra.run.smithi077.stdout:5374 read 0x299ed30 thru 0x29ace7e (0xe14f bytes) 2024-04-23T23:39:14.034 INFO:teuthology.orchestra.run.smithi077.stdout:5376 writesame 0x14b1b98 thru 0x14b30d0 data_size 0x1(0x1539 bytes) 2024-04-23T23:39:14.041 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:14.053+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:14.046 INFO:teuthology.orchestra.run.smithi077.stdout:5377 trunc from 0x8edf84a to 0x9fa4b8 2024-04-23T23:39:14.068 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:14.068 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:14.068 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:14.068 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:14.068 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:14.073 INFO:teuthology.orchestra.run.smithi077.stdout:5378 writesame 0x787a26a thru 0x7884649 data_size 0x60(0xa3e0 bytes) 2024-04-23T23:39:14.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:14.079 INFO:teuthology.orchestra.run.smithi077.stdout:5379 write 0x870dadd thru 0x8710fbc (0x34e0 bytes) 2024-04-23T23:39:14.082 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.084 INFO:teuthology.orchestra.run.smithi077.stdout:5382 trunc from 0x8710fbd to 0xa6628dd 2024-04-23T23:39:14.099 INFO:teuthology.orchestra.run.smithi077.stdout:5383 write 0xed33715 thru 0xed36a27 (0x3313 bytes) 2024-04-23T23:39:14.102 INFO:teuthology.orchestra.run.smithi077.stdout:5384 write 0x82f2799 thru 0x82f27b5 (0x1d bytes) 2024-04-23T23:39:14.106 INFO:teuthology.orchestra.run.smithi077.stdout:5386 read 0x4b96da1 thru 0x4b9b30f (0x456f bytes) 2024-04-23T23:39:14.111 INFO:teuthology.orchestra.run.smithi077.stdout:5387 trunc from 0xed36a28 to 0xb5029a6 2024-04-23T23:39:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:5388 writesame 0xbc0d5b5 thru 0xbc1442c data_size 0x28(0x6e78 bytes) 2024-04-23T23:39:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:5390 punch from 0x88212a1 to 0x8830675, (0xf3d4 bytes) 2024-04-23T23:39:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:5394 read 0x94f95b1 thru 0x94fa580 (0xfd0 bytes) 2024-04-23T23:39:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:5395 write 0x3f8af7a thru 0x3f911af (0x6236 bytes) 2024-04-23T23:39:14.138 INFO:teuthology.orchestra.run.smithi077.stdout:5396 write 0xcb98e88 thru 0xcb9b1d6 (0x234f bytes) 2024-04-23T23:39:14.142 INFO:teuthology.orchestra.run.smithi077.stdout:5397 write 0x8de4dc9 thru 0x8debee2 (0x711a bytes) 2024-04-23T23:39:14.142 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:14.154+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:14.146 INFO:teuthology.orchestra.run.smithi077.stdout:5398 punch from 0xc56e17a to 0xc578cfb, (0xab81 bytes) 2024-04-23T23:39:14.147 INFO:teuthology.orchestra.run.smithi077.stdout:5399 punch from 0xbcebf4e to 0xbcf3dfa, (0x7eac bytes) 2024-04-23T23:39:14.147 INFO:teuthology.orchestra.run.smithi077.stdout:5400 read 0xac19ec8 thru 0xac247ab (0xa8e4 bytes) 2024-04-23T23:39:14.147 INFO:teuthology.orchestra.run.smithi077.stdout:5401 write 0x112d905 thru 0x1137810 (0x9f0c bytes) 2024-04-23T23:39:14.162 INFO:teuthology.orchestra.run.smithi077.stdout:5402 trunc from 0xcb9b1d7 to 0x3e10e5 2024-04-23T23:39:14.189 INFO:teuthology.orchestra.run.smithi077.stdout:5403 trunc from 0x3e10e5 to 0x5423e61 2024-04-23T23:39:14.193 INFO:teuthology.orchestra.run.smithi077.stdout:5405 read 0x13c0e49 thru 0x13c80fe (0x72b6 bytes) 2024-04-23T23:39:14.194 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:14.194 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 85.812160845999998, 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:39:14.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:39:14.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:39:14.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 76.813510218000005, 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:39:14.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:39:14.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:39:14.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.373856805000003, 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.205 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:14.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:14.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90590 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3441664~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.204323250000002, 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051386827000000003, 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90590 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001684+0000", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001690+0000", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1480000000000003e-06 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001694+0000", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052909+0000", 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051214519 2024-04-23T23:39:14.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052978+0000", 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8738000000000005e-05 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.053068+0000", 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0068000000000006e-05 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90651 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3556352~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.214 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.200440608000001, 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051409877, 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90651 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005566+0000", 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9489999999999999e-06 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005572+0000", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1179999999999997e-06 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005577+0000", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7060000000000003e-06 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056808+0000", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051230879999999999 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056879+0000", 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1261999999999996e-05 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056973+0000", 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4569999999999997e-05 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90653 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3563520~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:14.218 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.200421487, 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051620653000000002, 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90653 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005585+0000", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.883e-06 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005591+0000", 2024-04-23T23:39:14.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005596+0000", 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057017+0000", 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051421175999999999 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057094+0000", 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7040999999999996e-05 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057203+0000", 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010935 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90655 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3570688~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:14.222 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.200402836999999, 2024-04-23T23:39:14.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051736068000000003, 2024-04-23T23:39:14.225 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.225 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.225 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90655 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005602+0000", 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005603+0000", 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005609+0000", 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005614+0000", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6190000000000002e-06 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057238+0000", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051623872000000001 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057281+0000", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3259e-05 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057337+0000", 2024-04-23T23:39:14.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6298999999999997e-05 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90662 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3613696~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.198818651, 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051308223, 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90662 2024-04-23T23:39:14.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007186+0000", 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:14.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007188+0000", 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.945e-06 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007195+0000", 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007200+0000", 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058336+0000", 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051136231999999997 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058404+0000", 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8613000000000002e-05 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058494+0000", 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9314999999999994e-05 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.232 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90663 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3620864~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.198797475999999, 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051524557999999998, 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90663 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007209+0000", 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.813e-06 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007215+0000", 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3899999999999998e-06 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007220+0000", 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8189999999999999e-06 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058536+0000", 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051315847999999997 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058621+0000", 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5453999999999999e-05 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058731+0000", 2024-04-23T23:39:14.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010982800000000001 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90664 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3628032~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.198778259000001, 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051704831, 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.237 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90664 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:14.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007228+0000", 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.829e-06 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007233+0000", 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007238+0000", 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5159999999999996e-06 2024-04-23T23:39:14.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058770+0000", 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051532124999999998 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058839+0000", 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9356999999999993e-05 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058931+0000", 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1230000000000006e-05 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90665 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3635200~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.198760365999998, 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051935859000000001, 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90665 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008976+0000", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017323939999999999 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008980+0000", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0910000000000003e-06 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008987+0000", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.131e-06 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008992+0000", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6670000000000004e-06 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058981+0000", 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049988772000000001 2024-04-23T23:39:14.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059068+0000", 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7640999999999997e-05 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059180+0000", 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011116300000000001 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90674 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4484096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.196820665000001, 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051442084999999999, 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90674 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009184+0000", 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009186+0000", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009192+0000", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009198+0000", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060463+0000", 2024-04-23T23:39:14.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051264788999999998 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060543+0000", 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0344000000000002e-05 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060626+0000", 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2576000000000004e-05 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.248 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90675 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4491264~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.196799901999999, 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051599027999999998, 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90675 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009205+0000", 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009207+0000", 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009212+0000", 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7479999999999999e-06 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009218+0000", 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1919999999999996e-06 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060663+0000", 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051445554999999997 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060732+0000", 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9041000000000005e-05 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060803+0000", 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1135000000000002e-05 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90676 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4498432~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.196780923999999, 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051792194999999999, 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90676 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009224+0000", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009225+0000", 2024-04-23T23:39:14.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009232+0000", 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5089999999999999e-06 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009238+0000", 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060845+0000", 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051607346999999998 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060927+0000", 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1644999999999995e-05 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061015+0000", 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8642999999999998e-05 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90677 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4505600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:14.256 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.196760338000001, 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051967037000000001, 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90677 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010979+0000", 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017348070000000001 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010985+0000", 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010995+0000", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0370000000000001e-05 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011002+0000", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2960000000000001e-06 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061051+0000", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.050048603999999997 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061134+0000", 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3219000000000004e-05 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061211+0000", 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6724999999999995e-05 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90686 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4562944~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.194751620000002, 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051380604000000003, 2024-04-23T23:39:14.260 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90686 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011253+0000", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.34e-07 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011254+0000", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011258+0000", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7050000000000001e-06 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011261+0000", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9349999999999999e-06 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062492+0000", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051231454000000003 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062563+0000", 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0461000000000002e-05 2024-04-23T23:39:14.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062633+0000", 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0548000000000003e-05 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90687 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4570112~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.194740475, 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051576652000000001, 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.264 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90687 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9299999999999999e-07 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011265+0000", 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2109999999999999e-06 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011268+0000", 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1470000000000001e-06 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011271+0000", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6309999999999999e-06 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062678+0000", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051406962 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062759+0000", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0803000000000005e-05 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062840+0000", 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1605000000000002e-05 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90688 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4577280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.194730346, 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051748664999999999, 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.268 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90688 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012977+0000", 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017037109999999999 2024-04-23T23:39:14.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012982+0000", 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5979999999999999e-06 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013006+0000", 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4300000000000001e-05 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013015+0000", 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4649999999999994e-06 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062879+0000", 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049864420999999999 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062949+0000", 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9728999999999996e-05 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.063022+0000", 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3441000000000004e-05 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.271 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.311997033000001, 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.272 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:39:14.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.276 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.3391675139999997, 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:39:14.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:39:14.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.281 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:14.282 INFO:teuthology.orchestra.run.smithi077.stdout:5407 punch from 0x2c6fdc0 to 0x2c7066e, (0x8ae bytes) 2024-04-23T23:39:14.282 INFO:teuthology.orchestra.run.smithi077.stdout:5409 punch from 0x2b096d to 0x2bc558, (0xbbeb bytes) 2024-04-23T23:39:14.282 INFO:teuthology.orchestra.run.smithi077.stdout:5410 write 0x76fe7bf thru 0x77061e1 (0x7a23 bytes) 2024-04-23T23:39:14.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:14.284 INFO:teuthology.orchestra.run.smithi077.stdout:5411 write 0xa7d4f3c thru 0xa7dd262 (0x8327 bytes) 2024-04-23T23:39:14.284 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.284 INFO:teuthology.orchestra.run.smithi077.stdout:5415 read 0xa7208f6 thru 0xa72ad08 (0xa413 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5417 write 0x4a89645 thru 0x4a92425 (0x8de1 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5419 write 0x1ee8864 thru 0x1ef0cfe (0x849b bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5420 read 0x1301bd6 thru 0x1305b65 (0x3f90 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5421 write 0xd2d824f thru 0xd2db940 (0x36f2 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5422 read 0xc85a480 thru 0xc8615e7 (0x7168 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5424 writesame 0x766be2a thru 0x7673e49 data_size 0x64(0x8020 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5425 write 0x6a98c91 thru 0x6aa0f79 (0x82e9 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5426 writesame 0x86315e4 thru 0x8639a5b data_size 0x48(0x8478 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5427 write 0x859c4fc thru 0x85a6ad8 (0xa5dd bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5428 read 0x7b19807 thru 0x7b2881d (0xf017 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5429 write 0xd53a4a2 thru 0xd53e729 (0x4288 bytes) 2024-04-23T23:39:14.285 INFO:teuthology.orchestra.run.smithi077.stdout:5430 trunc from 0xd53e72a to 0x355c240 2024-04-23T23:39:14.286 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:14.297+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:14.295 INFO:teuthology.orchestra.run.smithi077.stdout:5431 trunc from 0x355c240 to 0xaa9b3f1 2024-04-23T23:39:14.300 INFO:teuthology.orchestra.run.smithi077.stdout:5432 writesame 0x8e60d1c thru 0x8e66d12 data_size 0x13(0x5ff7 bytes) 2024-04-23T23:39:14.303 INFO:teuthology.orchestra.run.smithi077.stdout:5433 read 0xa5c0851 thru 0xa5cd95a (0xd10a bytes) 2024-04-23T23:39:14.303 INFO:teuthology.orchestra.run.smithi077.stdout:5434 write 0x76654b5 thru 0x7665f9f (0xaeb bytes) 2024-04-23T23:39:14.311 INFO:teuthology.orchestra.run.smithi077.stdout:5436 writesame 0xbc15a21 thru 0xbc23815 data_size 0x1(0xddf5 bytes) 2024-04-23T23:39:14.311 INFO:teuthology.orchestra.run.smithi077.stdout:5437 read 0x444801 thru 0x4490d2 (0x48d2 bytes) 2024-04-23T23:39:14.317 INFO:teuthology.orchestra.run.smithi077.stdout:5440 trunc from 0xbc23816 to 0x6f97507 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:5442 read 0x6a5f871 thru 0x6a6826c (0x89fc bytes) 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:5443 read 0x1ffd507 thru 0x200000b (0x2b05 bytes) 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:5444 punch from 0x4dfca3e to 0x4dff11e, (0x26e0 bytes) 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:14.324 INFO:teuthology.orchestra.run.smithi077.stdout:5449 clone 46 order 23 su 2097152 sc 13 2024-04-23T23:39:14.385 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:14.398+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:14.399 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:14.399 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:14.399 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:14.399 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:14.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:14.486 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:14.499+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:14.548 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:14.548 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:14.549 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:14.549 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:14.549 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:14.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:14.588 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:14.600+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:14.660 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 86.263360348999996, 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 77.263664495, 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:14.668 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 64.584407397999996, 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:39:14.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56712 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20578304~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403230452999999, 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012838067999999999, 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56712 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269165+0000", 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269166+0000", 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0199999999999998e-07 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269167+0000", 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.316e-06 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269170+0000", 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3830000000000001e-06 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269173+0000", 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4399999999999999e-06 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281816+0000", 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012643596999999999 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.281903+0000", 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6630000000000002e-05 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282004+0000", 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0001004 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56713 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23199744~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403220124000001, 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013058065000000001, 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56713 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269176+0000", 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.28e-07 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269177+0000", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.003e-06 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269180+0000", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0319999999999999e-06 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269184+0000", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.755e-06 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282046+0000", 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01286259 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282131+0000", 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4917e-05 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282234+0000", 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010254 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403209206, 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:39:14.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.684 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403181019999998, 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.688 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403165315000003, 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403154332, 2024-04-23T23:39:14.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:14.696 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403139961000001, 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:39:14.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403102621999999, 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.700 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:14.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:39:14.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403080303000003, 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:39:14.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.707 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403053088999997, 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403033035999997, 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.712 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:14.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.403013659000003, 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.716 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.402994235000001, 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:14.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.491645085999998, 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:39:14.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:39:14.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.727 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 36.283802858000001, 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.731 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 36.115803839000002, 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 36.097235607999998, 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:14.735 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:14.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:14.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:14.739 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:14.740 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:14.741 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:14.753+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:14.841 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:14.853+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:14.843 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:14.843 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:14.843 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:14.843 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:14.852 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:14.942 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:14.954+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:14.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:39:15.004 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.005 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:15.005 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:15.005 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:15.005 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:15.014 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:15.050 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone45 from 0x6f97507 (overlap 0x3e10e5) to 0x1f0872 2024-04-23T23:39:15.058 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:15.071+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 70.153379638999994, 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.896300883999999, 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:39:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:39:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.896258552000006, 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:39:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.896235951999998, 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:39:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:39:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.896210865, 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:39:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.896189527999994, 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:39:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.896168481000004, 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.895964026000001, 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.895630627000003, 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.895604731000006, 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:39:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.895207799000005, 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:39:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.895171473000005, 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:39:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.894783114999996, 2024-04-23T23:39:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:39:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.894757713999994, 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:39:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:39:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.892576715999994, 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.892556368000001, 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:39:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.892536688000007, 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:39:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.890533231999996, 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:39:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:39:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.249625222000001, 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.1333749730000005, 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.212 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:15.213 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-04-23T23:39:15.213 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:15.214 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:15.225+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:15.237 INFO:teuthology.orchestra.run.smithi077.stdout:5450 writesame 0xbd0e6ea thru 0xbd1dcd7 data_size 0x15(0xf5ee bytes) 2024-04-23T23:39:15.241 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:15.241 INFO:teuthology.orchestra.run.smithi077.stdout:5452 punch from 0x9fef666 to 0x9ff847e, (0x8e18 bytes) 2024-04-23T23:39:15.241 INFO:teuthology.orchestra.run.smithi077.stdout:5453 trunc from 0xbd1dcd8 to 0xc629f4a 2024-04-23T23:39:15.247 INFO:teuthology.orchestra.run.smithi077.stdout:5454 read 0x3e8c1d7 thru 0x3e93598 (0x73c2 bytes) 2024-04-23T23:39:15.247 INFO:teuthology.orchestra.run.smithi077.stdout:5455 write 0x8f3a236 thru 0x8f43446 (0x9211 bytes) 2024-04-23T23:39:15.250 INFO:teuthology.orchestra.run.smithi077.stdout:5456 clone 47 order 18 su 1024 sc 15 2024-04-23T23:39:15.314 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:15.327+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:15.356 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.356 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:15.356 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:15.356 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:15.365 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:15.450 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:15.462+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:15.508 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.508 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:15.508 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:15.508 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:15.508 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:15.515 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:15.528+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:15.516 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:15.616 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:15.628+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.762119343999998, 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.661 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:39:15.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:39:15.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.762085142999993, 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.762051553000006, 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.762014018000002, 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.761990482000002, 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:39:15.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.681 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760572878999994, 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:39:15.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:39:15.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760550570000007, 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:39:15.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760382347000004, 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.690 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:39:15.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:39:15.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:39:15.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760333621000001, 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760238426000001, 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.698 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:39:15.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:39:15.701 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760206475999993, 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:39:15.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:15.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:39:15.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.705 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760184175999996, 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.706 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:39:15.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.709 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.760153979999998, 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.710 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:15.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.759994215000006, 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.759958596000004, 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:15.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:15.721 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.759859315, 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.759829749000005, 2024-04-23T23:39:15.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:39:15.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:39:15.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.759807324999997, 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.729 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:15.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:39:15.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.129789660999997, 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:39:15.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:39:15.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:120050 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:13.645670+0000", 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 2.026840086, 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044824704999999999, 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:15.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 120050 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.645670+0000", 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.645670+0000", 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.645671+0000", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.879999999999999e-07 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656459+0000", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010787622 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656497+0000", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8269000000000002e-05 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:15.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656506+0000", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6549999999999993e-06 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656563+0000", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7290000000000002e-05 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656665+0000", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102125 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 5", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.666623+0000", 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0099580299999999997 2024-04-23T23:39:15.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690271+0000", 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023647996000000001 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690405+0000", 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00013371999999999999 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690446+0000", 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1576999999999999e-05 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:15.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690495+0000", 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8433000000000002e-05 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:15.743 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:15.744 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:15.745 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:15.757+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:15.845 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:15.857+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:15.887 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.887 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:15.887 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:15.887 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:15.896 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:15.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:15.946 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:15.958+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:15.996 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:39:15.999 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:15.999 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:15.999 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:15.999 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:15.999 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:16.009 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:16.051 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:16.064+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:16.074 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:16.074 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:16.091 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:16.091 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:16.108 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:16.108 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:16.108 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:16.125 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:16.126 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:16.143 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:16.143 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:16.148 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:16.161+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:39:16.155 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 118.438899232, 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:39:16.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:39:16.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:39:16.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:39:16.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 48.113046222999998, 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:16.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:39:16.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:39:16.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:39:16.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:39:16.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.614073185999999, 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:39:16.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:39:16.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:39:16.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.173 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106837 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1105920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.021024199999999, 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043899269999999997, 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106837 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145834+0000", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0699999999999999e-07 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145835+0000", 2024-04-23T23:39:16.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0210000000000001e-06 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145837+0000", 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.847e-06 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145840+0000", 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.481e-06 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189637+0000", 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043796663 2024-04-23T23:39:16.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189681+0000", 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4725999999999998e-05 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189733+0000", 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1325000000000001e-05 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106838 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1130496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.177 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.021014811000001, 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044012456999999998, 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106838 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145844+0000", 2024-04-23T23:39:16.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.049e-06 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145847+0000", 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8289999999999999e-06 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145849+0000", 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189761+0000", 2024-04-23T23:39:16.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911752999999998 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189804+0000", 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2695999999999999e-05 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189855+0000", 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1431999999999998e-05 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.181 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106839 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1155072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.021005462000002, 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044114555999999999, 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106839 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:16.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146080+0000", 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000227486 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146083+0000", 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.258e-06 2024-04-23T23:39:16.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146093+0000", 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0672999999999999e-05 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146100+0000", 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0299999999999999e-06 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189882+0000", 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043782284999999997 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189920+0000", 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8516000000000002e-05 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189967+0000", 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6307999999999998e-05 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106840 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1179648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:16.185 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.020747935999999, 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043966107999999997, 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106840 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146117+0000", 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6619999999999999e-06 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146129+0000", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2371000000000001e-05 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146134+0000", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2449999999999998e-06 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189992+0000", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043858000000000001 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190030+0000", 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7755e-05 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190076+0000", 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5538999999999999e-05 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106841 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1335296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.020715207999999, 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044044613000000003, 2024-04-23T23:39:16.189 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106841 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146143+0000", 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146145+0000", 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.334e-06 2024-04-23T23:39:16.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146152+0000", 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4479999999999999e-06 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146156+0000", 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7509999999999999e-06 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190099+0000", 2024-04-23T23:39:16.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043942795999999999 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190140+0000", 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0813999999999999e-05 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190187+0000", 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6974999999999997e-05 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106842 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1359872~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.020694781, 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044137033999999999, 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106842 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.194 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147472+0000", 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0013091859999999999 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147475+0000", 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3739999999999998e-06 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147487+0000", 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1212e-05 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147494+0000", 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1459999999999999e-06 2024-04-23T23:39:16.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190215+0000", 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042721228999999999 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190254+0000", 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9161e-05 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190300+0000", 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5726000000000002e-05 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.197 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106855 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2072576~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.019031353999999, 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043925840000000001, 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106855 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147827+0000", 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147829+0000", 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7010000000000001e-06 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147837+0000", 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7910000000000005e-06 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147843+0000", 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9560000000000002e-06 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191668+0000", 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043824701000000001 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191708+0000", 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0371999999999999e-05 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191752+0000", 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3792999999999999e-05 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106856 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2097152~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.019006851, 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044011869000000002, 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106856 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.202 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7599999999999997e-07 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147853+0000", 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1780000000000002e-06 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147860+0000", 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5019999999999998e-06 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147865+0000", 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191777+0000", 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911126000000002 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191819+0000", 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1990000000000003e-05 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191863+0000", 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3995999999999997e-05 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106857 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.018985528000002, 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044095387999999999, 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106857 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147873+0000", 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.82e-07 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147874+0000", 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147881+0000", 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.392e-06 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147886+0000", 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9389999999999996e-06 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191884+0000", 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043998430999999998 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191922+0000", 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7339000000000003e-05 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191967+0000", 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5785000000000003e-05 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.209 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106858 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2277376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.018965404999999, 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044206352999999997, 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106858 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149473+0000", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001580733 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149477+0000", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149488+0000", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0891e-05 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149495+0000", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2289999999999997e-06 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191990+0000", 2024-04-23T23:39:16.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042494707999999999 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192048+0000", 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7615000000000003e-05 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192098+0000", 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0915999999999998e-05 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.213 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106873 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3170304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.017025233999998, 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043985420999999997, 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106873 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149833+0000", 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999998e-07 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149834+0000", 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.15e-06 2024-04-23T23:39:16.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149837+0000", 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9390000000000002e-06 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149839+0000", 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5739999999999998e-06 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193731+0000", 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043891442000000003 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193770+0000", 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9236999999999997e-05 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193818+0000", 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7839000000000001e-05 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106874 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3194880~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.017015563000001, 2024-04-23T23:39:16.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044084569999999997, 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106874 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149843+0000", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2600000000000001e-07 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149846+0000", 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.366e-06 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149851+0000", 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999997e-06 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193842+0000", 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043991808 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193880+0000", 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7296999999999999e-05 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193927+0000", 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6864999999999999e-05 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106875 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3219456~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.017001791999999, 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044177196000000002, 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.221 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106875 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:16.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149940+0000", 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4321999999999997e-05 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149942+0000", 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.26e-06 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149948+0000", 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9190000000000004e-06 2024-04-23T23:39:16.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149952+0000", 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7560000000000001e-06 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193948+0000", 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043995819999999998 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193985+0000", 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6798999999999998e-05 2024-04-23T23:39:16.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194033+0000", 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999998e-05 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106876 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3244032~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.016898616999999, 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044183060000000003, 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106876 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:16.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151472+0000", 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001513316 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151481+0000", 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6829999999999997e-06 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151490+0000", 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8929999999999994e-06 2024-04-23T23:39:16.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151496+0000", 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8690000000000001e-06 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194058+0000", 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042562068000000002 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194095+0000", 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7336000000000003e-05 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194142+0000", 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6894999999999997e-05 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106886 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3883008~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.015168315, 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043926192000000003, 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106886 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4600000000000001e-07 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151691+0000", 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.277e-06 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151694+0000", 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0599999999999999e-06 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151696+0000", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.531e-06 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195434+0000", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043737442000000001 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195516+0000", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2545000000000003e-05 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195615+0000", 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9091000000000004e-05 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106887 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3907584~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.015158016000001, 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044058967999999997, 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106887 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-07 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151701+0000", 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1310000000000001e-06 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151704+0000", 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.954e-06 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151706+0000", 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.571e-06 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195662+0000", 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043955283999999997 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195711+0000", 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8872999999999998e-05 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195758+0000", 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7935000000000001e-05 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106888 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3932160~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.015148421999999, 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044184735000000003, 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:16.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106888 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153471+0000", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001761777 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153485+0000", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4015999999999999e-05 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153495+0000", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7899999999999994e-06 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153500+0000", 2024-04-23T23:39:16.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1739999999999999e-06 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195787+0000", 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042287400000000003 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195830+0000", 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2624999999999999e-05 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195894+0000", 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3953000000000002e-05 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.241 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.241 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:16.241 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:16.241 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:16.241 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4] out_osds: [3, 0, 7] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:16.241 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:16.241 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-23T23:39:16.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:39:16.242 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:16.243 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:16.243 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:16.244 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:16.244 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:16.287 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:16.298+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:16.317 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone46 from 0xc629f4a (overlap 0x6f97507) to 0x1651767 2024-04-23T23:39:16.350 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:16.362+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:16.407 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:16.407 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:16.416 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:16.451 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:16.463+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:16.521 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:16.521 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:16.527 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #45, image image_client.0-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent46 2024-04-23T23:39:16.531 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:16.542 INFO:teuthology.orchestra.run.smithi077.stdout:5457 trunc from 0xc629f4a to 0x64aa6b7 2024-04-23T23:39:16.575 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:16.588+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:16.595 INFO:teuthology.orchestra.run.smithi077.stdout:5459 read 0x3ecf11c thru 0x3edce31 (0xdd16 bytes) 2024-04-23T23:39:16.600 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:16.600 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:16.600 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 109, 2024-04-23T23:39:16.600 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:39:16.600 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:39:16.002645+0000", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:38:46.812648+0000", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:39:05.808440+0000", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5799936, 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 5, 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:39:16.601 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 3, 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "luminous", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:39:16.602 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:39:16.603 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:39:16.604 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:16.605 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:16.606 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 8, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 8, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.25, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:16.607 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:16.608 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:16.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:16.610 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.611 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:16.612 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 2.9800000190734863, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 2.9800000190734863, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.62999999523162842, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 1.8799999952316284, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.8799999952316284, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "pool_client.0", 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:30.028908+0000", 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 8193, 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-04-23T23:39:16.613 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 32, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 32, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 32, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 32, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 32, 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:16.614 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "109", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 49, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 109, 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:16.615 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:16.616 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:16.617 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 3.2200000286102295, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 3.2200000286102295, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.62999999523162842, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.0299999713897705, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2.0299999713897705, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.618 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 80, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.619 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.620 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.622 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.623 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 103, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.624 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.627 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:39:16.628 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 100, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:16.629 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.630 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.631 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:39:16.633 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 0, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.634 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 55, 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 84, 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.635 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/4292713565", 2024-04-23T23:39:16.638 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/4292713565", 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/4292713565", 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/4292713565", 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "exists" 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.639 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 104, 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.640 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.641 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.642 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.643 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 24, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 35, 2024-04-23T23:39:16.644 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 103, 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 26, 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.645 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.646 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.647 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2756265516", 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2756265516", 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2756265516", 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2756265516", 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:16.649 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.1546478271484375, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 102, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:39:16.650 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:39:16.651 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:39:16.652 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.654 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.744476318359375, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 99, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:16.655 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:16.656 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.657 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:16.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:39:16.659 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:39:16.660 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.661 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 84 2024-04-23T23:39:16.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:39:16.663 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 26 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:16.664 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [ 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:16.665 INFO:teuthology.orchestra.run.smithi077.stdout: "pgid": "2.3", 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: 2, 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: 6 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:39:16.666 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [], 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [], 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [], 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:39:16.667 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:39:16.668 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:16.668 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:16.669 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:16.669 INFO:teuthology.orchestra.run.smithi077.stdout:5463 writesame 0xc0e96d6 thru 0xc0ef253 data_size 0x31(0x5b7e bytes) 2024-04-23T23:39:16.669 INFO:teuthology.orchestra.run.smithi077.stdout:5464 read 0x2d7d286 thru 0x2d7fa6d (0x27e8 bytes) 2024-04-23T23:39:16.670 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:16.670 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:16.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:16.671 INFO:tasks.thrashosds.thrasher:j is {'epoch': 109, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:39:16.002645+0000', 'last_up_change': '2024-04-23T23:38:46.812648+0000', 'last_in_change': '2024-04-23T23:39:05.808440+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-04-23T23:37:30.028908+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 109, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.2200000286102295, 'score_stable': 3.2200000286102295, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 2.0299999713897705, 'raw_score_stable': 2.0299999713897705, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 103, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 55, 'down_at': 84, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 4292713565}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 4292713565}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 4292713565}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 4292713565}]}, 'public_addr': '172.21.15.77:6809/4292713565', 'cluster_addr': '172.21.15.77:6811/4292713565', 'heartbeat_back_addr': '172.21.15.77:6815/4292713565', 'heartbeat_front_addr': '172.21.15.77:6813/4292713565', 'state': ['exists']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 104, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 24, 'up_from': 35, 'up_thru': 103, 'down_at': 26, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2756265516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2756265516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2756265516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2756265516}]}, 'public_addr': '172.21.15.170:6801/2756265516', 'cluster_addr': '172.21.15.170:6803/2756265516', 'heartbeat_back_addr': '172.21.15.170:6807/2756265516', 'heartbeat_front_addr': '172.21.15.170:6805/2756265516', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1546478271484375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0.744476318359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 99, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 84}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 26}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.3', 'osds': [2, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:39:16.672 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 2.3 2024-04-23T23:39:16.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap 2.3 2024-04-23T23:39:16.672 INFO:teuthology.orchestra.run.smithi077.stdout:5465 read 0x34babb thru 0x34e6ad (0x2bf3 bytes) 2024-04-23T23:39:16.672 INFO:teuthology.orchestra.run.smithi077.stdout:5466 flatten 2024-04-23T23:39:16.672 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:16.681+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:16.770 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:16.782+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:16.826 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:16.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:16.871 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:16.884+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:16.972 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:16.985+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:16.980 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:16.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:17.073 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:17.086+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:17.174 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:17.186+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.212 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:17.275 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:17.288+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.373 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.376 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:17.389+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:17.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:17.477 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:17.490+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.537 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:17.577 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:17.590+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.662 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:17.715 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:17.727+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:17.780 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:17.793+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.784 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:17.881 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:17.894+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:17.945 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:17.955 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:18.002 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:18.012+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:18.006 INFO:teuthology.orchestra.run.smithi077.stderr:clear 2.3 pg_upmap mapping 2024-04-23T23:39:18.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:39:18.084 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:18.096+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:18.111 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:18.111 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:18.125 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:18.185 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:18.197+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:18.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:18.287 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:18.299+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:18.336 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:18.336 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:18.350 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:18.374 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:18.374 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:18.387 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:18.399+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:18.393 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:18.394 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:18.411 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:18.411 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:18.412 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:18.431 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:18.431 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:18.465 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:18.465 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:18.482 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:18.483 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:18.488 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:18.500+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:18.502 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:18.504 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:18.505 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.572830905999993, 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:18.551 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33570 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12222464~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315752150999998, 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047435962999999998, 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33570 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245991+0000", 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.245993+0000", 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9360000000000002e-06 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246000+0000", 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5570000000000001e-06 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246005+0000", 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1150000000000002e-06 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293304+0000", 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047298912999999998 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293355+0000", 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1204e-05 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293427+0000", 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1865000000000004e-05 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33573 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12419072~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315709819000006, 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047636495000000001, 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33573 2024-04-23T23:39:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246033+0000", 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246034+0000", 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246036+0000", 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9649999999999998e-06 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246043+0000", 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8859999999999998e-06 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246049+0000", 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1319999999999999e-06 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293474+0000", 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047424701 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293564+0000", 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0759000000000003e-05 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293670+0000", 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105475 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33579 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6324224~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315687218999997, 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047763914999999997, 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33579 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246056+0000", 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246058+0000", 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9850000000000001e-06 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246065+0000", 2024-04-23T23:39:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4439999999999996e-06 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246070+0000", 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1560000000000003e-06 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293704+0000", 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047634211000000003 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293749+0000", 2024-04-23T23:39:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400999999999997e-05 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293820+0000", 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1221000000000001e-05 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33580 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6520832~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315662132, 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047955193, 2024-04-23T23:39:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33580 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246081+0000", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246083+0000", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246090+0000", 2024-04-23T23:39:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5050000000000004e-06 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246095+0000", 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0989999999999998e-06 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293862+0000", 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047767206999999999 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.293942+0000", 2024-04-23T23:39:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9796999999999995e-05 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294036+0000", 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4180999999999998e-05 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33581 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6717440~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315640794999993, 2024-04-23T23:39:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048147092000000002, 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33581 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246102+0000", 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246103+0000", 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246105+0000", 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.069e-06 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246111+0000", 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246116+0000", 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294078+0000", 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047961740000000003 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294167+0000", 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8628999999999995e-05 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294249+0000", 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2789999999999998e-05 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33582 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 6914048~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315619748000003, 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048327488000000002, 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33582 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246123+0000", 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246301+0000", 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017764199999999999 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246304+0000", 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3900000000000002e-06 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246313+0000", 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2800000000000003e-06 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246319+0000", 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294286+0000", 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047966891999999997 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294362+0000", 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6775999999999998e-05 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294451+0000", 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8407999999999998e-05 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33583 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7110656~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315415293000001, 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048317418000000001, 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33583 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246328+0000", 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246626+0000", 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00029822900000000001 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246630+0000", 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8489999999999999e-06 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246640+0000", 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0558e-05 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246648+0000", 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7249999999999997e-06 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294496+0000", 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047847717999999997 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294578+0000", 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294645+0000", 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7127999999999998e-05 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33584 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7307264~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315081894000002, 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048187023000000002, 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33584 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246661+0000", 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246662+0000", 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7999999999999995e-07 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246664+0000", 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5100000000000001e-06 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246672+0000", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1780000000000003e-06 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246678+0000", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.964e-06 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294682+0000", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048003125000000001 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294757+0000", 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5686999999999995e-05 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294848+0000", 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0978999999999997e-05 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33585 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7503872~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.315055998000005, 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048296344999999997, 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33585 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.246687+0000", 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247051+0000", 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036361299999999999 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247055+0000", 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2729999999999996e-06 2024-04-23T23:39:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247066+0000", 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0929e-05 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247073+0000", 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4290000000000004e-06 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294879+0000", 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047805621999999999 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294926+0000", 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6801999999999997e-05 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.294983+0000", 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7676999999999997e-05 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33586 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7700480~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.314659066000004, 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048103688999999998, 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33586 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247084+0000", 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247085+0000", 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0500000000000004e-07 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247087+0000", 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7750000000000001e-06 2024-04-23T23:39:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247101+0000", 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3900000000000001e-05 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247107+0000", 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0009999999999998e-06 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295019+0000", 2024-04-23T23:39:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047911435000000002 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295098+0000", 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9463999999999997e-05 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295188+0000", 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9609000000000002e-05 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33587 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 7897088~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.314622740000004, 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048194807999999999, 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33587 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247120+0000", 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247475+0000", 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00035478099999999998 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247479+0000", 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9790000000000004e-06 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247491+0000", 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1527e-05 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247497+0000", 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8329999999999996e-06 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295216+0000", 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047718895999999997 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295261+0000", 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4233999999999997e-05 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295315+0000", 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4558000000000002e-05 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33588 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8093696~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.314234381999995, 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048012826000000002, 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33588 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247509+0000", 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247513+0000", 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9539999999999998e-06 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247520+0000", 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3119999999999996e-06 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247526+0000", 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2689999999999999e-06 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295351+0000", 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047825670000000001 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295430+0000", 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8583000000000003e-05 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295522+0000", 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1551999999999994e-05 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33589 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 8290304~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.607 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.314208980999993, 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048119770999999999, 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33589 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.247534+0000", 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249474+0000", 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0019397279999999999 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249479+0000", 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:39:18.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249488+0000", 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6700000000000006e-06 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249495+0000", 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6719999999999998e-06 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295551+0000", 2024-04-23T23:39:18.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046056330999999999 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295597+0000", 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5485999999999998e-05 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.295654+0000", 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7216000000000002e-05 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33598 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10125312~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.312027982999993, 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047483353999999998, 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33598 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.612 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249715+0000", 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249716+0000", 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249718+0000", 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0719999999999998e-06 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249724+0000", 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4790000000000001e-06 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249729+0000", 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0220000000000004e-06 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297030+0000", 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047300742999999999 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297107+0000", 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7282999999999999e-05 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297198+0000", 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1346000000000003e-05 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.615 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33599 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10321920~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.312007635000001, 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047613401999999999, 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33599 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.616 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249735+0000", 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249736+0000", 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:39:18.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249738+0000", 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249744+0000", 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0920000000000003e-06 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249749+0000", 2024-04-23T23:39:18.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297226+0000", 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047477116999999999 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297284+0000", 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-05 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297349+0000", 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4980999999999993e-05 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33600 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 10584064~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.311987955000006, 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047797235, 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33600 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.249755+0000", 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251471+0000", 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001716277 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251477+0000", 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251487+0000", 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251496+0000", 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1770000000000004e-06 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297380+0000", 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045883524000000002 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297456+0000", 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5933000000000006e-05 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.297552+0000", 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6630000000000001e-05 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:33610 3.11 3:8d1a3803:::rbd_data.1194fcca93b1.0000000000000001:d [read 12550144~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e48)", 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.309984498999995, 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047430894000000001, 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.624 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 33610 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251759+0000", 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:18.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251760+0000", 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3510000000000001e-06 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251764+0000", 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3960000000000002e-06 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.251767+0000", 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1240000000000001e-06 2024-04-23T23:39:18.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299023+0000", 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.04725621 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299101+0000", 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7865000000000001e-05 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:10.299189+0000", 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8573999999999996e-05 2024-04-23T23:39:18.628 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.669076488999998, 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:18.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.5528262399999999, 2024-04-23T23:39:18.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:18.634 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:18.634 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:18.634 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:18.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:18.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:18.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:18.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.645 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.645 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:18.645 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:18.645 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:18.646 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:18.647 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:18.658+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:18.747 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:18.759+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:18.818 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:18.818 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:18.818 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:18.818 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:18.829 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:18.872 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:18.885+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:18.948 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:18.961+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:18.969 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:18.969 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:18.969 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:18.970 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:18.970 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:18.981 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:39:19.072 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:19.084+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:19.151 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:19.164+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13765 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 410624~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.289982120000005, 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030402872000000001, 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13765 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910391+0000", 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910396+0000", 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910403+0000", 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3479999999999998e-06 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910408+0000", 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940640+0000", 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030231645000000001 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940724+0000", 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4308999999999995e-05 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940794+0000", 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9606999999999999e-05 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13767 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 421888~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.289947918999999, 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030508670000000002, 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13767 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910425+0000", 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910426+0000", 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910428+0000", 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910440+0000", 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.216e-05 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910446+0000", 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940831+0000", 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030384732000000001 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940877+0000", 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.596e-05 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940934+0000", 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6984999999999997e-05 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13768 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 434176~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.289914328999998, 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030634771000000002, 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13768 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910459+0000", 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0800000000000005e-07 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910462+0000", 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3760000000000002e-06 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910481+0000", 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-05 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910487+0000", 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.64e-06 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940960+0000", 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030472809999999999 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.940999+0000", 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8578000000000002e-05 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941093+0000", 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4789000000000003e-05 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13771 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 482304~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.289876793999994, 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030821340999999999, 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13771 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910496+0000", 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910497+0000", 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910500+0000", 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-06 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910507+0000", 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.754e-06 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910512+0000", 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941137+0000", 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030624404000000001 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941213+0000", 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6174999999999995e-05 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941318+0000", 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010482199999999999 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13793 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 411648~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.289853257999994, 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031026617999999999, 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13793 2024-04-23T23:39:19.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910520+0000", 2024-04-23T23:39:19.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910531+0000", 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0685e-05 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910538+0000", 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2559999999999996e-06 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.910543+0000", 2024-04-23T23:39:19.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1220000000000003e-06 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941361+0000", 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030818058999999998 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941439+0000", 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7242000000000003e-05 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.941546+0000", 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107822 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13822 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 412672~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288435655000001, 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030467531999999999, 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13822 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911937+0000", 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911938+0000", 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911940+0000", 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3819999999999998e-06 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911947+0000", 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0230000000000004e-06 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911952+0000", 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9570000000000001e-06 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942231+0000", 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030278468999999999 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942299+0000", 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8546000000000004e-05 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942405+0000", 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105728 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13824 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 423936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288413345999999, 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030682273999999999, 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.215 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13824 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:19.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911960+0000", 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911962+0000", 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911968+0000", 2024-04-23T23:39:19.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2840000000000003e-06 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.911980+0000", 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1691999999999999e-05 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942450+0000", 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030469396999999999 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942543+0000", 2024-04-23T23:39:19.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3244000000000004e-05 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942642+0000", 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9143999999999998e-05 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13826 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 436224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288245122999996, 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030744113, 2024-04-23T23:39:19.219 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13826 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912128+0000", 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912129+0000", 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912151+0000", 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2385e-05 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912160+0000", 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8650000000000007e-06 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912166+0000", 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.618e-06 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942686+0000", 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030519647 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942768+0000", 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1691000000000001e-05 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942872+0000", 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000104286 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.223 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13841 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 484352~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288196396999993, 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030872525000000001, 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13841 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912177+0000", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912180+0000", 2024-04-23T23:39:19.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6560000000000001e-06 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912187+0000", 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9110000000000004e-06 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912192+0000", 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0420000000000002e-06 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942916+0000", 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.03072414 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.942981+0000", 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5025999999999997e-05 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943049+0000", 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8163000000000005e-05 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13854 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 413696~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288101202000007, 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031001251000000001, 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13854 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.228 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912272+0000", 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:39:19.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912278+0000", 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7359999999999998e-06 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912287+0000", 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0629999999999995e-06 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912294+0000", 2024-04-23T23:39:19.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5810000000000002e-06 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943089+0000", 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030795123000000001 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943165+0000", 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6168000000000007e-05 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943273+0000", 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000107969 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13856 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 424960~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288069252, 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031139318999999999, 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.232 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13856 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912304+0000", 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912307+0000", 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912314+0000", 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:39:19.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912319+0000", 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943318+0000", 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030999183 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943376+0000", 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7574999999999997e-05 2024-04-23T23:39:19.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943443+0000", 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7380999999999997e-05 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13857 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 437248~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288046952000002, 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031347706000000003, 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.236 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13857 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912326+0000", 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912327+0000", 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8800000000000003e-07 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912336+0000", 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1300000000000007e-06 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912343+0000", 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3100000000000003e-06 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912348+0000", 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943492+0000", 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031144037999999999 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943569+0000", 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990999999999995e-05 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943674+0000", 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010440799999999999 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13861 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 485376~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:19.240 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.288016756000005, 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031493475999999999, 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13861 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912356+0000", 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912357+0000", 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912359+0000", 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.638e-06 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912366+0000", 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4760000000000003e-06 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912377+0000", 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943717+0000", 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031340668000000002 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943790+0000", 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2256999999999996e-05 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943850+0000", 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0049000000000001e-05 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13885 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 414720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.287856990999998, 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031545681999999999, 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13885 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912516+0000", 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912517+0000", 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:39:19.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912525+0000", 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5199999999999997e-06 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912535+0000", 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5100000000000004e-06 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912541+0000", 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943880+0000", 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031339288999999999 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.943952+0000", 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1191000000000003e-05 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944062+0000", 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000110092 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.248 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13887 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 427008~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.287821371999996, 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031727692000000002, 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.249 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13887 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912552+0000", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912555+0000", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912562+0000", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8820000000000003e-06 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912567+0000", 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5929999999999996e-06 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944103+0000", 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031535523000000003 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944178+0000", 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4836e-05 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944279+0000", 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010166900000000001 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13888 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 438272~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.287722091000006, 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031839834999999997, 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13888 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912651+0000", 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912652+0000", 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912655+0000", 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2210000000000002e-06 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912663+0000", 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5120000000000008e-06 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912670+0000", 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9330000000000004e-06 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944321+0000", 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031650824000000001 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944404+0000", 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2527000000000005e-05 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944491+0000", 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7162000000000003e-05 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13892 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 475136~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.287692524999997, 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032030531000000001, 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.257 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13892 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912680+0000", 2024-04-23T23:39:19.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912681+0000", 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912684+0000", 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5969999999999999e-06 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912690+0000", 2024-04-23T23:39:19.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7490000000000001e-06 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912695+0000", 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9819999999999999e-06 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944529+0000", 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031833795999999998 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944604+0000", 2024-04-23T23:39:19.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5395000000000006e-05 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944711+0000", 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010651599999999999 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:13893 3.10 3:0ebc2b78:::rbd_data.1194137ed5d1.0000000000000003:5 [read 486400~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34)", 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.287670101000003, 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032227936999999998, 2024-04-23T23:39:19.261 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 13893 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912703+0000", 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912706+0000", 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.277e-06 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912712+0000", 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.674e-06 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.912718+0000", 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3850000000000001e-06 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944745+0000", 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032027730999999997 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944833+0000", 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7655e-05 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:52.944931+0000", 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7695999999999994e-05 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.265 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77885 3.10 3:0eb7a02a:::rbd_data.1194696b8826.0000000000000004:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.657652437000003, 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032880303999999999, 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77885 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542721+0000", 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.542722+0000", 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.576e-06 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547895+0000", 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0051728360000000001 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547909+0000", 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3954999999999999e-05 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.547920+0000", 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0903e-05 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548014+0000", 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3826999999999995e-05 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548195+0000", 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000181688 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.548990+0000", 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079499300000000002 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:19.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.560810+0000", 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011819557 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575462+0000", 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014652521999999999 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575541+0000", 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8634000000000006e-05 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.575601+0000", 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9812999999999998e-05 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:120050 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e107)", 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:13.645670+0000", 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.5547028620000001, 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044824704999999999, 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.271 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 120050 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.645670+0000", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.645670+0000", 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.645671+0000", 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.879999999999999e-07 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656459+0000", 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010787622 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656497+0000", 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8269000000000002e-05 2024-04-23T23:39:19.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656506+0000", 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6549999999999993e-06 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656563+0000", 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7290000000000002e-05 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.656665+0000", 2024-04-23T23:39:19.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000102125 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 5", 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.666623+0000", 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0099580299999999997 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690271+0000", 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023647996000000001 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690405+0000", 2024-04-23T23:39:19.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00013371999999999999 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690446+0000", 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1576999999999999e-05 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:13.690495+0000", 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8433000000000002e-05 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.276 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.277 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:19.278 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:19.278 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:19.290+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:19.379 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:19.391+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:19.480 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:19.493+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:19.494 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:19.494 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:19.494 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:19.494 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:19.507 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:19.581 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:19.593+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:19.682 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:19.695+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:19.701 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:19.701 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:19.701 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:19.701 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:19.701 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:19.714 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:19.784 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:19.796+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 122.166289417, 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.884 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:39:19.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.840436408000002, 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.891 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:39:19.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:39:19.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.341463371000003, 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:39:19.897 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:39:19.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:19.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106837 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1105920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.748414385, 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043899269999999997, 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.903 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106837 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:19.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145834+0000", 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0699999999999999e-07 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145835+0000", 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0210000000000001e-06 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145837+0000", 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.847e-06 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145840+0000", 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.481e-06 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189637+0000", 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043796663 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189681+0000", 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4725999999999998e-05 2024-04-23T23:39:19.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189733+0000", 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1325000000000001e-05 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106838 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1130496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.748404996000001, 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044012456999999998, 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.907 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106838 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145844+0000", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.049e-06 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145847+0000", 2024-04-23T23:39:19.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8289999999999999e-06 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145849+0000", 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189761+0000", 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911752999999998 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189804+0000", 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2695999999999999e-05 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189855+0000", 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1431999999999998e-05 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106839 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1155072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.748395646999999, 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044114555999999999, 2024-04-23T23:39:19.911 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106839 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146080+0000", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000227486 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146083+0000", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.258e-06 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146093+0000", 2024-04-23T23:39:19.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0672999999999999e-05 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146100+0000", 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0299999999999999e-06 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189882+0000", 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043782284999999997 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189920+0000", 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8516000000000002e-05 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189967+0000", 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6307999999999998e-05 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106840 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1179648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.748138121, 2024-04-23T23:39:19.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043966107999999997, 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106840 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146117+0000", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6619999999999999e-06 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146129+0000", 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2371000000000001e-05 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146134+0000", 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2449999999999998e-06 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189992+0000", 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043858000000000001 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190030+0000", 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7755e-05 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190076+0000", 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5538999999999999e-05 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106841 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1335296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.748105392999999, 2024-04-23T23:39:19.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044044613000000003, 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106841 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146143+0000", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146145+0000", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.334e-06 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146152+0000", 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4479999999999999e-06 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146156+0000", 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7509999999999999e-06 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190099+0000", 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043942795999999999 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190140+0000", 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0813999999999999e-05 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190187+0000", 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6974999999999997e-05 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106842 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1359872~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:19.923 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.748084966, 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044137033999999999, 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106842 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147472+0000", 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0013091859999999999 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147475+0000", 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3739999999999998e-06 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.925 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147487+0000", 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1212e-05 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147494+0000", 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1459999999999999e-06 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190215+0000", 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042721228999999999 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190254+0000", 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9161e-05 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190300+0000", 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5726000000000002e-05 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106855 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2072576~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746421539, 2024-04-23T23:39:19.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043925840000000001, 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106855 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147827+0000", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147829+0000", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7010000000000001e-06 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.929 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147837+0000", 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7910000000000005e-06 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147843+0000", 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9560000000000002e-06 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191668+0000", 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043824701000000001 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191708+0000", 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0371999999999999e-05 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191752+0000", 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3792999999999999e-05 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106856 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2097152~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746397036000001, 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044011869000000002, 2024-04-23T23:39:19.931 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106856 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7599999999999997e-07 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147853+0000", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1780000000000002e-06 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147860+0000", 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5019999999999998e-06 2024-04-23T23:39:19.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147865+0000", 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191777+0000", 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911126000000002 2024-04-23T23:39:19.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191819+0000", 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1990000000000003e-05 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.937 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191863+0000", 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3995999999999997e-05 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106857 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.746375712999999, 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044095387999999999, 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106857 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147873+0000", 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.82e-07 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147874+0000", 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147881+0000", 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.392e-06 2024-04-23T23:39:19.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147886+0000", 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9389999999999996e-06 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191884+0000", 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043998430999999998 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191922+0000", 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7339000000000003e-05 2024-04-23T23:39:19.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191967+0000", 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5785000000000003e-05 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106858 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2277376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.74635559, 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044206352999999997, 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.942 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106858 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149473+0000", 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001580733 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149477+0000", 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149488+0000", 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0891e-05 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149495+0000", 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2289999999999997e-06 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191990+0000", 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042494707999999999 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192048+0000", 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7615000000000003e-05 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192098+0000", 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0915999999999998e-05 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106873 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3170304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.744415418999999, 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043985420999999997, 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.946 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106873 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149833+0000", 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999998e-07 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149834+0000", 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.15e-06 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149837+0000", 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9390000000000002e-06 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149839+0000", 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5739999999999998e-06 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193731+0000", 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043891442000000003 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193770+0000", 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9236999999999997e-05 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193818+0000", 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7839000000000001e-05 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106874 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3194880~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.744405747999998, 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044084569999999997, 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.950 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106874 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:19.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149843+0000", 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2600000000000001e-07 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149846+0000", 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.366e-06 2024-04-23T23:39:19.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149851+0000", 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999997e-06 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193842+0000", 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043991808 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193880+0000", 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7296999999999999e-05 2024-04-23T23:39:19.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193927+0000", 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6864999999999999e-05 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106875 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3219456~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.744391976999999, 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044177196000000002, 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.954 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106875 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149940+0000", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4321999999999997e-05 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149942+0000", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.26e-06 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149948+0000", 2024-04-23T23:39:19.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9190000000000004e-06 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149952+0000", 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7560000000000001e-06 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193948+0000", 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043995819999999998 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193985+0000", 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6798999999999998e-05 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194033+0000", 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999998e-05 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106876 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3244032~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.744288802, 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044183060000000003, 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.958 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106876 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151472+0000", 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001513316 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151481+0000", 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6829999999999997e-06 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151490+0000", 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8929999999999994e-06 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151496+0000", 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8690000000000001e-06 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194058+0000", 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042562068000000002 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194095+0000", 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7336000000000003e-05 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194142+0000", 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6894999999999997e-05 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106886 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3883008~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.742558500000001, 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043926192000000003, 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.962 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106886 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4600000000000001e-07 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151691+0000", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.277e-06 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151694+0000", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0599999999999999e-06 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151696+0000", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.531e-06 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195434+0000", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043737442000000001 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195516+0000", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2545000000000003e-05 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195615+0000", 2024-04-23T23:39:19.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9091000000000004e-05 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106887 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3907584~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.742548200999998, 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044058967999999997, 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106887 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-07 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151701+0000", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1310000000000001e-06 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151704+0000", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.954e-06 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151706+0000", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.571e-06 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195662+0000", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043955283999999997 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195711+0000", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8872999999999998e-05 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195758+0000", 2024-04-23T23:39:19.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7935000000000001e-05 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106888 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3932160~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 22.742538607, 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044184735000000003, 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:19.970 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106888 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153471+0000", 2024-04-23T23:39:19.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001761777 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153485+0000", 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4015999999999999e-05 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153495+0000", 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7899999999999994e-06 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153500+0000", 2024-04-23T23:39:19.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1739999999999999e-06 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195787+0000", 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042287400000000003 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195830+0000", 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2624999999999999e-05 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195894+0000", 2024-04-23T23:39:19.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3953000000000002e-05 2024-04-23T23:39:19.974 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.974 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.974 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.974 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:19.974 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:19.974 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:19.975 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:19.976 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:19.988+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:20.076 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:20.088+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:20.176 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:20.189+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171521 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156189+0000", 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046343096, 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046367314, 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171521 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156189+0000", 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156189+0000", 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156189+0000", 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7800000000000002e-07 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156191+0000", 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.875e-06 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156196+0000", 2024-04-23T23:39:20.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3630000000000002e-06 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156201+0000", 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7509999999999999e-06 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171588 3.1d 3.fb61c9bd (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.158470+0000", 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.044061707999999998, 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044150907000000003, 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.215 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171588 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158470+0000", 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158470+0000", 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158471+0000", 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6899999999999998e-07 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158473+0000", 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1710000000000001e-06 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158479+0000", 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0020000000000003e-06 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158484+0000", 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0980000000000001e-06 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171687 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.165114+0000", 2024-04-23T23:39:20.218 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.037417745000000002, 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037565813000000003, 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171687 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165114+0000", 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165114+0000", 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165115+0000", 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165117+0000", 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.973e-06 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165122+0000", 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165127+0000", 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171797 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168307+0000", 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034224692000000001, 2024-04-23T23:39:20.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034426977999999997, 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171797 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168307+0000", 2024-04-23T23:39:20.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168307+0000", 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168308+0000", 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.01e-07 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168309+0000", 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.765e-06 2024-04-23T23:39:20.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168315+0000", 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5520000000000004e-06 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168319+0000", 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4870000000000004e-06 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171897 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.224 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171976+0000", 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030556173999999998, 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030812307000000001, 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171897 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171976+0000", 2024-04-23T23:39:20.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171976+0000", 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171976+0000", 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171978+0000", 2024-04-23T23:39:20.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.781e-06 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171985+0000", 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.413e-06 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171991+0000", 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.49e-06 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.227 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172290 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191355+0000", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.01117694, 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011486573, 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172290 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191355+0000", 2024-04-23T23:39:20.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191355+0000", 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191356+0000", 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4799999999999998e-07 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191358+0000", 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.317e-06 2024-04-23T23:39:20.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191364+0000", 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191368+0000", 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7330000000000003e-06 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172391 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196429+0000", 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.006102667, 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0064673309999999998, 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172391 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196429+0000", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196429+0000", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196430+0000", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196432+0000", 2024-04-23T23:39:20.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9350000000000001e-06 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196437+0000", 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.835e-06 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196442+0000", 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8600000000000001e-06 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172458 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.233 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.200564+0000", 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0019675339999999999, 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.002385875, 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172458 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200564+0000", 2024-04-23T23:39:20.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200564+0000", 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200565+0000", 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200567+0000", 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.753e-06 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200572+0000", 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200577+0000", 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7809999999999996e-06 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171522 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.236 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156207+0000", 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046325039999999998, 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046797881999999999, 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171522 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156207+0000", 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156207+0000", 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156207+0000", 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3299999999999998e-07 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156209+0000", 2024-04-23T23:39:20.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.637e-06 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156216+0000", 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8449999999999997e-06 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156220+0000", 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5560000000000001e-06 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171623 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.158490+0000", 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.044041675000000002, 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044570543999999997, 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171623 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158490+0000", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158490+0000", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158491+0000", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158493+0000", 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0679999999999999e-06 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158499+0000", 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8039999999999998e-06 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158507+0000", 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2460000000000003e-06 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.242 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171688 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.165133+0000", 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.03739874, 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037981127000000003, 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171688 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.243 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165133+0000", 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165133+0000", 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165134+0000", 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2399999999999999e-07 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165135+0000", 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8419999999999999e-06 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165149+0000", 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3662000000000001e-05 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165155+0000", 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5509999999999999e-06 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171798 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168325+0000", 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034207122999999999, 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034843119999999998, 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171798 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168325+0000", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168325+0000", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168325+0000", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168327+0000", 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7489999999999999e-06 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168332+0000", 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4190000000000001e-06 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168337+0000", 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6160000000000004e-06 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.248 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171898 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171997+0000", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030534705999999998, 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031224432, 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171898 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171997+0000", 2024-04-23T23:39:20.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171997+0000", 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171998+0000", 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1300000000000001e-07 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172000+0000", 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172007+0000", 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172012+0000", 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7690000000000004e-06 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.251 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172291 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191379+0000", 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011152802, 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011898656000000001, 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172291 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191379+0000", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191379+0000", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191380+0000", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191382+0000", 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0420000000000001e-06 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191388+0000", 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191392+0000", 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7180000000000004e-06 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172392 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196521+0000", 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0060112639999999997, 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0068100349999999999, 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172392 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196521+0000", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196521+0000", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196521+0000", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.06e-07 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196533+0000", 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1466e-05 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196546+0000", 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3016e-05 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196552+0000", 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1670000000000004e-06 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171523 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156226+0000", 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046305520000000003, 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047157213000000003, 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171523 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156226+0000", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156226+0000", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156227+0000", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156229+0000", 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.984e-06 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156234+0000", 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4419999999999997e-06 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156239+0000", 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.578e-06 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.260 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171624 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.158516+0000", 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.044016206000000002, 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044922958999999998, 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171624 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158516+0000", 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158516+0000", 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158516+0000", 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158518+0000", 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1610000000000001e-06 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158524+0000", 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9549999999999997e-06 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158536+0000", 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1472e-05 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171689 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.165162+0000", 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.037370282999999997, 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.038338782000000002, 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171689 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165162+0000", 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165162+0000", 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165162+0000", 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165164+0000", 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9860000000000001e-06 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165170+0000", 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1330000000000004e-06 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165175+0000", 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9139999999999999e-06 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171799 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168343+0000", 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034189246999999999, 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035212669000000002, 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171799 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168343+0000", 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168343+0000", 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168343+0000", 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168353+0000", 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8179999999999999e-06 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168362+0000", 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2369999999999998e-06 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168368+0000", 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6570000000000002e-06 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171899 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.172022+0000", 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030510193000000001, 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031587439000000002, 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171899 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172022+0000", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172022+0000", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172540+0000", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00051782599999999999 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172550+0000", 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0540000000000001e-05 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172559+0000", 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0229999999999998e-06 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172565+0000", 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3249999999999996e-06 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171990 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.177913+0000", 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024618634, 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025752891, 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171990 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177913+0000", 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177913+0000", 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177914+0000", 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177917+0000", 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2219999999999998e-06 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177924+0000", 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0269999999999998e-06 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177930+0000", 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9009999999999999e-06 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172092 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181332+0000", 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.021199993, 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022388692000000002, 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172092 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181332+0000", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181332+0000", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181333+0000", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6400000000000002e-07 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181335+0000", 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3269999999999999e-06 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181581+0000", 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00024654000000000001 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181591+0000", 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4530000000000008e-06 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.278 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172292 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191398+0000", 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011133909000000001, 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.012378241, 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172292 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.279 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191398+0000", 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191398+0000", 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191398+0000", 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1800000000000002e-07 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191400+0000", 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7570000000000001e-06 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191406+0000", 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191411+0000", 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0329999999999999e-06 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.281 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172393 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196561+0000", 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.005970815, 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0072703819999999997, 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172393 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.282 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196561+0000", 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196561+0000", 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196562+0000", 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196564+0000", 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1210000000000001e-06 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196570+0000", 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0970000000000002e-06 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196575+0000", 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0640000000000001e-06 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171524 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156245+0000", 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046286987000000002, 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047637208, 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171524 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156245+0000", 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156245+0000", 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156245+0000", 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2199999999999999e-07 2024-04-23T23:39:20.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156251+0000", 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9939999999999997e-06 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156257+0000", 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9669999999999998e-06 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156262+0000", 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4730000000000002e-06 2024-04-23T23:39:20.287 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171625 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.158543+0000", 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.04398846, 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045391774000000003, 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171625 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.288 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158543+0000", 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158543+0000", 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158544+0000", 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158546+0000", 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158562+0000", 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5641000000000002e-05 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158567+0000", 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9660000000000004e-06 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.290 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171690 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.165181+0000", 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.037350802000000002, 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.038828644000000002, 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171690 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.291 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165181+0000", 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165181+0000", 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165182+0000", 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165183+0000", 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8109999999999999e-06 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165189+0000", 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5999999999999997e-06 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165194+0000", 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6260000000000003e-06 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171800 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168375+0000", 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034156686999999998, 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035702178000000001, 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171800 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168375+0000", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168375+0000", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168376+0000", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7099999999999997e-07 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168378+0000", 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1090000000000001e-06 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168383+0000", 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4319999999999998e-06 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168388+0000", 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171900 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.172577+0000", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.029954848999999999, 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031558889, 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171900 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172577+0000", 2024-04-23T23:39:20.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.172577+0000", 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173063+0000", 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00048542300000000002 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173067+0000", 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1280000000000001e-06 2024-04-23T23:39:20.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173074+0000", 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9670000000000004e-06 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173079+0000", 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7230000000000001e-06 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171991 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.299 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.177952+0000", 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024579709000000002, 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026242761, 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171991 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177952+0000", 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177952+0000", 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177953+0000", 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177955+0000", 2024-04-23T23:39:20.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.463e-06 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177962+0000", 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7680000000000003e-06 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177967+0000", 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4820000000000002e-06 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172093 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181603+0000", 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020928705999999998, 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.02265033, 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172093 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181603+0000", 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181603+0000", 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181604+0000", 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181607+0000", 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6689999999999999e-06 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181615+0000", 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6890000000000004e-06 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181621+0000", 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172293 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191416+0000", 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011115841, 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.012893280999999999, 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172293 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.306 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191416+0000", 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191416+0000", 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191416+0000", 2024-04-23T23:39:20.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4200000000000002e-07 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191418+0000", 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191424+0000", 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191428+0000", 2024-04-23T23:39:20.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6070000000000001e-06 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172394 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196581+0000", 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0059513370000000001, 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0077905600000000002, 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.309 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172394 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196581+0000", 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196581+0000", 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196581+0000", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6399999999999998e-07 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196583+0000", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7940000000000001e-06 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196588+0000", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6489999999999996e-06 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196593+0000", 2024-04-23T23:39:20.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3540000000000002e-06 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171525 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156268+0000", 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046263730000000003, 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048162851999999999, 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.312 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171525 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156268+0000", 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156268+0000", 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156269+0000", 2024-04-23T23:39:20.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156271+0000", 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0020000000000001e-06 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156276+0000", 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8590000000000001e-06 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156281+0000", 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6290000000000001e-06 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.314 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171626 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.158574+0000", 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.043957659000000003, 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045962626999999999, 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.315 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171626 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158574+0000", 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158574+0000", 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160323+0000", 2024-04-23T23:39:20.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017485090000000001 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160328+0000", 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4129999999999997e-06 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160337+0000", 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0899999999999994e-06 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160344+0000", 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:39:20.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171801 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168393+0000", 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034138792000000001, 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036199889999999998, 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171801 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168393+0000", 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168393+0000", 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168394+0000", 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168395+0000", 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.875e-06 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.169415+0000", 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010198570000000001 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.169424+0000", 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3010000000000007e-06 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171901 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.173217+0000", 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.029315171000000001, 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031433524999999997, 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.321 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171901 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173217+0000", 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173217+0000", 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173217+0000", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173221+0000", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2179999999999999e-06 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173228+0000", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3069999999999997e-06 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173234+0000", 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9399999999999999e-06 2024-04-23T23:39:20.323 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171992 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.177975+0000", 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024557303999999999, 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026729981999999999, 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171992 2024-04-23T23:39:20.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177975+0000", 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177975+0000", 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177975+0000", 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2500000000000001e-07 2024-04-23T23:39:20.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177977+0000", 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9939999999999999e-06 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177984+0000", 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7009999999999999e-06 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177989+0000", 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2959999999999998e-06 2024-04-23T23:39:20.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172094 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181629+0000", 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020903426999999999, 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023130484, 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.327 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172094 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181629+0000", 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181629+0000", 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181629+0000", 2024-04-23T23:39:20.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9999999999999998e-07 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181631+0000", 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2989999999999999e-06 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181638+0000", 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0319999999999998e-06 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181644+0000", 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2159999999999997e-06 2024-04-23T23:39:20.329 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172294 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191434+0000", 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.01109752, 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013381811, 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172294 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191434+0000", 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191434+0000", 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191435+0000", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191437+0000", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.029e-06 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191443+0000", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9519999999999999e-06 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191447+0000", 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6800000000000001e-06 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172395 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196599+0000", 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0059333340000000002, 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0082712020000000001, 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.333 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172395 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196599+0000", 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196599+0000", 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196599+0000", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5900000000000003e-07 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196601+0000", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196607+0000", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0129999999999999e-06 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196612+0000", 2024-04-23T23:39:20.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7489999999999998e-06 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171526 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156288+0000", 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046244288000000001, 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048644304999999999, 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.336 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171526 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156288+0000", 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156288+0000", 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156288+0000", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156290+0000", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9750000000000001e-06 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156296+0000", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156301+0000", 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171627 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160356+0000", 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042175949999999997, 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044630158000000003, 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171627 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160356+0000", 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160356+0000", 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160357+0000", 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2200000000000004e-07 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160359+0000", 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4559999999999999e-06 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160372+0000", 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3497e-05 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160378+0000", 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.835e-06 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171902 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.173251+0000", 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.029280621999999999, 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031794596000000001, 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.342 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171902 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173251+0000", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173251+0000", 2024-04-23T23:39:20.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173252+0000", 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173254+0000", 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3630000000000001e-06 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173260+0000", 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7629999999999997e-06 2024-04-23T23:39:20.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173265+0000", 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.198e-06 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171993 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.177996+0000", 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024535489000000001, 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027112752, 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.345 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171993 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177996+0000", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177996+0000", 2024-04-23T23:39:20.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177997+0000", 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2e-07 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.177999+0000", 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9750000000000001e-06 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178004+0000", 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5770000000000001e-06 2024-04-23T23:39:20.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178010+0000", 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2619999999999998e-06 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172095 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181650+0000", 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020881548, 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023515835999999998, 2024-04-23T23:39:20.348 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172095 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181650+0000", 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181650+0000", 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181651+0000", 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181653+0000", 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0059999999999999e-06 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181659+0000", 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2709999999999998e-06 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181664+0000", 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172195 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.185675+0000", 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0168571, 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019545112, 2024-04-23T23:39:20.351 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172195 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.185675+0000", 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.185675+0000", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186297+0000", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000622128 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186306+0000", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2539999999999998e-06 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186315+0000", 2024-04-23T23:39:20.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9469999999999992e-06 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186323+0000", 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6040000000000004e-06 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172295 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191454+0000", 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011077623, 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013833847, 2024-04-23T23:39:20.354 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172295 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191454+0000", 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191454+0000", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191455+0000", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191457+0000", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1179999999999999e-06 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191463+0000", 2024-04-23T23:39:20.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3969999999999999e-06 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191475+0000", 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1392e-05 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172396 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196618+0000", 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0059140199999999999, 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0087457130000000004, 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.357 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172396 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196618+0000", 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196618+0000", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196618+0000", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400000000000001e-07 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196621+0000", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1490000000000001e-06 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196627+0000", 2024-04-23T23:39:20.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.088e-06 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196632+0000", 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1950000000000002e-06 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171527 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.156307+0000", 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.046225120000000001, 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049133785999999999, 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.360 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171527 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156307+0000", 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156307+0000", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156307+0000", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8799999999999998e-07 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156309+0000", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0760000000000001e-06 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156314+0000", 2024-04-23T23:39:20.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9259999999999999e-06 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.156319+0000", 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3279999999999999e-06 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171628 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160386+0000", 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042145678999999998, 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045127687, 2024-04-23T23:39:20.363 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171628 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160386+0000", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160386+0000", 2024-04-23T23:39:20.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160387+0000", 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000002e-07 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160389+0000", 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3630000000000001e-06 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160395+0000", 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5879999999999997e-06 2024-04-23T23:39:20.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160400+0000", 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171903 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.173279+0000", 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.029253219, 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032293152999999998, 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.366 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171903 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173279+0000", 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173279+0000", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173279+0000", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.15e-07 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173286+0000", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1230000000000002e-06 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173292+0000", 2024-04-23T23:39:20.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173297+0000", 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1649999999999997e-06 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171994 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178016+0000", 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024516004000000001, 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027610529000000002, 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.369 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171994 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178016+0000", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178016+0000", 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178016+0000", 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178018+0000", 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.823e-06 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178024+0000", 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1129999999999997e-06 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178029+0000", 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7219999999999999e-06 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172096 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181671+0000", 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020860888000000001, 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024012136999999999, 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.372 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172096 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181671+0000", 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181671+0000", 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181672+0000", 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6300000000000005e-07 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181674+0000", 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9939999999999999e-06 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181680+0000", 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1929999999999998e-06 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181685+0000", 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1789999999999999e-06 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172196 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.186939+0000", 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.015593065999999999, 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.018799208000000001, 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.375 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172196 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186939+0000", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186939+0000", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186940+0000", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6499999999999999e-07 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186944+0000", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0690000000000003e-06 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186955+0000", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1694e-05 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186963+0000", 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3730000000000004e-06 2024-04-23T23:39:20.377 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172297 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191482+0000", 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011050307000000001, 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014309814000000001, 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172297 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191482+0000", 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191482+0000", 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191482+0000", 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.03e-07 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191484+0000", 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2220000000000001e-06 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191491+0000", 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3090000000000001e-06 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191496+0000", 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1569999999999999e-06 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172397 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196756+0000", 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0057762380000000004, 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0090945209999999995, 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.381 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172397 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196756+0000", 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196756+0000", 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196756+0000", 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7899999999999998e-07 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196760+0000", 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2569999999999999e-06 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196769+0000", 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4110000000000002e-06 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196775+0000", 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0279999999999997e-06 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171629 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160419+0000", 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042113187000000003, 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045489481999999998, 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.384 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171629 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160419+0000", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160419+0000", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160419+0000", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.08e-07 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160430+0000", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0528e-05 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160436+0000", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0310000000000004e-06 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160441+0000", 2024-04-23T23:39:20.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1719999999999998e-06 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171904 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.173304+0000", 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.029228035999999999, 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032662201000000002, 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.387 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171904 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173304+0000", 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173304+0000", 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173447+0000", 2024-04-23T23:39:20.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000142769 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173450+0000", 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5080000000000001e-06 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173457+0000", 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.173462+0000", 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5940000000000001e-06 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171995 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178035+0000", 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024497000000000001, 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027984808, 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171995 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.390 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178035+0000", 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178035+0000", 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178035+0000", 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1300000000000001e-07 2024-04-23T23:39:20.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178037+0000", 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0480000000000001e-06 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178043+0000", 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0809999999999999e-06 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178048+0000", 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7589999999999997e-06 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.392 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172097 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181749+0000", 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020782730999999999, 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024327292, 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172097 2024-04-23T23:39:20.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181749+0000", 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181749+0000", 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181750+0000", 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999995e-07 2024-04-23T23:39:20.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181753+0000", 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0010000000000002e-06 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181761+0000", 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6600000000000001e-06 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181767+0000", 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:20.395 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172197 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.186975+0000", 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.015557402999999999, 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019156408999999999, 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172197 2024-04-23T23:39:20.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186975+0000", 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186975+0000", 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186975+0000", 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186977+0000", 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4269999999999998e-06 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186985+0000", 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186990+0000", 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2630000000000003e-06 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172306 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191502+0000", 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011029485, 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014685584999999999, 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172306 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191502+0000", 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191502+0000", 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191503+0000", 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0400000000000002e-07 2024-04-23T23:39:20.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191505+0000", 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191511+0000", 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2539999999999998e-06 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191516+0000", 2024-04-23T23:39:20.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-06 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172398 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196785+0000", 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0057473330000000003, 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0094576020000000007, 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172398 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196785+0000", 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196785+0000", 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196785+0000", 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7899999999999999e-07 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196787+0000", 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.136e-06 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196794+0000", 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3289999999999999e-06 2024-04-23T23:39:20.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196798+0000", 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9370000000000003e-06 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171630 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160449+0000", 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042083376999999998, 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045852784000000001, 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.405 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171630 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160449+0000", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160449+0000", 2024-04-23T23:39:20.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160449+0000", 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160451+0000", 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4870000000000001e-06 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160457+0000", 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8540000000000002e-06 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160462+0000", 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.87e-06 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171996 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178054+0000", 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024477705999999998, 2024-04-23T23:39:20.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028303974999999999, 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171996 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178054+0000", 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178054+0000", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178055+0000", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178056+0000", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8899999999999999e-06 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178062+0000", 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3959999999999997e-06 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178067+0000", 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7809999999999996e-06 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172098 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181776+0000", 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020755932000000001, 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024639791000000001, 2024-04-23T23:39:20.411 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172098 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181776+0000", 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181776+0000", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181777+0000", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181779+0000", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1100000000000001e-06 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181785+0000", 2024-04-23T23:39:20.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7700000000000004e-06 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181791+0000", 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1599999999999997e-06 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172198 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.186997+0000", 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.015534704, 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019476838999999999, 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.414 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172198 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186997+0000", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186997+0000", 2024-04-23T23:39:20.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186998+0000", 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2199999999999999e-07 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187000+0000", 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187006+0000", 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3600000000000001e-06 2024-04-23T23:39:20.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187011+0000", 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172307 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191675+0000", 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010856687, 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.014932379000000001, 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.417 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172307 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191675+0000", 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191675+0000", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191676+0000", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191680+0000", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000003e-06 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191692+0000", 2024-04-23T23:39:20.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.15e-05 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191699+0000", 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6229999999999997e-06 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172408 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196804+0000", 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0057276790000000003, 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0098595209999999996, 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.420 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172408 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196804+0000", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196804+0000", 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196805+0000", 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196807+0000", 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.131e-06 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196813+0000", 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8810000000000001e-06 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196817+0000", 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171631 3.d 3.76ddfb6d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160475+0000", 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042056780000000002, 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046246536999999997, 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.423 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171631 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160475+0000", 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160475+0000", 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160476+0000", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160478+0000", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2479999999999999e-06 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160484+0000", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2129999999999996e-06 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160489+0000", 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7360000000000001e-06 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171998 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178073+0000", 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.024459221, 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028706939000000001, 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171998 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178073+0000", 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178073+0000", 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178073+0000", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178075+0000", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178080+0000", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.322e-06 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178084+0000", 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:39:20.428 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172099 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181797+0000", 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020734929999999999, 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025042245000000001, 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.429 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172099 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181797+0000", 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181797+0000", 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.430 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181797+0000", 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181799+0000", 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0320000000000002e-06 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181806+0000", 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3589999999999996e-06 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181812+0000", 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4139999999999999e-06 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172199 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.187018+0000", 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.015514078000000001, 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019880891000000001, 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.432 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172199 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187018+0000", 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187018+0000", 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187018+0000", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.39e-07 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187020+0000", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9439999999999999e-06 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187026+0000", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.728e-06 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187031+0000", 2024-04-23T23:39:20.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6739999999999996e-06 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172308 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191711+0000", 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010821213, 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015241815000000001, 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.435 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172308 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191711+0000", 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191711+0000", 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191711+0000", 2024-04-23T23:39:20.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1200000000000003e-07 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191723+0000", 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2102e-05 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191731+0000", 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3799999999999996e-06 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191736+0000", 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7459999999999997e-06 2024-04-23T23:39:20.437 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172409 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196891+0000", 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0056413710000000001, 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010120331, 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172409 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196891+0000", 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196891+0000", 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196891+0000", 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7800000000000001e-07 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196894+0000", 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7030000000000002e-06 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196902+0000", 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0860000000000002e-06 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196908+0000", 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171640 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160495+0000", 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042036785, 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046573245999999999, 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.441 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171640 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160495+0000", 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160495+0000", 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160496+0000", 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1399999999999997e-07 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160498+0000", 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160503+0000", 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160509+0000", 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172033 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178694+0000", 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023838206000000001, 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028432723999999999, 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.444 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172033 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178694+0000", 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178694+0000", 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178695+0000", 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1299999999999999e-07 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178714+0000", 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9772e-05 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178729+0000", 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4225e-05 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178737+0000", 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0160000000000008e-06 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172101 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181819+0000", 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020712972, 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025361859, 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172101 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181819+0000", 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181819+0000", 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181819+0000", 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181821+0000", 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181828+0000", 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5309999999999998e-06 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181833+0000", 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7520000000000004e-06 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172200 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.187036+0000", 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.015495833000000001, 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.020202705000000001, 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.450 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172200 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187036+0000", 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187036+0000", 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188837+0000", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018013949999999999 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188842+0000", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5329999999999996e-06 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188854+0000", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2085e-05 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188862+0000", 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5229999999999998e-06 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172309 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191744+0000", 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010787448999999999, 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015557382999999999, 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172309 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191744+0000", 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191744+0000", 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191753+0000", 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7350000000000002e-06 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191756+0000", 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.441e-06 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191762+0000", 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1789999999999996e-06 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191767+0000", 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1939999999999997e-06 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172410 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196916+0000", 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0056157309999999997, 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010492875, 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.456 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172410 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196916+0000", 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196916+0000", 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196917+0000", 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196919+0000", 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.153e-06 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196925+0000", 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.268e-06 2024-04-23T23:39:20.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196930+0000", 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1510000000000003e-06 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172502 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.201629+0000", 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.000903045, 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0058443410000000003, 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.459 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172502 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201629+0000", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201629+0000", 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201629+0000", 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201631+0000", 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201637+0000", 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6049999999999997e-06 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201642+0000", 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6609999999999997e-06 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171641 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160514+0000", 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.042017470000000001, 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047019591999999999, 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.462 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171641 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160514+0000", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160514+0000", 2024-04-23T23:39:20.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160515+0000", 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8599999999999999e-07 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160517+0000", 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160522+0000", 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4439999999999999e-06 2024-04-23T23:39:20.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160527+0000", 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5959999999999997e-06 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172034 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178749+0000", 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023783253000000001, 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028839224, 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.465 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172034 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178749+0000", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178749+0000", 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178749+0000", 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178752+0000", 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6929999999999999e-06 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178759+0000", 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4279999999999999e-06 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178765+0000", 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4020000000000001e-06 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172134 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181840+0000", 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020691991999999999, 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.025807949, 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.468 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172134 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181840+0000", 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181840+0000", 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181840+0000", 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181843+0000", 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181849+0000", 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.545e-06 2024-04-23T23:39:20.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181854+0000", 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7670000000000003e-06 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172201 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.188931+0000", 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.013600898, 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.018781817999999999, 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.471 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172201 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188931+0000", 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188931+0000", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188932+0000", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9800000000000003e-07 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188935+0000", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1499999999999999e-06 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188944+0000", 2024-04-23T23:39:20.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8680000000000005e-06 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188950+0000", 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2450000000000003e-06 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172310 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191775+0000", 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010757127999999999, 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015995572999999999, 2024-04-23T23:39:20.474 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172310 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191775+0000", 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191775+0000", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192023+0000", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00024847299999999998 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192027+0000", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8060000000000001e-06 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192035+0000", 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0390000000000005e-06 2024-04-23T23:39:20.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192041+0000", 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2020000000000001e-06 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172411 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196936+0000", 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0055960910000000001, 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010895474, 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.477 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172411 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196936+0000", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196936+0000", 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196936+0000", 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8299999999999997e-07 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196938+0000", 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.787e-06 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196944+0000", 2024-04-23T23:39:20.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7470000000000002e-06 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196949+0000", 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6920000000000001e-06 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172503 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.201648+0000", 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00088394999999999999, 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0062373070000000001, 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.480 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172503 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201648+0000", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201648+0000", 2024-04-23T23:39:20.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201648+0000", 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201650+0000", 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0619999999999999e-06 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201656+0000", 2024-04-23T23:39:20.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7370000000000003e-06 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201661+0000", 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6140000000000002e-06 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171642 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160533+0000", 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.041999324999999997, 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047411494999999998, 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.483 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171642 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160533+0000", 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160533+0000", 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160533+0000", 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7e-07 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160535+0000", 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9800000000000001e-06 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160544+0000", 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0799999999999995e-06 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160549+0000", 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6519999999999997e-06 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172035 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178773+0000", 2024-04-23T23:39:20.486 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023758946999999999, 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029227070000000001, 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172035 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178773+0000", 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178773+0000", 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178773+0000", 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178776+0000", 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.26e-06 2024-04-23T23:39:20.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178782+0000", 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7610000000000002e-06 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178788+0000", 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2290000000000002e-06 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172136 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181860+0000", 2024-04-23T23:39:20.489 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020672042000000002, 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026203541, 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172136 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181860+0000", 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181860+0000", 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181860+0000", 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2799999999999996e-07 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181862+0000", 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.939e-06 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181869+0000", 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181874+0000", 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1970000000000004e-06 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172202 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.188959+0000", 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.013572858, 2024-04-23T23:39:20.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019166220000000001, 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172202 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188959+0000", 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188959+0000", 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188960+0000", 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7999999999999996e-07 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188962+0000", 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.283e-06 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188969+0000", 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4669999999999998e-06 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188975+0000", 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2519999999999999e-06 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172311 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.192051+0000", 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010480629999999999, 2024-04-23T23:39:20.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016134558, 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172311 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192051+0000", 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192051+0000", 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192231+0000", 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000179378 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192234+0000", 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5480000000000002e-06 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192242+0000", 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0760000000000003e-06 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192249+0000", 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4670000000000001e-06 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172412 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196954+0000", 2024-04-23T23:39:20.498 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0055779669999999996, 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011288713000000001, 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172412 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196954+0000", 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196954+0000", 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196954+0000", 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196960+0000", 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196966+0000", 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.716e-06 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196970+0000", 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7949999999999998e-06 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172504 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.201666+0000", 2024-04-23T23:39:20.501 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00086576899999999996, 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0066355670000000002, 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172504 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201666+0000", 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201666+0000", 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201667+0000", 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201668+0000", 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8199999999999999e-06 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201674+0000", 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6380000000000001e-06 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201678+0000", 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171643 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.504 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160555+0000", 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.041977050000000002, 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047801275999999997, 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171643 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160555+0000", 2024-04-23T23:39:20.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160555+0000", 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160555+0000", 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.77e-07 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160557+0000", 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0829999999999998e-06 2024-04-23T23:39:20.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160563+0000", 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7679999999999997e-06 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160568+0000", 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4989999999999996e-06 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171734 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.165722+0000", 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.036809828000000003, 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042692323999999997, 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171734 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165722+0000", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165722+0000", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165723+0000", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165725+0000", 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.018e-06 2024-04-23T23:39:20.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165731+0000", 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0059999999999998e-06 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165736+0000", 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4009999999999996e-06 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171836 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171526+0000", 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.031005516, 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036946956000000003, 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171836 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171526+0000", 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171526+0000", 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171527+0000", 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8800000000000002e-07 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171530+0000", 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3230000000000002e-06 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171537+0000", 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4110000000000001e-06 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171542+0000", 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4879999999999998e-06 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172036 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178795+0000", 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023737227, 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029736095000000001, 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172036 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178795+0000", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178795+0000", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178795+0000", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178797+0000", 2024-04-23T23:39:20.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9810000000000002e-06 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178804+0000", 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7100000000000001e-06 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178809+0000", 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3340000000000001e-06 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.516 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172137 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.181880+0000", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020652024000000001, 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026704529000000001, 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172137 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181880+0000", 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.181880+0000", 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182378+0000", 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00049830700000000003 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182393+0000", 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4752999999999999e-05 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182404+0000", 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0886999999999999e-05 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182411+0000", 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.233e-06 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172312 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.519 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.192259+0000", 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010273354, 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016384919000000001, 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172312 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192259+0000", 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192259+0000", 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192424+0000", 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00016576199999999999 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192429+0000", 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7269999999999998e-06 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192441+0000", 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1938e-05 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192448+0000", 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3549999999999999e-06 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172413 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196977+0000", 2024-04-23T23:39:20.522 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.005554832, 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011721097, 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172413 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196977+0000", 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196977+0000", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197158+0000", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000180562 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197166+0000", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2029999999999992e-06 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197181+0000", 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5121e-05 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197188+0000", 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9450000000000004e-06 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172505 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.201684+0000", 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00084776600000000001, 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0070677719999999999, 2024-04-23T23:39:20.525 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172505 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201684+0000", 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201684+0000", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201685+0000", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201687+0000", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0439999999999998e-06 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201694+0000", 2024-04-23T23:39:20.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9269999999999999e-06 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201699+0000", 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.181e-06 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171644 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160573+0000", 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.041958635000000001, 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048239979000000002, 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.528 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171644 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160573+0000", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160573+0000", 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160574+0000", 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160576+0000", 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1009999999999999e-06 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160582+0000", 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160586+0000", 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7979999999999996e-06 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171735 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.165743+0000", 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.036789257999999998, 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043126660999999997, 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.531 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171735 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165743+0000", 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165743+0000", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165984+0000", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00024111900000000001 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165987+0000", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3390000000000001e-06 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.165995+0000", 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1440000000000003e-06 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166001+0000", 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1040000000000003e-06 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171837 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171552+0000", 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030980007, 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037376391000000002, 2024-04-23T23:39:20.534 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171837 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171552+0000", 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171552+0000", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171552+0000", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171564+0000", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1824999999999999e-05 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171573+0000", 2024-04-23T23:39:20.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1409999999999994e-06 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171579+0000", 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2739999999999998e-06 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172037 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.178816+0000", 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023716017999999998, 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030175790000000001, 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.537 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172037 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178816+0000", 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178816+0000", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178816+0000", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178818+0000", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9719999999999999e-06 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178825+0000", 2024-04-23T23:39:20.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2750000000000001e-06 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.178830+0000", 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172138 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.182442+0000", 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020089984000000002, 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.026610992, 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.540 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172138 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182442+0000", 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182442+0000", 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182442+0000", 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3300000000000002e-07 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182445+0000", 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8490000000000002e-06 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182453+0000", 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0569999999999993e-06 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182459+0000", 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7799999999999997e-06 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172313 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.543 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.192461+0000", 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.010070984, 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016657432, 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172313 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192461+0000", 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.192461+0000", 2024-04-23T23:39:20.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.194392+0000", 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001931033 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.194396+0000", 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9890000000000003e-06 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.194416+0000", 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9763e-05 2024-04-23T23:39:20.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.194425+0000", 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3219999999999999e-06 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172414 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.197205+0000", 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0053272240000000002, 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011971259999999999, 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.547 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172414 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197205+0000", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197205+0000", 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197205+0000", 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3099999999999998e-07 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197208+0000", 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6129999999999998e-06 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197215+0000", 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8499999999999996e-06 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197220+0000", 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6069999999999998e-06 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172506 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.201705+0000", 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00082672900000000001, 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00753062, 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.550 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172506 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201705+0000", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201705+0000", 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201706+0000", 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201708+0000", 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1179999999999999e-06 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201714+0000", 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9549999999999997e-06 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201719+0000", 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9189999999999998e-06 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171645 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160592+0000", 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.041939775999999998, 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048705552999999999, 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171645 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160592+0000", 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160592+0000", 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160593+0000", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5100000000000001e-07 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160594+0000", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7540000000000001e-06 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160600+0000", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3349999999999997e-06 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160604+0000", 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.51e-06 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171736 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.166010+0000", 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.036521555999999997, 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043341457, 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.556 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171736 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166010+0000", 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166010+0000", 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166011+0000", 2024-04-23T23:39:20.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166013+0000", 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166018+0000", 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7119999999999999e-06 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166023+0000", 2024-04-23T23:39:20.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2410000000000003e-06 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171838 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171586+0000", 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030945526000000001, 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037826268000000003, 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.559 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171838 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171586+0000", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171586+0000", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171587+0000", 2024-04-23T23:39:20.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7100000000000002e-07 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171589+0000", 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171595+0000", 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8510000000000004e-06 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171600+0000", 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8010000000000003e-06 2024-04-23T23:39:20.561 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172038 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179048+0000", 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023483799999999999, 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030432101, 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172038 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179048+0000", 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179048+0000", 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179049+0000", 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2900000000000003e-07 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179052+0000", 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.123e-06 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179062+0000", 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0227999999999999e-05 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179069+0000", 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6229999999999999e-06 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172139 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.182474+0000", 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.020057662, 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027064112000000001, 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172139 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182474+0000", 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182474+0000", 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182475+0000", 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1500000000000005e-07 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182477+0000", 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6800000000000002e-06 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182490+0000", 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2434e-05 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182496+0000", 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7239999999999997e-06 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172415 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.197331+0000", 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0052006500000000002, 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.012265750000000001, 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.568 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172415 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197331+0000", 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197331+0000", 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197332+0000", 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2399999999999998e-07 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197335+0000", 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.926e-06 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197343+0000", 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3359999999999995e-06 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.197349+0000", 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7309999999999998e-06 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172507 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.201725+0000", 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00080706699999999996, 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0079323810000000005, 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.571 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172507 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201725+0000", 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201725+0000", 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201725+0000", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201728+0000", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5009999999999999e-06 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201734+0000", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.201739+0000", 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9289999999999997e-06 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171646 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.160610+0000", 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.041922424999999999, 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049104336999999998, 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171646 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160610+0000", 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.160610+0000", 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162373+0000", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017635820000000001 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162378+0000", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3489999999999999e-06 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162389+0000", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0112000000000001e-05 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162403+0000", 2024-04-23T23:39:20.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4312e-05 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171737 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.166029+0000", 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.036503425999999999, 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043740225000000001, 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.577 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171737 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166029+0000", 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.166029+0000", 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167747+0000", 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001718439 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167751+0000", 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.216e-06 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167764+0000", 2024-04-23T23:39:20.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3192e-05 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167771+0000", 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4910000000000002e-06 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171839 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171606+0000", 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030926213000000001, 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.038220915000000001, 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.580 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171839 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171606+0000", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171606+0000", 2024-04-23T23:39:20.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171606+0000", 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171608+0000", 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.945e-06 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171614+0000", 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6520000000000003e-06 2024-04-23T23:39:20.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171618+0000", 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8119999999999998e-06 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172039 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179079+0000", 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023453100000000001, 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030802439000000001, 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.583 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172039 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179079+0000", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179079+0000", 2024-04-23T23:39:20.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179079+0000", 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179082+0000", 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2050000000000001e-06 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179088+0000", 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3940000000000001e-06 2024-04-23T23:39:20.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179093+0000", 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2079999999999999e-06 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172140 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.182646+0000", 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.019885448999999999, 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027295071000000001, 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.586 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172140 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182646+0000", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182646+0000", 2024-04-23T23:39:20.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182647+0000", 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182651+0000", 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6260000000000001e-06 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182661+0000", 2024-04-23T23:39:20.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.04e-05 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182668+0000", 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7020000000000004e-06 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172508 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202397+0000", 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.000135186, 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0076027100000000004, 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.589 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172508 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202397+0000", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202397+0000", 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202397+0000", 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4000000000000001e-07 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202406+0000", 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3829999999999992e-06 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202416+0000", 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.026e-05 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202422+0000", 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.251e-06 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171647 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.162417+0000", 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.040115382999999998, 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047643170999999998, 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.592 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171647 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162417+0000", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162417+0000", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162417+0000", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4300000000000003e-07 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162420+0000", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5679999999999998e-06 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162428+0000", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2819999999999996e-06 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162434+0000", 2024-04-23T23:39:20.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3169999999999998e-06 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171738 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.167783+0000", 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034749134000000001, 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042331901999999998, 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.595 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171738 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167783+0000", 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167783+0000", 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167783+0000", 2024-04-23T23:39:20.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6100000000000001e-07 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167786+0000", 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6290000000000002e-06 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167797+0000", 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0555e-05 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167802+0000", 2024-04-23T23:39:20.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6790000000000002e-06 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171840 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171624+0000", 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030907746, 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.038548210999999999, 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.598 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171840 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171624+0000", 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171624+0000", 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171625+0000", 2024-04-23T23:39:20.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171626+0000", 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8819999999999999e-06 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171632+0000", 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6679999999999998e-06 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171636+0000", 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:39:20.600 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171939 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175702+0000", 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026829579999999999, 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.034523650000000003, 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.601 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171939 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175702+0000", 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175702+0000", 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175703+0000", 2024-04-23T23:39:20.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6599999999999996e-07 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175706+0000", 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1039999999999998e-06 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175713+0000", 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6159999999999998e-06 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175718+0000", 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3870000000000003e-06 2024-04-23T23:39:20.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172041 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179100+0000", 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023432390000000001, 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031193405, 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172041 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179100+0000", 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179100+0000", 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179100+0000", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179102+0000", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.888e-06 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179108+0000", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0390000000000001e-06 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179113+0000", 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.921e-06 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172141 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.182678+0000", 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.019853942999999999, 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027670591000000001, 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172141 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182678+0000", 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.182678+0000", 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183474+0000", 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079587500000000003 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183478+0000", 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2270000000000004e-06 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183488+0000", 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0331e-05 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183495+0000", 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9240000000000001e-06 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172510 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202433+0000", 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.8657000000000001e-05, 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0079717569999999995, 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.610 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172510 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202433+0000", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202433+0000", 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202434+0000", 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202436+0000", 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999999e-06 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202444+0000", 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7500000000000003e-06 2024-04-23T23:39:20.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202449+0000", 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4879999999999998e-06 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171648 3.1d 3.c33c133d (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.162442+0000", 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.040089667000000002, 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048020933000000002, 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.613 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171648 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162442+0000", 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162442+0000", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162443+0000", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2099999999999997e-07 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162445+0000", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2019999999999998e-06 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162452+0000", 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9160000000000004e-06 2024-04-23T23:39:20.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.162457+0000", 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2820000000000004e-06 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171739 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.167810+0000", 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034721712000000002, 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042715511999999997, 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171739 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167810+0000", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167810+0000", 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167811+0000", 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6800000000000001e-07 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167813+0000", 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.368e-06 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167819+0000", 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7919999999999998e-06 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167824+0000", 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7820000000000001e-06 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171841 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171642+0000", 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030889565000000001, 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.038938878000000003, 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.619 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171841 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171642+0000", 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171642+0000", 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171643+0000", 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171645+0000", 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9080000000000002e-06 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171650+0000", 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2800000000000003e-06 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171654+0000", 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1919999999999998e-06 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171940 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175728+0000", 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026804154, 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035038227999999998, 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.622 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171940 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175728+0000", 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175728+0000", 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175728+0000", 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175739+0000", 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1156e-05 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175754+0000", 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4116e-05 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175759+0000", 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8069999999999996e-06 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172050 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179119+0000", 2024-04-23T23:39:20.625 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023413377999999999, 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.031704476000000002, 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172050 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179119+0000", 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179119+0000", 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179119+0000", 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6899999999999998e-07 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179121+0000", 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9800000000000001e-06 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179127+0000", 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9150000000000001e-06 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179132+0000", 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8099999999999997e-06 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172142 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.183520+0000", 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.019012138000000001, 2024-04-23T23:39:20.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027357739999999998, 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172142 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183520+0000", 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183520+0000", 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183520+0000", 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.68e-07 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183523+0000", 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9490000000000001e-06 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183531+0000", 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5050000000000001e-06 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183537+0000", 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.925e-06 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172544 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.631 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202457+0000", 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 7.4783000000000006e-05, 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0084781240000000001, 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172544 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202457+0000", 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202457+0000", 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202458+0000", 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999999e-07 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202460+0000", 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2359999999999999e-06 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202471+0000", 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0589e-05 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202476+0000", 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1250000000000001e-06 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.634 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171740 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.167832+0000", 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034700415999999998, 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043158384000000001, 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171740 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167832+0000", 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167832+0000", 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167832+0000", 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999998e-07 2024-04-23T23:39:20.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167834+0000", 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.035e-06 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167840+0000", 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167844+0000", 2024-04-23T23:39:20.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6770000000000003e-06 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171842 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171678+0000", 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030854097, 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.039381281999999997, 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171842 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171678+0000", 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171678+0000", 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171678+0000", 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171681+0000", 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.266e-06 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171687+0000", 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0440000000000001e-06 2024-04-23T23:39:20.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171691+0000", 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171941 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175768+0000", 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026764125999999999, 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035353877999999998, 2024-04-23T23:39:20.641 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171941 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175768+0000", 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175768+0000", 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175768+0000", 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175771+0000", 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.712e-06 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175777+0000", 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8089999999999998e-06 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175782+0000", 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8450000000000002e-06 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172051 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179137+0000", 2024-04-23T23:39:20.644 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023394452999999999, 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032043065000000003, 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172051 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179137+0000", 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179137+0000", 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179138+0000", 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179140+0000", 2024-04-23T23:39:20.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.844e-06 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179145+0000", 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4e-06 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179150+0000", 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4750000000000004e-06 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172152 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.183545+0000", 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018987055999999999, 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.027690058, 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172152 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183545+0000", 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183545+0000", 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183545+0000", 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7599999999999997e-07 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183548+0000", 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1799999999999999e-06 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183554+0000", 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8310000000000003e-06 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183560+0000", 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.22e-06 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.650 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172545 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202482+0000", 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.9883000000000003e-05, 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0088110529999999992, 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172545 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.651 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202482+0000", 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202482+0000", 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202482+0000", 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:20.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202484+0000", 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9810000000000002e-06 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202490+0000", 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5130000000000004e-06 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202494+0000", 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0940000000000001e-06 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171741 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.167851+0000", 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034681343000000003, 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043509816999999999, 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171741 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.654 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167851+0000", 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167851+0000", 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167851+0000", 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:20.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167853+0000", 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2299999999999998e-06 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167859+0000", 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5450000000000003e-06 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167863+0000", 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.656 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171843 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171698+0000", 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030833626999999999, 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.039721434, 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171843 2024-04-23T23:39:20.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171698+0000", 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171698+0000", 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171699+0000", 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3200000000000001e-07 2024-04-23T23:39:20.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171701+0000", 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8679999999999999e-06 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171706+0000", 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5979999999999996e-06 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171711+0000", 2024-04-23T23:39:20.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6419999999999998e-06 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171942 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175788+0000", 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026743697, 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.035690679000000003, 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.660 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171942 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175788+0000", 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175788+0000", 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175789+0000", 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:20.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175791+0000", 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.906e-06 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175796+0000", 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6439999999999997e-06 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175800+0000", 2024-04-23T23:39:20.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.172e-06 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172052 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179156+0000", 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023375803000000001, 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032380333999999997, 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.663 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172052 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179156+0000", 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179156+0000", 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179157+0000", 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179158+0000", 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9400000000000001e-06 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179165+0000", 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4420000000000003e-06 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179170+0000", 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7380000000000002e-06 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172153 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.183567+0000", 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018965433, 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028034502999999999, 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.666 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172153 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183567+0000", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183567+0000", 2024-04-23T23:39:20.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183567+0000", 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183569+0000", 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0789999999999999e-06 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183575+0000", 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4479999999999999e-06 2024-04-23T23:39:20.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183581+0000", 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1749999999999996e-06 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172546 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202499+0000", 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.2795e-05, 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.009158345, 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.669 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172546 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202499+0000", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202499+0000", 2024-04-23T23:39:20.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202500+0000", 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.27e-07 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202501+0000", 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202507+0000", 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1940000000000003e-06 2024-04-23T23:39:20.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202512+0000", 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.301e-06 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171777 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.167870+0000", 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034662341999999999, 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043841590999999999, 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.672 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171777 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167870+0000", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167870+0000", 2024-04-23T23:39:20.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167870+0000", 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167872+0000", 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3599999999999999e-06 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167878+0000", 2024-04-23T23:39:20.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8019999999999997e-06 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167883+0000", 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9060000000000001e-06 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171845 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171717+0000", 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030814856000000002, 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.040056122999999999, 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.675 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171845 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171717+0000", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171717+0000", 2024-04-23T23:39:20.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171717+0000", 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7800000000000002e-07 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171720+0000", 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2290000000000002e-06 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171725+0000", 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8069999999999996e-06 2024-04-23T23:39:20.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171730+0000", 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6249999999999998e-06 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171943 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175807+0000", 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026725189999999999, 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036019688000000001, 2024-04-23T23:39:20.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171943 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175807+0000", 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175807+0000", 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175807+0000", 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175810+0000", 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.446e-06 2024-04-23T23:39:20.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175815+0000", 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6969999999999998e-06 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175820+0000", 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7360000000000001e-06 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172053 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.681 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179176+0000", 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023356058999999998, 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.032709502000000001, 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172053 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179176+0000", 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179176+0000", 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179176+0000", 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179179+0000", 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999999e-06 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179185+0000", 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4999999999999996e-06 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179190+0000", 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.045e-06 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172154 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.183587+0000", 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018945087999999999, 2024-04-23T23:39:20.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028354535, 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172154 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183587+0000", 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183587+0000", 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183587+0000", 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.84e-07 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183589+0000", 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2500000000000001e-06 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183596+0000", 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0719999999999996e-06 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183601+0000", 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0250000000000002e-06 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172547 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202716+0000", 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9998159, 2024-04-23T23:39:20.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0092811149999999995, 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172547 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202716+0000", 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202716+0000", 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202716+0000", 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2900000000000003e-07 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202720+0000", 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.394e-06 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202728+0000", 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8089999999999993e-06 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202734+0000", 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1120000000000001e-06 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171778 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.167889+0000", 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034642961999999999, 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044172265000000002, 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171778 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167889+0000", 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167889+0000", 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167889+0000", 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167900+0000", 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1085e-05 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167908+0000", 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7610000000000007e-06 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.167913+0000", 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171879 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171736+0000", 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030796039000000001, 2024-04-23T23:39:20.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.040378623000000002, 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171879 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171736+0000", 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171736+0000", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171736+0000", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171738+0000", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0480000000000001e-06 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171744+0000", 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5799999999999999e-06 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171749+0000", 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6380000000000003e-06 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171944 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175826+0000", 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026705626, 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036344475000000001, 2024-04-23T23:39:20.696 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171944 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175826+0000", 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175826+0000", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175827+0000", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175829+0000", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.922e-06 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175834+0000", 2024-04-23T23:39:20.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5770000000000001e-06 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175839+0000", 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2789999999999998e-06 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172054 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179202+0000", 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.023330152999999999, 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033025098000000003, 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172054 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179202+0000", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179202+0000", 2024-04-23T23:39:20.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179202+0000", 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179204+0000", 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2900000000000001e-06 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179211+0000", 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3799999999999999e-06 2024-04-23T23:39:20.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179216+0000", 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9490000000000004e-06 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172155 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.183607+0000", 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018924933000000001, 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.028686028999999998, 2024-04-23T23:39:20.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172155 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183607+0000", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183607+0000", 2024-04-23T23:39:20.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183817+0000", 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000210309 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183822+0000", 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9150000000000004e-06 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183833+0000", 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0343000000000001e-05 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183839+0000", 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6089999999999997e-06 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172246 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.189338+0000", 2024-04-23T23:39:20.705 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.013193783000000001, 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023040069, 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172246 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.189338+0000", 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.189338+0000", 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191088+0000", 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001749738 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191093+0000", 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999997e-06 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191105+0000", 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2293000000000001e-05 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191120+0000", 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4902999999999999e-05 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172548 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202741+0000", 2024-04-23T23:39:20.708 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9997907, 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0097447260000000004, 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172548 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202741+0000", 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202741+0000", 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202742+0000", 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202744+0000", 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.995e-06 2024-04-23T23:39:20.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202750+0000", 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1550000000000004e-06 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202755+0000", 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9830000000000004e-06 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171779 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168085+0000", 2024-04-23T23:39:20.711 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034446665000000001, 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044519087999999998, 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171779 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168085+0000", 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168085+0000", 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168086+0000", 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0299999999999999e-07 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168089+0000", 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.377e-06 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168102+0000", 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2614e-05 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168108+0000", 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4919999999999998e-06 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171880 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.714 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171754+0000", 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030777493, 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.040947168999999999, 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171880 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171754+0000", 2024-04-23T23:39:20.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171754+0000", 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171755+0000", 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3499999999999996e-07 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171757+0000", 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8369999999999999e-06 2024-04-23T23:39:20.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171762+0000", 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6840000000000001e-06 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171767+0000", 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7090000000000001e-06 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171945 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175846+0000", 2024-04-23T23:39:20.717 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0266863, 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.036930494000000001, 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171945 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175846+0000", 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175846+0000", 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175846+0000", 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4200000000000002e-07 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175848+0000", 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9719999999999999e-06 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175853+0000", 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3279999999999996e-06 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175858+0000", 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8770000000000001e-06 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172055 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.720 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179783+0000", 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.022749387999999999, 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033062969999999997, 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172055 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179783+0000", 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179783+0000", 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179783+0000", 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4300000000000003e-07 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179786+0000", 2024-04-23T23:39:20.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2389999999999998e-06 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179797+0000", 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0209e-05 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179803+0000", 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7100000000000001e-06 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172156 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.183851+0000", 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018681212999999999, 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029048358, 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172156 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183851+0000", 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.183851+0000", 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184312+0000", 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000461228 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184317+0000", 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6419999999999998e-06 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184327+0000", 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0647e-05 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184334+0000", 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9310000000000002e-06 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.726 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172247 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191133+0000", 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011398894999999999, 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021822000000000001, 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172247 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191133+0000", 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191133+0000", 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191134+0000", 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6700000000000003e-07 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191136+0000", 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7520000000000001e-06 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191144+0000", 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4699999999999996e-06 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191149+0000", 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4009999999999996e-06 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172348 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.195746+0000", 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0067857890000000004, 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017264170999999998, 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172348 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195746+0000", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195746+0000", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195747+0000", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195749+0000", 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195756+0000", 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195761+0000", 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3380000000000004e-06 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172549 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202761+0000", 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9997711, 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010317756000000001, 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172549 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202761+0000", 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202761+0000", 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202761+0000", 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:20.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202763+0000", 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202769+0000", 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9710000000000001e-06 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202774+0000", 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9799999999999998e-06 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171780 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168119+0000", 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034413332999999997, 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045035191000000002, 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171780 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168119+0000", 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168119+0000", 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168119+0000", 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168122+0000", 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.588e-06 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168128+0000", 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5030000000000002e-06 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168134+0000", 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171881 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171773+0000", 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.03075926, 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.041434430000000001, 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171881 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171773+0000", 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171773+0000", 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171773+0000", 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171775+0000", 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.826e-06 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171780+0000", 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3090000000000003e-06 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171785+0000", 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5299999999999998e-06 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.741 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171946 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.175864+0000", 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.026668137000000001, 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.037400825999999998, 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171946 2024-04-23T23:39:20.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175864+0000", 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175864+0000", 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175864+0000", 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:20.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175866+0000", 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.86e-06 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175872+0000", 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.626e-06 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.175876+0000", 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6029999999999998e-06 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.744 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172056 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179814+0000", 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.022718410000000001, 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033513432000000003, 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.745 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172056 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179814+0000", 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179814+0000", 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179814+0000", 2024-04-23T23:39:20.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179816+0000", 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1890000000000001e-06 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179823+0000", 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6229999999999999e-06 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179828+0000", 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172157 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.184346+0000", 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018186193999999999, 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029044418999999998, 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172157 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184346+0000", 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184346+0000", 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184346+0000", 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2699999999999999e-07 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184349+0000", 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184355+0000", 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6209999999999998e-06 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184360+0000", 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172248 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191166+0000", 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011366004000000001, 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022277506999999998, 2024-04-23T23:39:20.751 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172248 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191166+0000", 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191166+0000", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191167+0000", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2799999999999996e-07 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191169+0000", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5610000000000001e-06 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191176+0000", 2024-04-23T23:39:20.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7689999999999999e-06 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191181+0000", 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3859999999999998e-06 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172349 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.195768+0000", 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0067642589999999999, 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.017743307, 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.754 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172349 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195768+0000", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195768+0000", 2024-04-23T23:39:20.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195768+0000", 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195770+0000", 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.075e-06 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195777+0000", 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3539999999999996e-06 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195782+0000", 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2050000000000001e-06 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172550 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202779+0000", 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9997525, 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010788169, 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172550 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202779+0000", 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202779+0000", 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202780+0000", 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.41e-07 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202781+0000", 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.829e-06 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202787+0000", 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202794+0000", 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4640000000000003e-06 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171781 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168141+0000", 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034391048, 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045487316999999999, 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.760 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171781 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168141+0000", 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168141+0000", 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168141+0000", 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168144+0000", 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.21e-06 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168149+0000", 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7590000000000003e-06 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168154+0000", 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5639999999999998e-06 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171882 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171791+0000", 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030741337000000001, 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.041898097000000002, 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.763 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171882 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171791+0000", 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171791+0000", 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171791+0000", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171793+0000", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9230000000000001e-06 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171798+0000", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.451e-06 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171803+0000", 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8500000000000002e-06 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172057 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.179834+0000", 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.022697716999999999, 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.033932915000000001, 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172057 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179834+0000", 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179834+0000", 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179835+0000", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179837+0000", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.995e-06 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179843+0000", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1700000000000002e-06 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.179848+0000", 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.916e-06 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172158 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.184368+0000", 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018163697999999999, 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029463508999999999, 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172158 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184368+0000", 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184368+0000", 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184369+0000", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.51e-07 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184381+0000", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2598e-05 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184388+0000", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1389999999999998e-06 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184395+0000", 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1850000000000001e-06 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172249 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191187+0000", 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011344695, 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.022708823, 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.772 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172249 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191187+0000", 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191187+0000", 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191188+0000", 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191190+0000", 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9319999999999999e-06 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191197+0000", 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191202+0000", 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1279999999999999e-06 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172350 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.195788+0000", 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0067436960000000004, 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.018169423000000001, 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.775 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172350 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195788+0000", 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195788+0000", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195789+0000", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3300000000000003e-07 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195791+0000", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0250000000000001e-06 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195797+0000", 2024-04-23T23:39:20.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9619999999999998e-06 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195802+0000", 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8980000000000004e-06 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172451 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.198928+0000", 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0036041580000000001, 2024-04-23T23:39:20.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015087774, 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172451 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198928+0000", 2024-04-23T23:39:20.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198928+0000", 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198928+0000", 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7299999999999995e-07 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198931+0000", 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8100000000000002e-06 2024-04-23T23:39:20.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198941+0000", 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7340000000000003e-06 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198947+0000", 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5709999999999997e-06 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172551 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202799+0000", 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9997325, 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011270616000000001, 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172551 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202799+0000", 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202799+0000", 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202800+0000", 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202802+0000", 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8920000000000001e-06 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202817+0000", 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5404e-05 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202823+0000", 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9819999999999996e-06 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171782 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168165+0000", 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034366709000000002, 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.045965751999999999, 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171782 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168165+0000", 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168165+0000", 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168166+0000", 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168168+0000", 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.154e-06 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168173+0000", 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5400000000000003e-06 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168178+0000", 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5349999999999998e-06 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.787 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171883 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171809+0000", 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030723311, 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042382878999999998, 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171883 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.788 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171809+0000", 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171809+0000", 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171809+0000", 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7e-07 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171816+0000", 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5400000000000001e-06 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171822+0000", 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9789999999999998e-06 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171827+0000", 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-06 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.790 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172159 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.184403+0000", 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.018129368999999999, 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.029843451, 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172159 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184403+0000", 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184403+0000", 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184557+0000", 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015444100000000001 2024-04-23T23:39:20.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184561+0000", 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1749999999999998e-06 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184571+0000", 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6889999999999999e-06 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184577+0000", 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3720000000000001e-06 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.793 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172250 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191207+0000", 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011324829999999999, 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023100275999999999, 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172250 2024-04-23T23:39:20.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191207+0000", 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191207+0000", 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191207+0000", 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9299999999999999e-07 2024-04-23T23:39:20.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191209+0000", 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.841e-06 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191215+0000", 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191220+0000", 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8400000000000002e-06 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172351 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.195808+0000", 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0067237299999999998, 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.018553329, 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172351 2024-04-23T23:39:20.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195808+0000", 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195808+0000", 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195809+0000", 2024-04-23T23:39:20.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195811+0000", 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0710000000000002e-06 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195821+0000", 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0434999999999999e-05 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195826+0000", 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2000000000000002e-06 2024-04-23T23:39:20.799 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172452 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.198955+0000", 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0035774320000000002, 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015463314000000001, 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172452 2024-04-23T23:39:20.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198955+0000", 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198955+0000", 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198955+0000", 2024-04-23T23:39:20.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7999999999999996e-07 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198957+0000", 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3029999999999998e-06 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198964+0000", 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4509999999999997e-06 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198969+0000", 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9099999999999996e-06 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172552 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202830+0000", 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9997025, 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.01166234, 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.803 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172552 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202830+0000", 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202830+0000", 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202956+0000", 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000126193 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202974+0000", 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8241e-05 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202982+0000", 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1159999999999999e-06 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202989+0000", 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171783 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.806 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168192+0000", 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034339982999999998, 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046367419, 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171783 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168192+0000", 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168192+0000", 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168192+0000", 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.15e-07 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168195+0000", 2024-04-23T23:39:20.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3489999999999999e-06 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168206+0000", 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0886e-05 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168211+0000", 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.809 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171884 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171865+0000", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030666868999999999, 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042749903999999998, 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171884 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171865+0000", 2024-04-23T23:39:20.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171865+0000", 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171865+0000", 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171868+0000", 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1849999999999998e-06 2024-04-23T23:39:20.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171876+0000", 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9610000000000005e-06 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171881+0000", 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172160 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.184588+0000", 2024-04-23T23:39:20.812 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.017943668999999999, 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.030085337, 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172160 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184588+0000", 2024-04-23T23:39:20.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184588+0000", 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184685+0000", 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7183999999999997e-05 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184690+0000", 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0770000000000001e-06 2024-04-23T23:39:20.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184699+0000", 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0729999999999994e-06 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.184705+0000", 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3489999999999997e-06 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172251 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.815 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191226+0000", 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011306428, 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023502540999999998, 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172251 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191226+0000", 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191226+0000", 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191226+0000", 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191228+0000", 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191233+0000", 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4890000000000003e-06 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191238+0000", 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.668e-06 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172352 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.818 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.195834+0000", 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0066978680000000001, 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.018958338000000002, 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172352 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195834+0000", 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195834+0000", 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195835+0000", 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195837+0000", 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4219999999999999e-06 2024-04-23T23:39:20.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195843+0000", 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.285e-06 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195848+0000", 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8500000000000002e-06 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172453 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.821 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.198975+0000", 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0035570689999999999, 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015874071999999999, 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172453 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198975+0000", 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198975+0000", 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198975+0000", 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198978+0000", 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2479999999999999e-06 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198985+0000", 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1380000000000001e-06 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198990+0000", 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999996e-06 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172561 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.202997+0000", 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9995346, 2024-04-23T23:39:20.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011910975000000001, 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172561 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202997+0000", 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202997+0000", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.202998+0000", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9900000000000001e-07 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203000+0000", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0870000000000001e-06 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203006+0000", 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0249999999999999e-06 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203011+0000", 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0409999999999997e-06 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171784 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168225+0000", 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034306693999999999, 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.046738725000000002, 2024-04-23T23:39:20.827 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171784 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168225+0000", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168225+0000", 2024-04-23T23:39:20.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168226+0000", 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7399999999999998e-07 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168228+0000", 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3269999999999999e-06 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168234+0000", 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:39:20.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168239+0000", 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2120000000000002e-06 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171885 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171890+0000", 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030642184999999999, 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043141392000000001, 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.830 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171885 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171890+0000", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171890+0000", 2024-04-23T23:39:20.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171890+0000", 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171892+0000", 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1110000000000002e-06 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171900+0000", 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.571e-06 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171906+0000", 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8510000000000004e-06 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172252 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191244+0000", 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011287648000000001, 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.023842546999999999, 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.833 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172252 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191244+0000", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191244+0000", 2024-04-23T23:39:20.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191245+0000", 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191247+0000", 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0250000000000001e-06 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191253+0000", 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8459999999999996e-06 2024-04-23T23:39:20.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191257+0000", 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7729999999999999e-06 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172353 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.195861+0000", 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0066710220000000004, 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019280506999999999, 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172353 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195861+0000", 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195861+0000", 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195861+0000", 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5000000000000003e-07 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195864+0000", 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1289999999999999e-06 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195870+0000", 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7519999999999999e-06 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.195876+0000", 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2830000000000001e-06 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172454 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.198997+0000", 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0035351710000000001, 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016204987000000001, 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.839 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172454 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198997+0000", 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198997+0000", 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198997+0000", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6400000000000002e-07 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.198999+0000", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0200000000000001e-06 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.199005+0000", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0399999999999998e-06 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.199010+0000", 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.904e-06 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172562 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.203024+0000", 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9995084, 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.012243436999999999, 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.842 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172562 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203024+0000", 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203024+0000", 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203847+0000", 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00082376900000000002 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203860+0000", 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2132e-05 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203871+0000", 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1559999999999999e-05 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203878+0000", 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3660000000000003e-06 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171794 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168251+0000", 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034281363000000002, 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047077960000000002, 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.845 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171794 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168251+0000", 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168251+0000", 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168251+0000", 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168253+0000", 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0669999999999999e-06 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168259+0000", 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0129999999999999e-06 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168264+0000", 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0300000000000001e-06 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171886 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171913+0000", 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030618480999999999, 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043469673, 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.848 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171886 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171913+0000", 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171913+0000", 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171914+0000", 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171916+0000", 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9250000000000002e-06 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171922+0000", 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3999999999999997e-06 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171927+0000", 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172253 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191264+0000", 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011267750999999999, 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024176071, 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.851 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172253 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191264+0000", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191264+0000", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191265+0000", 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191273+0000", 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3699999999999995e-06 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191287+0000", 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3818999999999999e-05 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191292+0000", 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172354 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196360+0000", 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0061721429999999997, 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019146719999999999, 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.854 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172354 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196360+0000", 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196360+0000", 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196360+0000", 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-07 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196364+0000", 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196374+0000", 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0261999999999999e-05 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196381+0000", 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6220000000000003e-06 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172455 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.199016+0000", 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.003516187, 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.016549891000000001, 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.857 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172455 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.199016+0000", 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.199016+0000", 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200478+0000", 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001462281 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200482+0000", 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1570000000000002e-06 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200494+0000", 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1524e-05 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200501+0000", 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4309999999999997e-06 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172563 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.203888+0000", 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9986444, 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.011734034000000001, 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172563 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203888+0000", 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203888+0000", 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203888+0000", 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6300000000000005e-07 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203890+0000", 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2050000000000001e-06 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203897+0000", 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2530000000000001e-06 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203902+0000", 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4079999999999997e-06 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171795 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168270+0000", 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034261741999999998, 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047410974000000002, 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.863 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171795 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168270+0000", 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168270+0000", 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168271+0000", 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168273+0000", 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9410000000000001e-06 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168278+0000", 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7169999999999996e-06 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168283+0000", 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4510000000000002e-06 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171887 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171933+0000", 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030598469999999999, 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043804293000000001, 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.866 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171887 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171933+0000", 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171933+0000", 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171934+0000", 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5600000000000001e-07 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171936+0000", 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.829e-06 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171943+0000", 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6709999999999999e-06 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171948+0000", 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1440000000000002e-06 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172288 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191300+0000", 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011231758, 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024495454999999999, 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172288 2024-04-23T23:39:20.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191300+0000", 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191300+0000", 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191301+0000", 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9699999999999996e-07 2024-04-23T23:39:20.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191303+0000", 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4930000000000001e-06 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191310+0000", 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7449999999999998e-06 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191315+0000", 2024-04-23T23:39:20.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1800000000000004e-06 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172355 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196390+0000", 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0061418439999999996, 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.019460635, 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172355 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196390+0000", 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196390+0000", 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196391+0000", 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196393+0000", 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196399+0000", 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2999999999999998e-06 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196404+0000", 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.31e-06 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172456 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.200522+0000", 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0020102430000000001, 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015396151, 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172456 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200522+0000", 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200522+0000", 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200522+0000", 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4600000000000005e-07 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200525+0000", 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.632e-06 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200532+0000", 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2049999999999996e-06 2024-04-23T23:39:20.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200537+0000", 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3129999999999998e-06 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172564 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.203908+0000", 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9986238, 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.012066062000000001, 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.879 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172564 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203908+0000", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203908+0000", 2024-04-23T23:39:20.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203909+0000", 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203911+0000", 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9089999999999998e-06 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203916+0000", 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9900000000000002e-06 2024-04-23T23:39:20.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203921+0000", 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171796 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.168288+0000", 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.034243494999999999, 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047746869999999997, 2024-04-23T23:39:20.882 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171796 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168288+0000", 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168288+0000", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168289+0000", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168291+0000", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9069999999999999e-06 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168297+0000", 2024-04-23T23:39:20.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8440000000000003e-06 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.168302+0000", 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8489999999999997e-06 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171896 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.171955+0000", 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.030577126999999999, 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044136764000000002, 2024-04-23T23:39:20.885 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171896 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171955+0000", 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171955+0000", 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171955+0000", 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.15e-07 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171957+0000", 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0200000000000001e-06 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171965+0000", 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2710000000000003e-06 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.171970+0000", 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.888 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172289 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.191322+0000", 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.011210402, 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.024825231999999999, 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172289 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191322+0000", 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191322+0000", 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191322+0000", 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191335+0000", 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.278e-05 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191342+0000", 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.272e-06 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.191347+0000", 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4160000000000003e-06 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172356 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.196410+0000", 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0061217709999999998, 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.01979353, 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172356 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196410+0000", 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196410+0000", 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196411+0000", 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6899999999999998e-07 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196412+0000", 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.826e-06 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196418+0000", 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8850000000000004e-06 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.196423+0000", 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9690000000000002e-06 2024-04-23T23:39:20.894 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172457 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.200545+0000", 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0019868920000000001, 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.015713037999999999, 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172457 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.895 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200545+0000", 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200545+0000", 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200545+0000", 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200548+0000", 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1289999999999999e-06 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200554+0000", 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1519999999999997e-06 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200559+0000", 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-06 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172565 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.203927+0000", 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4294967295.9986053, 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.012391651, 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172565 2024-04-23T23:39:20.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203927+0000", 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203927+0000", 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203927+0000", 2024-04-23T23:39:20.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203929+0000", 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8059999999999999e-06 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203935+0000", 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8000000000000004e-06 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.203939+0000", 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8539999999999996e-06 2024-04-23T23:39:20.900 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.901 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:20.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:20.901 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:39:20.901 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 227 2024-04-23T23:39:20.901 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:20.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:20.903 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:20.903 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:20.915+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:21.004 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:21.015+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:21.027 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:21.027 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:21.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:39:21.048 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:21.048 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:21.070 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:21.070 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:21.095 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:21.095 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:21.103 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:21.116+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:21.104 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:21.104 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:21.104 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:21.104 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:21.104 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:21.114 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:21.115 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:21.117 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:21.138 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:21.138 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:21.161 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:21.161 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:21.166 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:21.167 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:21.204 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:21.216+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:21.304 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:21.304 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:21.305 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:21.317+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:21.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:21.405 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:21.417+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:21.434 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:21.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:21.505 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:21.518+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:21.557 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:21.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:21.612 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:21.624+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:21.678 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:21.678 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:21.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:21.707 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:21.719+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:21.809 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:21.820+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:21.837 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:21.846 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:21.908 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:21.920+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:21.950 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:21.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:22.009 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:22.022+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:22.033 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:39:22.109 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:22.122+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:22.112 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:22.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:22.210 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:22.222+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:22.231 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:22.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:22.311 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:22.324+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:22.385 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:22.394 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:22.438 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:22.450+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:22.498 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:22.507 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:22.551 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:22.564+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:22.613 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:22.625+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:22.661 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:22.661 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:22.672 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:22.715 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:22.727+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:22.816 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:22.828+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:22.887 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:22.887 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:22.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:22.916 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:22.928+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:23.017 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:23.030+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:23.022 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4] out_osds: [3, 0, 7] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:23.022 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:23.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:39:23.117 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:23.117 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:23.123 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:23.130+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:23.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:23.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:23.219 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:23.232+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:23.300 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:23.300 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:23.319 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:23.332+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:23.320 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:23.320 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:23.330 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:23.330 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:23.337 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:23.337 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:23.339 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:23.355 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:23.355 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:23.359 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:23.360 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:39:23.365 INFO:teuthology.orchestra.run.smithi077.stdout:5467 write 0x7e082bb thru 0x7e0de19 (0x5b5f bytes) 2024-04-23T23:39:23.373 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2024-04-23T23:39:22.223067+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1888363785,"num_objects":2689,"num_object_clones":359,"num_object_copies":5378,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2689,"num_whiteouts":1438,"num_read":195765,"num_read_kb":995473,"num_write":18991,"num_write_kb":611012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5670,"num_bytes_recovered":324594835,"num_keys_recovered":853,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16003,"ondisk_log_size":16003,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":5,"num_per_pool_osds":5,"num_per_pool_omap_osds":5,"kb":471859200,"kb_used":733112,"kb_used_data":501168,"kb_used_omap":10,"kb_used_meta":231861,"kb_avail":471126088,"statfs":{"total":483183820800,"available":482433114112,"internally_reserved":0,"allocated":513196032,"data_stored":629994042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10877,"internal_metadata":237426051},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":63655735,"num_objects":132,"num_object_clones":24,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":49,"num_read":42269,"num_read_kb":53813,"num_write":668,"num_write_kb":25581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000950"},"pg_stats":[{"pgid":"3.1f","version":"109'541","reported_seq":4089,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:17.248081+0000","last_change":"2024-04-23T23:38:44.815145+0000","last_active":"2024-04-23T23:39:17.248081+0000","last_peered":"2024-04-23T23:39:17.248081+0000","last_clean":"2024-04-23T23:39:17.248081+0000","last_became_active":"2024-04-23T23:38:44.813152+0000","last_became_peered":"2024-04-23T23:38:44.813152+0000","last_unstale":"2024-04-23T23:39:17.248081+0000","last_undegraded":"2024-04-23T23:39:17.248081+0000","last_fullsized":"2024-04-23T23:39:17.248081+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":541,"log_dups_size":0,"ondisk_log_size":541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:30:42.113527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036166670000000001,"stat_sum":{"num_bytes":38797175,"num_objects":79,"num_object_clones":7,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":45,"num_read":5301,"num_read_kb":17304,"num_write":611,"num_write_kb":4737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":3224152,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"111'395","reported_seq":3341,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.035485+0000","last_change":"2024-04-23T23:38:29.052716+0000","last_active":"2024-04-23T23:39:19.035485+0000","last_peered":"2024-04-23T23:39:19.035485+0000","last_clean":"2024-04-23T23:39:19.035485+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:39:19.035485+0000","last_undegraded":"2024-04-23T23:39:19.035485+0000","last_fullsized":"2024-04-23T23:39:19.035485+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:43:02.617077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061879000000000003,"stat_sum":{"num_bytes":52585846,"num_objects":103,"num_object_clones":13,"num_object_copies":206,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":103,"num_whiteouts":58,"num_read":3959,"num_read_kb":20643,"num_write":339,"num_write_kb":5296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"109'479","reported_seq":5327,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:17.883261+0000","last_change":"2024-04-23T23:39:04.817002+0000","last_active":"2024-04-23T23:39:17.883261+0000","last_peered":"2024-04-23T23:39:17.883261+0000","last_clean":"2024-04-23T23:39:17.883261+0000","last_became_active":"2024-04-23T23:39:04.816060+0000","last_became_peered":"2024-04-23T23:39:04.816060+0000","last_unstale":"2024-04-23T23:39:17.883261+0000","last_undegraded":"2024-04-23T23:39:17.883261+0000","last_fullsized":"2024-04-23T23:39:17.883261+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:53:57.510717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013335580000000001,"stat_sum":{"num_bytes":40456985,"num_objects":96,"num_object_clones":16,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":48,"num_read":6397,"num_read_kb":26992,"num_write":522,"num_write_kb":34917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"109'513","reported_seq":6404,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:17.610451+0000","last_change":"2024-04-23T23:39:03.818256+0000","last_active":"2024-04-23T23:39:17.610451+0000","last_peered":"2024-04-23T23:39:17.610451+0000","last_clean":"2024-04-23T23:39:17.610451+0000","last_became_active":"2024-04-23T23:39:03.817321+0000","last_became_peered":"2024-04-23T23:39:03.817321+0000","last_unstale":"2024-04-23T23:39:17.610451+0000","last_undegraded":"2024-04-23T23:39:17.610451+0000","last_fullsized":"2024-04-23T23:39:17.610451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:00:41.541083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56570673,"num_objects":85,"num_object_clones":13,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":48,"num_read":8085,"num_read_kb":38574,"num_write":493,"num_write_kb":13965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"109'682","reported_seq":2999,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033557+0000","last_change":"2024-04-23T23:39:06.824155+0000","last_active":"2024-04-23T23:39:19.033557+0000","last_peered":"2024-04-23T23:39:19.033557+0000","last_clean":"2024-04-23T23:39:19.033557+0000","last_became_active":"2024-04-23T23:39:06.823397+0000","last_became_peered":"2024-04-23T23:39:06.823397+0000","last_unstale":"2024-04-23T23:39:19.033557+0000","last_undegraded":"2024-04-23T23:39:19.033557+0000","last_fullsized":"2024-04-23T23:39:19.033557+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":682,"log_dups_size":0,"ondisk_log_size":682,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:03:31.568812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048779100000000001,"stat_sum":{"num_bytes":29557911,"num_objects":81,"num_object_clones":9,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":47,"num_read":4331,"num_read_kb":25251,"num_write":990,"num_write_kb":27280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":258,"num_bytes_recovered":19138163,"num_keys_recovered":22,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"111'553","reported_seq":7959,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:20.235661+0000","last_change":"2024-04-23T23:39:03.813310+0000","last_active":"2024-04-23T23:39:20.235661+0000","last_peered":"2024-04-23T23:39:20.235661+0000","last_clean":"2024-04-23T23:39:20.235661+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:39:20.235661+0000","last_undegraded":"2024-04-23T23:39:20.235661+0000","last_fullsized":"2024-04-23T23:39:20.235661+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:58:42.258852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109447,"stat_sum":{"num_bytes":54699314,"num_objects":79,"num_object_clones":10,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":38,"num_read":9521,"num_read_kb":26625,"num_write":692,"num_write_kb":19899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"111'479","reported_seq":4744,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032499+0000","last_change":"2024-04-23T23:39:05.824747+0000","last_active":"2024-04-23T23:39:19.032499+0000","last_peered":"2024-04-23T23:39:19.032499+0000","last_clean":"2024-04-23T23:39:19.032499+0000","last_became_active":"2024-04-23T23:39:05.823040+0000","last_became_peered":"2024-04-23T23:39:05.823040+0000","last_unstale":"2024-04-23T23:39:19.032499+0000","last_undegraded":"2024-04-23T23:39:19.032499+0000","last_fullsized":"2024-04-23T23:39:19.032499+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:13:35.403232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044664900000000003,"stat_sum":{"num_bytes":143106712,"num_objects":107,"num_object_clones":16,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":60,"num_read":4260,"num_read_kb":39961,"num_write":428,"num_write_kb":28015,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":15840300,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"109'378","reported_seq":2270,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032428+0000","last_change":"2024-04-23T23:38:44.810906+0000","last_active":"2024-04-23T23:39:19.032428+0000","last_peered":"2024-04-23T23:39:19.032428+0000","last_clean":"2024-04-23T23:39:19.032428+0000","last_became_active":"2024-04-23T23:38:44.809902+0000","last_became_peered":"2024-04-23T23:38:44.809902+0000","last_unstale":"2024-04-23T23:39:19.032428+0000","last_undegraded":"2024-04-23T23:39:19.032428+0000","last_fullsized":"2024-04-23T23:39:19.032428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:49:23.573351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091463299999999998,"stat_sum":{"num_bytes":55314533,"num_objects":75,"num_object_clones":12,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":40,"num_read":2066,"num_read_kb":23614,"num_write":473,"num_write_kb":17850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":16101144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"109'412","reported_seq":4156,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:16.474586+0000","last_change":"2024-04-23T23:38:44.815156+0000","last_active":"2024-04-23T23:39:16.474586+0000","last_peered":"2024-04-23T23:39:16.474586+0000","last_clean":"2024-04-23T23:39:16.474586+0000","last_became_active":"2024-04-23T23:38:44.814027+0000","last_became_peered":"2024-04-23T23:38:44.814027+0000","last_unstale":"2024-04-23T23:39:16.474586+0000","last_undegraded":"2024-04-23T23:39:16.474586+0000","last_fullsized":"2024-04-23T23:39:16.474586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:48:10.502606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035554319999999999,"stat_sum":{"num_bytes":81294638,"num_objects":82,"num_object_clones":9,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":47,"num_read":4491,"num_read_kb":45441,"num_write":543,"num_write_kb":36001,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":34599238,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"109'545","reported_seq":6721,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:17.863041+0000","last_change":"2024-04-23T23:39:09.821232+0000","last_active":"2024-04-23T23:39:17.863041+0000","last_peered":"2024-04-23T23:39:17.863041+0000","last_clean":"2024-04-23T23:39:17.863041+0000","last_became_active":"2024-04-23T23:39:09.820220+0000","last_became_peered":"2024-04-23T23:39:09.820220+0000","last_unstale":"2024-04-23T23:39:17.863041+0000","last_undegraded":"2024-04-23T23:39:17.863041+0000","last_fullsized":"2024-04-23T23:39:17.863041+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":545,"log_dups_size":0,"ondisk_log_size":545,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:19:38.267569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012770870000000001,"stat_sum":{"num_bytes":54556083,"num_objects":76,"num_object_clones":13,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":39,"num_read":8019,"num_read_kb":30994,"num_write":691,"num_write_kb":30742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":116,"num_bytes_recovered":9269919,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"111'337","reported_seq":3439,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033404+0000","last_change":"2024-04-23T23:39:09.817144+0000","last_active":"2024-04-23T23:39:19.033404+0000","last_peered":"2024-04-23T23:39:19.033404+0000","last_clean":"2024-04-23T23:39:19.033404+0000","last_became_active":"2024-04-23T23:39:09.816070+0000","last_became_peered":"2024-04-23T23:39:09.816070+0000","last_unstale":"2024-04-23T23:39:19.033404+0000","last_undegraded":"2024-04-23T23:39:19.033404+0000","last_fullsized":"2024-04-23T23:39:19.033404+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":337,"log_dups_size":0,"ondisk_log_size":337,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:52:51.010335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066396700000000001,"stat_sum":{"num_bytes":56443116,"num_objects":102,"num_object_clones":12,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":66,"num_read":2434,"num_read_kb":18203,"num_write":271,"num_write_kb":15757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":382,"num_bytes_recovered":18174444,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"108'767","reported_seq":7378,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:20.239319+0000","last_change":"2024-04-23T23:39:09.819191+0000","last_active":"2024-04-23T23:39:20.239319+0000","last_peered":"2024-04-23T23:39:20.239319+0000","last_clean":"2024-04-23T23:39:20.239319+0000","last_became_active":"2024-04-23T23:39:09.816573+0000","last_became_peered":"2024-04-23T23:39:09.816573+0000","last_unstale":"2024-04-23T23:39:20.239319+0000","last_undegraded":"2024-04-23T23:39:20.239319+0000","last_fullsized":"2024-04-23T23:39:20.239319+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":767,"log_dups_size":0,"ondisk_log_size":767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:54:07.676235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000411357,"stat_sum":{"num_bytes":22414682,"num_objects":80,"num_object_clones":8,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":45,"num_read":9513,"num_read_kb":15827,"num_write":1077,"num_write_kb":9718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":274,"num_bytes_recovered":6692999,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.035390+0000","last_change":"2024-04-23T23:39:06.819217+0000","last_active":"2024-04-23T23:39:19.035390+0000","last_peered":"2024-04-23T23:39:19.035390+0000","last_clean":"2024-04-23T23:39:19.035390+0000","last_became_active":"2024-04-23T23:39:06.818805+0000","last_became_peered":"2024-04-23T23:39:06.818805+0000","last_unstale":"2024-04-23T23:39:19.035390+0000","last_undegraded":"2024-04-23T23:39:19.035390+0000","last_fullsized":"2024-04-23T23:39:19.035390+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:10:59.164225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"109'330","reported_seq":3805,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032828+0000","last_change":"2024-04-23T23:39:03.817855+0000","last_active":"2024-04-23T23:39:19.032828+0000","last_peered":"2024-04-23T23:39:19.032828+0000","last_clean":"2024-04-23T23:39:19.032828+0000","last_became_active":"2024-04-23T23:39:03.817144+0000","last_became_peered":"2024-04-23T23:39:03.817144+0000","last_unstale":"2024-04-23T23:39:19.032828+0000","last_undegraded":"2024-04-23T23:39:19.032828+0000","last_fullsized":"2024-04-23T23:39:19.032828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":330,"log_dups_size":0,"ondisk_log_size":330,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:50:22.024492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043457199999999999,"stat_sum":{"num_bytes":75294276,"num_objects":71,"num_object_clones":7,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":38,"num_read":3700,"num_read_kb":28447,"num_write":311,"num_write_kb":2202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":1741635,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032828+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:39:19.032828+0000","last_peered":"2024-04-23T23:39:19.032828+0000","last_clean":"2024-04-23T23:39:19.032828+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:39:19.032828+0000","last_undegraded":"2024-04-23T23:39:19.032828+0000","last_fullsized":"2024-04-23T23:39:19.032828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"107'694","reported_seq":4143,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:16.529914+0000","last_change":"2024-04-23T23:39:09.817403+0000","last_active":"2024-04-23T23:39:16.529914+0000","last_peered":"2024-04-23T23:39:16.529914+0000","last_clean":"2024-04-23T23:39:16.529914+0000","last_became_active":"2024-04-23T23:39:09.816358+0000","last_became_peered":"2024-04-23T23:39:09.816358+0000","last_unstale":"2024-04-23T23:39:16.529914+0000","last_undegraded":"2024-04-23T23:39:16.529914+0000","last_fullsized":"2024-04-23T23:39:16.529914+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:46:34.777408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000861358,"stat_sum":{"num_bytes":51749254,"num_objects":80,"num_object_clones":8,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":42,"num_read":6099,"num_read_kb":54760,"num_write":1010,"num_write_kb":15040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":230,"num_bytes_recovered":19379737,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":195,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033500+0000","last_change":"2024-04-23T23:39:06.826203+0000","last_active":"2024-04-23T23:39:19.033500+0000","last_peered":"2024-04-23T23:39:19.033500+0000","last_clean":"2024-04-23T23:39:19.033500+0000","last_became_active":"2024-04-23T23:39:06.825912+0000","last_became_peered":"2024-04-23T23:39:06.825912+0000","last_unstale":"2024-04-23T23:39:19.033500+0000","last_undegraded":"2024-04-23T23:39:19.033500+0000","last_fullsized":"2024-04-23T23:39:19.033500+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:48:08.669634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"109'359","reported_seq":2350,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032662+0000","last_change":"2024-04-23T23:37:33.804737+0000","last_active":"2024-04-23T23:39:19.032662+0000","last_peered":"2024-04-23T23:39:19.032662+0000","last_clean":"2024-04-23T23:39:19.032662+0000","last_became_active":"2024-04-23T23:37:31.799126+0000","last_became_peered":"2024-04-23T23:37:31.799126+0000","last_unstale":"2024-04-23T23:39:19.032662+0000","last_undegraded":"2024-04-23T23:39:19.032662+0000","last_fullsized":"2024-04-23T23:39:19.032662+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:50:05.248289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000552153,"stat_sum":{"num_bytes":53286797,"num_objects":74,"num_object_clones":9,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":35,"num_read":2409,"num_read_kb":30634,"num_write":351,"num_write_kb":13760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":204,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032721+0000","last_change":"2024-04-23T23:39:06.826058+0000","last_active":"2024-04-23T23:39:19.032721+0000","last_peered":"2024-04-23T23:39:19.032721+0000","last_clean":"2024-04-23T23:39:19.032721+0000","last_became_active":"2024-04-23T23:39:06.825725+0000","last_became_peered":"2024-04-23T23:39:06.825725+0000","last_unstale":"2024-04-23T23:39:19.032721+0000","last_undegraded":"2024-04-23T23:39:19.032721+0000","last_fullsized":"2024-04-23T23:39:19.032721+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:18.901281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"109'689","reported_seq":2082,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:16.408131+0000","last_change":"2024-04-23T23:38:19.815075+0000","last_active":"2024-04-23T23:39:16.408131+0000","last_peered":"2024-04-23T23:39:16.408131+0000","last_clean":"2024-04-23T23:39:16.408131+0000","last_became_active":"2024-04-23T23:38:19.813635+0000","last_became_peered":"2024-04-23T23:38:19.813635+0000","last_unstale":"2024-04-23T23:39:16.408131+0000","last_undegraded":"2024-04-23T23:39:16.408131+0000","last_fullsized":"2024-04-23T23:39:16.408131+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:21:42.373320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014827079999999999,"stat_sum":{"num_bytes":32521956,"num_objects":83,"num_object_clones":13,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":51,"num_read":4484,"num_read_kb":27819,"num_write":1048,"num_write_kb":22822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"111'391","reported_seq":3123,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033394+0000","last_change":"2024-04-23T23:39:05.818157+0000","last_active":"2024-04-23T23:39:19.033394+0000","last_peered":"2024-04-23T23:39:19.033394+0000","last_clean":"2024-04-23T23:39:19.033394+0000","last_became_active":"2024-04-23T23:39:05.817222+0000","last_became_peered":"2024-04-23T23:39:05.817222+0000","last_unstale":"2024-04-23T23:39:19.033394+0000","last_undegraded":"2024-04-23T23:39:19.033394+0000","last_fullsized":"2024-04-23T23:39:19.033394+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:06:21.574428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400399999999997,"stat_sum":{"num_bytes":19916954,"num_objects":77,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":38,"num_read":3212,"num_read_kb":19431,"num_write":462,"num_write_kb":11626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11294254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:16.029980+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:39:16.029980+0000","last_peered":"2024-04-23T23:39:16.029980+0000","last_clean":"2024-04-23T23:39:16.029980+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:39:16.029980+0000","last_undegraded":"2024-04-23T23:39:16.029980+0000","last_fullsized":"2024-04-23T23:39:16.029980+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"109'433","reported_seq":2136,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032581+0000","last_change":"2024-04-23T23:37:33.804968+0000","last_active":"2024-04-23T23:39:19.032581+0000","last_peered":"2024-04-23T23:39:19.032581+0000","last_clean":"2024-04-23T23:39:19.032581+0000","last_became_active":"2024-04-23T23:37:31.799146+0000","last_became_peered":"2024-04-23T23:37:31.799146+0000","last_unstale":"2024-04-23T23:39:19.032581+0000","last_undegraded":"2024-04-23T23:39:19.032581+0000","last_fullsized":"2024-04-23T23:39:19.032581+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:08:04.340217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055612800000000003,"stat_sum":{"num_bytes":91368814,"num_objects":83,"num_object_clones":9,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":43,"num_read":2324,"num_read_kb":42272,"num_write":620,"num_write_kb":67959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.035131+0000","last_change":"2024-04-23T23:38:42.163377+0000","last_active":"2024-04-23T23:39:19.035131+0000","last_peered":"2024-04-23T23:39:19.035131+0000","last_clean":"2024-04-23T23:39:19.035131+0000","last_became_active":"2024-04-23T23:38:42.163067+0000","last_became_peered":"2024-04-23T23:38:42.163067+0000","last_unstale":"2024-04-23T23:39:19.035131+0000","last_undegraded":"2024-04-23T23:39:19.035131+0000","last_fullsized":"2024-04-23T23:39:19.035131+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:15.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"111'611","reported_seq":3884,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033358+0000","last_change":"2024-04-23T23:39:05.821214+0000","last_active":"2024-04-23T23:39:19.033358+0000","last_peered":"2024-04-23T23:39:19.033358+0000","last_clean":"2024-04-23T23:39:19.033358+0000","last_became_active":"2024-04-23T23:39:05.820082+0000","last_became_peered":"2024-04-23T23:39:05.820082+0000","last_unstale":"2024-04-23T23:39:19.033358+0000","last_undegraded":"2024-04-23T23:39:19.033358+0000","last_fullsized":"2024-04-23T23:39:19.033358+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":611,"log_dups_size":0,"ondisk_log_size":611,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:47:38.744869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047655700000000001,"stat_sum":{"num_bytes":77636416,"num_objects":66,"num_object_clones":7,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":40,"num_read":4618,"num_read_kb":16192,"num_write":855,"num_write_kb":10584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":216,"num_bytes_recovered":5883246,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032634+0000","last_change":"2024-04-23T23:39:06.821895+0000","last_active":"2024-04-23T23:39:19.032634+0000","last_peered":"2024-04-23T23:39:19.032634+0000","last_clean":"2024-04-23T23:39:19.032634+0000","last_became_active":"2024-04-23T23:39:06.821617+0000","last_became_peered":"2024-04-23T23:39:06.821617+0000","last_unstale":"2024-04-23T23:39:19.032634+0000","last_undegraded":"2024-04-23T23:39:19.032634+0000","last_fullsized":"2024-04-23T23:39:19.032634+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:54:14.082204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"109'605","reported_seq":2151,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:16.475839+0000","last_change":"2024-04-23T23:38:19.814491+0000","last_active":"2024-04-23T23:39:16.475839+0000","last_peered":"2024-04-23T23:39:16.475839+0000","last_clean":"2024-04-23T23:39:16.475839+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:39:16.475839+0000","last_undegraded":"2024-04-23T23:39:16.475839+0000","last_fullsized":"2024-04-23T23:39:16.475839+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:33:03.494714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000789393,"stat_sum":{"num_bytes":44182009,"num_objects":65,"num_object_clones":5,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":33,"num_read":3699,"num_read_kb":8801,"num_write":757,"num_write_kb":5142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":180,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-23T23:39:14.958165+0000","last_change":"2024-04-23T23:37:32.837969+0000","last_active":"2024-04-23T23:39:14.958165+0000","last_peered":"2024-04-23T23:39:14.958165+0000","last_clean":"2024-04-23T23:39:14.958165+0000","last_became_active":"2024-04-23T23:37:32.837752+0000","last_became_peered":"2024-04-23T23:37:32.837752+0000","last_unstale":"2024-04-23T23:39:14.958165+0000","last_undegraded":"2024-04-23T23:39:14.958165+0000","last_fullsized":"2024-04-23T23:39:14.958165+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:28:24.064742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":311,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032423+0000","last_change":"2024-04-23T23:39:09.820117+0000","last_active":"2024-04-23T23:39:19.032423+0000","last_peered":"2024-04-23T23:39:19.032423+0000","last_clean":"2024-04-23T23:39:19.032423+0000","last_became_active":"2024-04-23T23:39:09.819719+0000","last_became_peered":"2024-04-23T23:39:09.819719+0000","last_unstale":"2024-04-23T23:39:19.032423+0000","last_undegraded":"2024-04-23T23:39:19.032423+0000","last_fullsized":"2024-04-23T23:39:19.032423+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:49:03.676146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"109'397","reported_seq":18955,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032538+0000","last_change":"2024-04-23T23:39:09.822758+0000","last_active":"2024-04-23T23:39:19.032538+0000","last_peered":"2024-04-23T23:39:19.032538+0000","last_clean":"2024-04-23T23:39:19.032538+0000","last_became_active":"2024-04-23T23:39:09.822024+0000","last_became_peered":"2024-04-23T23:39:09.822024+0000","last_unstale":"2024-04-23T23:39:19.032538+0000","last_undegraded":"2024-04-23T23:39:19.032538+0000","last_fullsized":"2024-04-23T23:39:19.032538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:54:10.406731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701399999999997,"stat_sum":{"num_bytes":53693835,"num_objects":88,"num_object_clones":11,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":51,"num_read":18647,"num_read_kb":39681,"num_write":469,"num_write_kb":22150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":175,"num_bytes_recovered":20412771,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"109'382","reported_seq":4849,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033228+0000","last_change":"2024-04-23T23:39:03.814910+0000","last_active":"2024-04-23T23:39:19.033228+0000","last_peered":"2024-04-23T23:39:19.033228+0000","last_clean":"2024-04-23T23:39:19.033228+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:39:19.033228+0000","last_undegraded":"2024-04-23T23:39:19.033228+0000","last_fullsized":"2024-04-23T23:39:19.033228+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:45:57.904522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078111900000000004,"stat_sum":{"num_bytes":69294582,"num_objects":90,"num_object_clones":14,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":49,"num_read":4647,"num_read_kb":27431,"num_write":336,"num_write_kb":28829,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"109'727","reported_seq":6789,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:20.239753+0000","last_change":"2024-04-23T23:39:05.817000+0000","last_active":"2024-04-23T23:39:20.239753+0000","last_peered":"2024-04-23T23:39:20.239753+0000","last_clean":"2024-04-23T23:39:20.239753+0000","last_became_active":"2024-04-23T23:39:05.815581+0000","last_became_peered":"2024-04-23T23:39:05.815581+0000","last_unstale":"2024-04-23T23:39:20.239753+0000","last_undegraded":"2024-04-23T23:39:20.239753+0000","last_fullsized":"2024-04-23T23:39:20.239753+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":727,"log_dups_size":0,"ondisk_log_size":727,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:55.866290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036496,"stat_sum":{"num_bytes":28771815,"num_objects":80,"num_object_clones":9,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":36,"num_read":8795,"num_read_kb":24388,"num_write":930,"num_write_kb":13623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"109'415","reported_seq":8521,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:20.237840+0000","last_change":"2024-04-23T23:39:04.822168+0000","last_active":"2024-04-23T23:39:20.237840+0000","last_peered":"2024-04-23T23:39:20.237840+0000","last_clean":"2024-04-23T23:39:20.237840+0000","last_became_active":"2024-04-23T23:39:04.819875+0000","last_became_peered":"2024-04-23T23:39:04.819875+0000","last_unstale":"2024-04-23T23:39:20.237840+0000","last_undegraded":"2024-04-23T23:39:20.237840+0000","last_fullsized":"2024-04-23T23:39:20.237840+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:16:27.286787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070273799999999995,"stat_sum":{"num_bytes":89917570,"num_objects":101,"num_object_clones":19,"num_object_copies":202,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":101,"num_whiteouts":46,"num_read":8232,"num_read_kb":44104,"num_write":385,"num_write_kb":16670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":11368218,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"109'345","reported_seq":6924,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:17.216847+0000","last_change":"2024-04-23T23:38:19.814484+0000","last_active":"2024-04-23T23:39:17.216847+0000","last_peered":"2024-04-23T23:39:17.216847+0000","last_clean":"2024-04-23T23:39:17.216847+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:39:17.216847+0000","last_undegraded":"2024-04-23T23:39:17.216847+0000","last_fullsized":"2024-04-23T23:39:17.216847+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:19:00.597598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001080988,"stat_sum":{"num_bytes":100428200,"num_objects":99,"num_object_clones":16,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":49,"num_read":6727,"num_read_kb":51591,"num_write":327,"num_write_kb":15135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"109'416","reported_seq":4683,"reported_epoch":109,"state":"active+clean","last_fresh":"2024-04-23T23:39:17.882906+0000","last_change":"2024-04-23T23:39:09.815104+0000","last_active":"2024-04-23T23:39:17.882906+0000","last_peered":"2024-04-23T23:39:17.882906+0000","last_clean":"2024-04-23T23:39:17.882906+0000","last_became_active":"2024-04-23T23:39:09.813994+0000","last_became_peered":"2024-04-23T23:39:09.813994+0000","last_unstale":"2024-04-23T23:39:17.882906+0000","last_undegraded":"2024-04-23T23:39:17.882906+0000","last_fullsized":"2024-04-23T23:39:17.882906+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":416,"log_dups_size":0,"ondisk_log_size":416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:52.683807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090758899999999999,"stat_sum":{"num_bytes":30056731,"num_objects":97,"num_object_clones":17,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":54,"num_read":5736,"num_read_kb":30072,"num_write":361,"num_write_kb":6479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":3634998,"num_keys_recovered":36,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"109'687","reported_seq":4781,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033402+0000","last_change":"2024-04-23T23:39:09.821178+0000","last_active":"2024-04-23T23:39:19.033402+0000","last_peered":"2024-04-23T23:39:19.033402+0000","last_clean":"2024-04-23T23:39:19.033402+0000","last_became_active":"2024-04-23T23:39:09.820009+0000","last_became_peered":"2024-04-23T23:39:09.820009+0000","last_unstale":"2024-04-23T23:39:19.033402+0000","last_undegraded":"2024-04-23T23:39:19.033402+0000","last_fullsized":"2024-04-23T23:39:19.033402+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:19:38.158971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727580000000001,"stat_sum":{"num_bytes":75134915,"num_objects":82,"num_object_clones":10,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":41,"num_read":6679,"num_read_kb":28521,"num_write":823,"num_write_kb":10341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":6150574,"num_keys_recovered":58,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"111'584","reported_seq":8011,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:20.238998+0000","last_change":"2024-04-23T23:39:10.820539+0000","last_active":"2024-04-23T23:39:20.238998+0000","last_peered":"2024-04-23T23:39:20.238998+0000","last_clean":"2024-04-23T23:39:20.238998+0000","last_became_active":"2024-04-23T23:39:10.818628+0000","last_became_peered":"2024-04-23T23:39:10.818628+0000","last_unstale":"2024-04-23T23:39:20.238998+0000","last_undegraded":"2024-04-23T23:39:20.238998+0000","last_fullsized":"2024-04-23T23:39:20.238998+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:57:39.295578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001215793,"stat_sum":{"num_bytes":92281358,"num_objects":94,"num_object_clones":17,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":48,"num_read":8415,"num_read_kb":50457,"num_write":653,"num_write_kb":20982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":376,"num_bytes_recovered":17288489,"num_keys_recovered":92,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"109'407","reported_seq":12669,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:20.230739+0000","last_change":"2024-04-23T23:38:44.814041+0000","last_active":"2024-04-23T23:39:20.230739+0000","last_peered":"2024-04-23T23:39:20.230739+0000","last_clean":"2024-04-23T23:39:20.230739+0000","last_became_active":"2024-04-23T23:38:44.813024+0000","last_became_peered":"2024-04-23T23:38:44.813024+0000","last_unstale":"2024-04-23T23:39:20.230739+0000","last_undegraded":"2024-04-23T23:39:20.230739+0000","last_fullsized":"2024-04-23T23:39:20.230739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:11:18.806860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044726999999999999,"stat_sum":{"num_bytes":74029650,"num_objects":90,"num_object_clones":13,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":44,"num_read":12775,"num_read_kb":26326,"num_write":482,"num_write_kb":35031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":6225512,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"111'386","reported_seq":5476,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033255+0000","last_change":"2024-04-23T23:39:09.818073+0000","last_active":"2024-04-23T23:39:19.033255+0000","last_peered":"2024-04-23T23:39:19.033255+0000","last_clean":"2024-04-23T23:39:19.033255+0000","last_became_active":"2024-04-23T23:39:09.816446+0000","last_became_peered":"2024-04-23T23:39:09.816446+0000","last_unstale":"2024-04-23T23:39:19.033255+0000","last_undegraded":"2024-04-23T23:39:19.033255+0000","last_fullsized":"2024-04-23T23:39:19.033255+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:04:50.671249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318700000000001,"stat_sum":{"num_bytes":68981421,"num_objects":86,"num_object_clones":14,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":42,"num_read":5368,"num_read_kb":60531,"num_write":350,"num_write_kb":18917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":317,"num_bytes_recovered":30597124,"num_keys_recovered":27,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"111'616","reported_seq":5264,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.032501+0000","last_change":"2024-04-23T23:39:09.820841+0000","last_active":"2024-04-23T23:39:19.032501+0000","last_peered":"2024-04-23T23:39:19.032501+0000","last_clean":"2024-04-23T23:39:19.032501+0000","last_became_active":"2024-04-23T23:39:09.819861+0000","last_became_peered":"2024-04-23T23:39:09.819861+0000","last_unstale":"2024-04-23T23:39:19.032501+0000","last_undegraded":"2024-04-23T23:39:19.032501+0000","last_fullsized":"2024-04-23T23:39:19.032501+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":616,"log_dups_size":0,"ondisk_log_size":616,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:52:59.265635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064394099999999998,"stat_sum":{"num_bytes":28746364,"num_objects":74,"num_object_clones":5,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":41,"num_read":6522,"num_read_kb":35119,"num_write":866,"num_write_kb":21131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":194,"num_bytes_recovered":20463237,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"111'331","reported_seq":4013,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-04-23T23:39:19.033294+0000","last_change":"2024-04-23T23:39:06.820108+0000","last_active":"2024-04-23T23:39:19.033294+0000","last_peered":"2024-04-23T23:39:19.033294+0000","last_clean":"2024-04-23T23:39:19.033294+0000","last_became_active":"2024-04-23T23:39:06.818912+0000","last_became_peered":"2024-04-23T23:39:06.818912+0000","last_unstale":"2024-04-23T23:39:19.033294+0000","last_undegraded":"2024-04-23T23:39:19.033294+0000","last_fullsized":"2024-04-23T23:39:19.033294+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":331,"log_dups_size":0,"ondisk_log_size":331,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:38:45.961703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045588699999999998,"stat_sum":{"num_bytes":44682832,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":36,"num_read":4184,"num_read_kb":19367,"num_write":306,"num_write_kb":5996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":2237133,"num_keys_recovered":36,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1887773417,"num_objects":2687,"num_object_clones":359,"num_object_copies":5374,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2687,"num_whiteouts":1438,"num_read":195649,"num_read_kb":995373,"num_write":18832,"num_write_kb":608596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5668,"num_bytes_recovered":324004467,"num_keys_recovered":853,"num_objects_omap":50,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552980480,"data_stored":693384890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":15886,"ondisk_log_size":15886,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177944,"kb_used_data":124552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94193896,"statfs":{"total":96636764160,"available":96454549504,"internally_reserved":0,"allocated":127541248,"data_stored":159730607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":132284,"kb_used_data":78892,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94239556,"statfs":{"total":96636764160,"available":96501305344,"internally_reserved":0,"allocated":80785408,"data_stored":91369231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855378,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123648,"kb_used_data":91384,"kb_used_omap":4,"kb_used_meta":32251,"kb_avail":94248192,"statfs":{"total":96636764160,"available":96510148608,"internally_reserved":0,"allocated":93577216,"data_stored":116650719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":33025646},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185632,"kb_used_data":136400,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94186208,"statfs":{"total":96636764160,"available":96446676992,"internally_reserved":0,"allocated":139673600,"data_stored":169217819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[10,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113604,"kb_used_data":69940,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94258236,"statfs":{"total":96636764160,"available":96520433664,"internally_reserved":0,"allocated":71618560,"data_stored":93025666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574878,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":14347775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":125624320,"data_stored":158512969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":70672384,"data_stored":92775228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":138350592,"data_stored":168590549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":93589504,"data_stored":117345804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":78868480,"data_stored":90151593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":7106560,"data_stored":10799346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:39:23.378 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:23.378 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:5468 read 0x5af83db thru 0x5b05d6c (0xd992 bytes) 2024-04-23T23:39:23.384 INFO:teuthology.orchestra.run.smithi077.stdout:5469 read 0x457d7e8 thru 0x4589466 (0xbc7f bytes) 2024-04-23T23:39:23.394 INFO:teuthology.orchestra.run.smithi077.stdout:5470 trunc from 0xc0ef254 to 0x3aed972 2024-04-23T23:39:23.397 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:23.397 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:5471 punch from 0x32d275e to 0x32d59de, (0x3280 bytes) 2024-04-23T23:39:23.410 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:23.419 INFO:teuthology.orchestra.run.smithi077.stdout:5473 write 0x664d116 thru 0x6650009 (0x2ef4 bytes) 2024-04-23T23:39:23.420 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:23.421 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:23.423 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:23.436+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:23.424 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:23.424 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:5475 read 0x2f8e606 thru 0x2f9b84b (0xd246 bytes) 2024-04-23T23:39:23.437 INFO:teuthology.orchestra.run.smithi077.stdout:5476 writesame 0x5f15996 thru 0x5f1a07e data_size 0x3(0x46e9 bytes) 2024-04-23T23:39:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:5478 read 0x48895d6 thru 0x488b93e (0x2369 bytes) 2024-04-23T23:39:23.458 INFO:teuthology.orchestra.run.smithi077.stdout:5479 read 0x3fc00a5 thru 0x3fcf1f5 (0xf151 bytes) 2024-04-23T23:39:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:5480 write 0xd719f0a thru 0xd726830 (0xc927 bytes) 2024-04-23T23:39:23.496 INFO:teuthology.orchestra.run.smithi077.stdout:5482 write 0xde69fd1 thru 0xde79edc (0xff0c bytes) 2024-04-23T23:39:23.504 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:23.504 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:23.505 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:23.505 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:23.505 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:23.515 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:23.518 INFO:teuthology.orchestra.run.smithi077.stdout:5487 write 0x6f7a74a thru 0x6f87756 (0xd00d bytes) 2024-04-23T23:39:23.540 INFO:teuthology.orchestra.run.smithi077.stdout:5489 trunc from 0xde79edd to 0xaadb629 2024-04-23T23:39:23.556 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:23.569+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:23.560 INFO:teuthology.orchestra.run.smithi077.stdout:5491 write 0x8ae9691 thru 0x8aea607 (0xf77 bytes) 2024-04-23T23:39:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:5492 punch from 0x74ad7f7 to 0x74bcab1, (0xf2ba bytes) 2024-04-23T23:39:23.570 INFO:teuthology.orchestra.run.smithi077.stdout:5493 write 0xa28abce thru 0xa299fc3 (0xf3f6 bytes) 2024-04-23T23:39:23.592 INFO:teuthology.orchestra.run.smithi077.stdout:5494 read 0x2d3aae thru 0x2d7278 (0x37cb bytes) 2024-04-23T23:39:23.593 INFO:teuthology.orchestra.run.smithi077.stdout:5495 punch from 0x1339286 to 0x133ad0a, (0x1a84 bytes) 2024-04-23T23:39:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:5496 trunc from 0xaadb629 to 0x6dd59ba 2024-04-23T23:39:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:5497 read 0x18e24da thru 0x18ecb47 (0xa66e bytes) 2024-04-23T23:39:23.616 INFO:teuthology.orchestra.run.smithi077.stdout:5499 clone 48 order 18 su 4096 sc 10 2024-04-23T23:39:23.621 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:23.634+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3013710920000001, 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:23.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:39:23.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:39:23.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3013523559999998, 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:39:23.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.677 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3013339760000004, 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:23.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:23.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:39:23.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.681 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3013147790000001, 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.685 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3010784920000003, 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.686 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:39:23.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:39:23.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3010523320000003, 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.301032663, 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:23.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:23.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:39:23.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.301014243, 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:39:23.698 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.702 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.3008675480000003, 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:23.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:39:23.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.2997121189999996, 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.710 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.2993964069999997, 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.711 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.2993743760000003, 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.715 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:39:23.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.2993538100000004, 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:39:23.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:39:23.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.2993329859999996, 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.2968846220000003, 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.728 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.8008708470000001, 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:23.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.8008546189999999, 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:39:23.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.8008383779999999, 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:23.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:39:23.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:39:23.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.8008231349999999, 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:39:23.745 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:23.749 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 3.80080705, 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:39:23.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:39:23.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:23.753 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:23.754 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:23.755 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:23.756 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:23.768+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:23.855 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:23.868+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:23.898 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:23.898 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:23.899 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:23.899 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:23.907 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:23.956 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:23.969+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:24.007 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:24.007 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:24.007 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:24.007 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:24.008 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:24.016 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:24.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:39:24.091 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:24.103+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4201.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-04-23T23:39:24.123 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 126.406889965, 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.491690234, 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4201", 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.170:0/3821296489", 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 1 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727958+0000", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727960+0000", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.404e-06 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727967+0000", 2024-04-23T23:39:24.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.182e-06 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727978+0000", 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1165000000000001e-05 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.727990+0000", 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1813e-05 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728058+0000", 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.826e-05 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:17.728067+0000", 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2490000000000007e-06 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218247+0000", 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.49018005199999998 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218393+0000", 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014605400000000001 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 0", 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.218583+0000", 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018926699999999999 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219211+0000", 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062781700000000002 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219579+0000", 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000368888 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219622+0000", 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2901999999999997e-05 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:37:18.219649+0000", 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6180999999999999e-05 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:55302 3.11 3:88191ad2:::rbd_object_map.1194dbf22edf.0000000000000018:head [writefull 0~36] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 56.081036955999998, 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99962695000000001, 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 55302 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053811+0000", 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053813+0000", 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2470000000000001e-06 2024-04-23T23:39:24.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053818+0000", 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053829+0000", 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0706e-05 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053836+0000", 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8589999999999999e-06 2024-04-23T23:39:24.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053886+0000", 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9713000000000003e-05 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:28.053894+0000", 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0129999999999993e-06 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051856+0000", 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99796209199999997 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.051969+0000", 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000113064 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052058+0000", 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9728999999999994e-05 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.052852+0000", 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000793869 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053380+0000", 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052786100000000002 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053414+0000", 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4029000000000002e-05 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:29.053438+0000", 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4000999999999999e-05 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.135 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:77891 3.e 3:774521ad:::rbd_data.1194696b8826.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 16777216 write_size 16777216,truncate 11272192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 45.582063918999999, 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047094975999999997, 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.136 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 77891 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552784+0000", 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.552786+0000", 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563659+0000", 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.010872865000000001 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563702+0000", 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3383000000000001e-05 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563734+0000", 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1495000000000003e-05 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.563836+0000", 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010215 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.564035+0000", 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019892600000000001 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.565107+0000", 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001072052 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.586378+0000", 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.021271195999999999 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599780+0000", 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.013402193999999999 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599832+0000", 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1975000000000003e-05 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:38.599879+0000", 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6996000000000002e-05 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106837 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1105920~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.989014933, 2024-04-23T23:39:24.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043899269999999997, 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106837 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145833+0000", 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145834+0000", 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0699999999999999e-07 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145835+0000", 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0210000000000001e-06 2024-04-23T23:39:24.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145837+0000", 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.847e-06 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145840+0000", 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.481e-06 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189637+0000", 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043796663 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189681+0000", 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4725999999999998e-05 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189733+0000", 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1325000000000001e-05 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106838 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1130496~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.989005544000001, 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044012456999999998, 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106838 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145843+0000", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145844+0000", 2024-04-23T23:39:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.049e-06 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145847+0000", 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8289999999999999e-06 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145849+0000", 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189761+0000", 2024-04-23T23:39:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911752999999998 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189804+0000", 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2695999999999999e-05 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189855+0000", 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1431999999999998e-05 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106839 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1155072~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.988996194999999, 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044114555999999999, 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106839 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.145852+0000", 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146080+0000", 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000227486 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146083+0000", 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.258e-06 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146093+0000", 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0672999999999999e-05 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146100+0000", 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0299999999999999e-06 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189882+0000", 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043782284999999997 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189920+0000", 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8516000000000002e-05 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189967+0000", 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6307999999999998e-05 2024-04-23T23:39:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106840 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1179648~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.988738669, 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043966107999999997, 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106840 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146110+0000", 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146117+0000", 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6619999999999999e-06 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146129+0000", 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2371000000000001e-05 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146134+0000", 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2449999999999998e-06 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.189992+0000", 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043858000000000001 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190030+0000", 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7755e-05 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190076+0000", 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5538999999999999e-05 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106841 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1335296~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.988705940999999, 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044044613000000003, 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106841 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146142+0000", 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146143+0000", 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9500000000000003e-07 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146145+0000", 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.334e-06 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146152+0000", 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4479999999999999e-06 2024-04-23T23:39:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146156+0000", 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7509999999999999e-06 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190099+0000", 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043942795999999999 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190140+0000", 2024-04-23T23:39:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0813999999999999e-05 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190187+0000", 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6974999999999997e-05 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106842 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 1359872~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.988685514, 2024-04-23T23:39:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044137033999999999, 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106842 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.146163+0000", 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147472+0000", 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0013091859999999999 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147475+0000", 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3739999999999998e-06 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147487+0000", 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1212e-05 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147494+0000", 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1459999999999999e-06 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190215+0000", 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042721228999999999 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190254+0000", 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9161e-05 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.190300+0000", 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5726000000000002e-05 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106855 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2072576~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.987022087, 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043925840000000001, 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106855 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147826+0000", 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147827+0000", 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2600000000000002e-07 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147829+0000", 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7010000000000001e-06 2024-04-23T23:39:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147837+0000", 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7910000000000005e-06 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147843+0000", 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9560000000000002e-06 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191668+0000", 2024-04-23T23:39:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043824701000000001 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191708+0000", 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0371999999999999e-05 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191752+0000", 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3792999999999999e-05 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106856 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2097152~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.986997584000001, 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044011869000000002, 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106856 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147851+0000", 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7599999999999997e-07 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147853+0000", 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1780000000000002e-06 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147860+0000", 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5019999999999998e-06 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147865+0000", 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191777+0000", 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043911126000000002 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191819+0000", 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1990000000000003e-05 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191863+0000", 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3995999999999997e-05 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106857 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2252800~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.986976260999999, 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044095387999999999, 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106857 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147872+0000", 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147873+0000", 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.82e-07 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147874+0000", 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147881+0000", 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.392e-06 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147886+0000", 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9389999999999996e-06 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191884+0000", 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043998430999999998 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191922+0000", 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7339000000000003e-05 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191967+0000", 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5785000000000003e-05 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106858 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 2277376~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.986956138, 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044206352999999997, 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106858 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.147892+0000", 2024-04-23T23:39:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149473+0000", 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001580733 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149477+0000", 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149488+0000", 2024-04-23T23:39:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0891e-05 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149495+0000", 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2289999999999997e-06 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.191990+0000", 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042494707999999999 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192048+0000", 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7615000000000003e-05 2024-04-23T23:39:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.192098+0000", 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0915999999999998e-05 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106873 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3170304~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.985015966999999, 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043985420999999997, 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106873 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149832+0000", 2024-04-23T23:39:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149833+0000", 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3999999999999998e-07 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149834+0000", 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.15e-06 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149837+0000", 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9390000000000002e-06 2024-04-23T23:39:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149839+0000", 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5739999999999998e-06 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193731+0000", 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043891442000000003 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193770+0000", 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9236999999999997e-05 2024-04-23T23:39:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193818+0000", 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7839000000000001e-05 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106874 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3194880~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.985006296000002, 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044084569999999997, 2024-04-23T23:39:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106874 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149842+0000", 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0800000000000001e-07 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149843+0000", 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2600000000000001e-07 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149846+0000", 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.366e-06 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149851+0000", 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0999999999999997e-06 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193842+0000", 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043991808 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193880+0000", 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7296999999999999e-05 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193927+0000", 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6864999999999999e-05 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106875 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3219456~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.984992524999999, 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044177196000000002, 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106875 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149856+0000", 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149940+0000", 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4321999999999997e-05 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149942+0000", 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.26e-06 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149948+0000", 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9190000000000004e-06 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149952+0000", 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7560000000000001e-06 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193948+0000", 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043995819999999998 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.193985+0000", 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6798999999999998e-05 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194033+0000", 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8319999999999998e-05 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106876 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3244032~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.98488935, 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044183060000000003, 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106876 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.149959+0000", 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151472+0000", 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001513316 2024-04-23T23:39:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151481+0000", 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6829999999999997e-06 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151490+0000", 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8929999999999994e-06 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151496+0000", 2024-04-23T23:39:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8690000000000001e-06 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194058+0000", 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042562068000000002 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194095+0000", 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7336000000000003e-05 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.194142+0000", 2024-04-23T23:39:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6894999999999997e-05 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106886 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3883008~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.983159048000001, 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043926192000000003, 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106886 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151689+0000", 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4600000000000001e-07 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151691+0000", 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.277e-06 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151694+0000", 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0599999999999999e-06 2024-04-23T23:39:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151696+0000", 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.531e-06 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195434+0000", 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043737442000000001 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195516+0000", 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2545000000000003e-05 2024-04-23T23:39:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195615+0000", 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.9091000000000004e-05 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106887 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3907584~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.983148749000001, 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044058967999999997, 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106887 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151700+0000", 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-07 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151701+0000", 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1310000000000001e-06 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151704+0000", 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.954e-06 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151706+0000", 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.571e-06 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195662+0000", 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.043955283999999997 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195711+0000", 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8872999999999998e-05 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195758+0000", 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7935000000000001e-05 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:106888 3.13 3:ccf15b0f:::rbd_data.1194f5419933.0000000000000003:29 [read 3932160~8192] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e91)", 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.983139155, 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.044184735000000003, 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 106888 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.151709+0000", 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153471+0000", 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001761777 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153485+0000", 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4015999999999999e-05 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153495+0000", 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7899999999999994e-06 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.153500+0000", 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1739999999999999e-06 2024-04-23T23:39:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195787+0000", 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.042287400000000003 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195830+0000", 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2624999999999999e-05 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:57.195894+0000", 2024-04-23T23:39:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3953000000000002e-05 2024-04-23T23:39:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.213 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:24.214 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:24.215 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:24.227+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:24.247 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #46, image image_client.0-clone46 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent47 2024-04-23T23:39:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:24.284 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:24.299 INFO:teuthology.orchestra.run.smithi077.stdout:5503 write 0xb762718 thru 0xb767b27 (0x5410 bytes) 2024-04-23T23:39:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:5505 read 0x6261d9c thru 0x6262290 (0x4f5 bytes) 2024-04-23T23:39:24.306 INFO:teuthology.orchestra.run.smithi077.stdout:5506 writesame 0xb280599 thru 0xb2880ed data_size 0x1(0x7b55 bytes) 2024-04-23T23:39:24.315 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:24.327+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:24.319 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:24.321 INFO:teuthology.orchestra.run.smithi077.stdout:5508 trunc from 0xb767b28 to 0x996c2ed 2024-04-23T23:39:24.334 INFO:teuthology.orchestra.run.smithi077.stdout:5510 writesame 0x82056a4 thru 0x820c07f data_size 0x32(0x69dc bytes) 2024-04-23T23:39:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:5514 punch from 0x4343d0f to 0x4353144, (0xf435 bytes) 2024-04-23T23:39:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:5515 read 0x2ead8c7 thru 0x2eb6472 (0x8bac bytes) 2024-04-23T23:39:24.344 INFO:teuthology.orchestra.run.smithi077.stdout:5516 read 0x844729c thru 0x845076b (0x94d0 bytes) 2024-04-23T23:39:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:5517 read 0xc14898 thru 0xc1fae8 (0xb251 bytes) 2024-04-23T23:39:24.345 INFO:teuthology.orchestra.run.smithi077.stdout:5520 punch from 0x8484b89 to 0x848ca7e, (0x7ef5 bytes) 2024-04-23T23:39:24.352 INFO:teuthology.orchestra.run.smithi077.stdout:5522 writesame 0xb439a2e thru 0xb44677a data_size 0x1(0xcd4d bytes) 2024-04-23T23:39:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:5523 read 0x272e1f5 thru 0x272ff6b (0x1d77 bytes) 2024-04-23T23:39:24.353 INFO:teuthology.orchestra.run.smithi077.stdout:5525 write 0xb371ea6 thru 0xb37782c (0x5987 bytes) 2024-04-23T23:39:24.360 INFO:teuthology.orchestra.run.smithi077.stdout:5526 writesame 0x4d2d455 thru 0x4d348cc data_size 0x4(0x7478 bytes) 2024-04-23T23:39:24.372 INFO:teuthology.orchestra.run.smithi077.stdout:5527 read 0x736767f thru 0x7367e85 (0x807 bytes) 2024-04-23T23:39:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:5529 punch from 0xb0a4199 to 0xb0ae2b4, (0xa11b bytes) 2024-04-23T23:39:24.373 INFO:teuthology.orchestra.run.smithi077.stdout:5530 writesame 0x6880f0f thru 0x6881aff data_size 0x1(0xbf1 bytes) 2024-04-23T23:39:24.379 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:24.379 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222429 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390841+0000", 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0011832710000000001, 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0012044410000000001, 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222429 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.380 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390841+0000", 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390841+0000", 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390842+0000", 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1399999999999997e-07 2024-04-23T23:39:24.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390844+0000", 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5150000000000001e-06 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390851+0000", 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9639999999999997e-06 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390857+0000", 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4539999999999998e-06 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222430 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390864+0000", 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.001160463, 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001243482, 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222430 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390864+0000", 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390864+0000", 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390865+0000", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0299999999999999e-07 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390867+0000", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9719999999999999e-06 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390873+0000", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3559999999999998e-06 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390878+0000", 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222431 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390885+0000", 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.001139113, 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0012771869999999999, 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222431 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390885+0000", 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390885+0000", 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390886+0000", 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8500000000000002e-07 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390888+0000", 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.176e-06 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390894+0000", 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3130000000000004e-06 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390900+0000", 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.181e-06 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222432 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390907+0000", 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0011179849999999999, 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001309101, 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.389 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222432 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390907+0000", 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390907+0000", 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390907+0000", 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390909+0000", 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1289999999999999e-06 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390915+0000", 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1449999999999996e-06 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390920+0000", 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.899e-06 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222433 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390927+0000", 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0010977140000000001, 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001341835, 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.392 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222433 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390927+0000", 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390927+0000", 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390927+0000", 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390929+0000", 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390936+0000", 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390942+0000", 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1360000000000002e-06 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222434 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.395 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390949+0000", 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.0010756260000000001, 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001373839, 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222434 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390949+0000", 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390949+0000", 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390949+0000", 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.01e-07 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390952+0000", 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.17e-06 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390958+0000", 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390963+0000", 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8629999999999999e-06 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.398 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222435 3.1c 3.32ac8ddc (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390969+0000", 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.001055486, 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014096009999999999, 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222435 2024-04-23T23:39:24.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390969+0000", 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390969+0000", 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390969+0000", 2024-04-23T23:39:24.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6399999999999998e-07 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390971+0000", 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390978+0000", 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2489999999999998e-06 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390983+0000", 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8910000000000003e-06 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:222428 3.1c 3:3bb1354c:::rbd_data.119414ff45cc.00000000000001a0:32 [read 180224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113)", 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:24.390808+0000", 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.001216988, 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016311330000000001, 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 222428 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390808+0000", 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390808+0000", 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390808+0000", 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390817+0000", 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8680000000000005e-06 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390825+0000", 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5950000000000001e-06 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.390831+0000", 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1299999999999998e-06 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:24.392410+0000", 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0015789739999999999 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 8 2024-04-23T23:39:24.405 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:24.406 INFO:teuthology.orchestra.run.smithi077.stdout:5531 clone 49 order 19 su 32768 sc 11 2024-04-23T23:39:24.407 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:24.451 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:24.463+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:24.508 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:24.508 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:24.508 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:24.508 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:24.508 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:24.517 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:24.517 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:24.529+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:24.618 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:24.631+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:24.661 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.854689824999999, 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159390 3.d 3:b6dfbb6e:::rbd_data.11943a52a299.0000000000000009:30 [read 3268608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.315023+0000", 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3583175169999997, 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057622829, 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159390 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315023+0000", 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315023+0000", 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315024+0000", 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7899999999999998e-07 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315027+0000", 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.472e-06 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315034+0000", 2024-04-23T23:39:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3779999999999998e-06 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315039+0000", 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372236+0000", 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057197018000000002 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372551+0000", 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00031490899999999999 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372646+0000", 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5131999999999997e-05 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159405 3.1d 3:bcc83cc3:::rbd_data.11943a52a299.000000000000000b:30 [read 3236864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.315144+0000", 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3581964480000002, 2024-04-23T23:39:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057338431000000002, 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159405 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315144+0000", 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315144+0000", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316019+0000", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00087469800000000003 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316024+0000", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6580000000000001e-06 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316044+0000", 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0863999999999999e-05 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316052+0000", 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9899999999999997e-06 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372308+0000", 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.056255538000000001 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372395+0000", 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7307999999999998e-05 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372483+0000", 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7374999999999996e-05 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159697 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.330585+0000", 2024-04-23T23:39:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3427552040000004, 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062867790000000007, 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159697 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330585+0000", 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330585+0000", 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330887+0000", 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00030158799999999999 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330898+0000", 2024-04-23T23:39:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.136e-05 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330909+0000", 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0705e-05 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330915+0000", 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393445+0000", 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062529888000000006 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393453+0000", 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9049999999999997e-06 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159698 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.330944+0000", 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3423966180000004, 2024-04-23T23:39:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062543163999999998, 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159698 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330944+0000", 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330944+0000", 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330945+0000", 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2799999999999996e-07 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330948+0000", 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0309999999999999e-06 2024-04-23T23:39:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330955+0000", 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.238e-06 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330961+0000", 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4840000000000001e-06 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393480+0000", 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062518435999999997 2024-04-23T23:39:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393487+0000", 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.447e-06 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159699 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.330971+0000", 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3423700219999999, 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062544927, 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159699 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330971+0000", 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330971+0000", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331501+0000", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053055400000000003 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331505+0000", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1749999999999998e-06 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331515+0000", 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0011e-05 2024-04-23T23:39:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331522+0000", 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0890000000000002e-06 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393508+0000", 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061985712999999998 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393516+0000", 2024-04-23T23:39:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3849999999999996e-06 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159700 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.331534+0000", 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3418065610000003, 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062007701999999998, 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159700 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331534+0000", 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331534+0000", 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331535+0000", 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1200000000000003e-07 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331537+0000", 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4499999999999998e-06 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331544+0000", 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7959999999999998e-06 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331549+0000", 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3800000000000002e-06 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393535+0000", 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061985798000000002 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393542+0000", 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7660000000000001e-06 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159710 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.331556+0000", 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.341784434, 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062016031999999999, 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159710 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331556+0000", 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331556+0000", 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331557+0000", 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331559+0000", 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0779999999999998e-06 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331565+0000", 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3980000000000004e-06 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331570+0000", 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1080000000000001e-06 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393565+0000", 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061994448000000001 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393572+0000", 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.576e-06 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159711 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.331577+0000", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3417640400000002, 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062024016000000001, 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159711 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331577+0000", 2024-04-23T23:39:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331577+0000", 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331844+0000", 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026689999999999998 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331848+0000", 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6539999999999998e-06 2024-04-23T23:39:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331857+0000", 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4740000000000005e-06 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331863+0000", 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7630000000000003e-06 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393592+0000", 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061728389000000002 2024-04-23T23:39:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393601+0000", 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8359999999999998e-06 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159712 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332089+0000", 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3412511809999996, 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061543016999999998, 2024-04-23T23:39:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159712 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332089+0000", 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332089+0000", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332090+0000", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5799999999999999e-07 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332094+0000", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.552e-06 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332102+0000", 2024-04-23T23:39:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0539999999999995e-06 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332108+0000", 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5629999999999997e-06 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393625+0000", 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061516690999999998 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393632+0000", 2024-04-23T23:39:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5989999999999996e-06 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159713 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332129+0000", 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.341211242, 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061530006999999998, 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159713 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332129+0000", 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332129+0000", 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332130+0000", 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332138+0000", 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1310000000000006e-06 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332145+0000", 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1969999999999999e-06 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332152+0000", 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5180000000000001e-06 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393652+0000", 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061500566999999999 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393659+0000", 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1470000000000004e-06 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159714 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332178+0000", 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3411622950000002, 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061507889000000003, 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159714 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332178+0000", 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332178+0000", 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332576+0000", 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039763800000000002 2024-04-23T23:39:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332581+0000", 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.062e-06 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332592+0000", 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0740000000000001e-05 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332599+0000", 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.148e-06 2024-04-23T23:39:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393679+0000", 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061080417999999997 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393686+0000", 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159715 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332611+0000", 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.340729498, 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061102712000000003, 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159715 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332611+0000", 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332611+0000", 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332612+0000", 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:39:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332614+0000", 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332621+0000", 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9500000000000004e-06 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332627+0000", 2024-04-23T23:39:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5539999999999997e-06 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393706+0000", 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061079732999999997 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393714+0000", 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4170000000000003e-06 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159716 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332634+0000", 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3407066170000004, 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061106413999999998, 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159716 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332634+0000", 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332634+0000", 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333305+0000", 2024-04-23T23:39:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000670825 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333309+0000", 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6140000000000002e-06 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333318+0000", 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.568e-06 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333324+0000", 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.285e-06 2024-04-23T23:39:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393733+0000", 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.060409138000000001 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393740+0000", 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159717 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.333337+0000", 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3400035739999998, 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.060429972999999998, 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159717 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333337+0000", 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333337+0000", 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333338+0000", 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333340+0000", 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7470000000000001e-06 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333347+0000", 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333352+0000", 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0950000000000003e-06 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393760+0000", 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.060408236999999997 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393767+0000", 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1160000000000001e-06 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159751 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3372149010000003, 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057671965999999998, 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159751 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336137+0000", 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1054e-05 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336144+0000", 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8299999999999998e-06 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336150+0000", 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393791+0000", 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057640907999999998 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393798+0000", 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0809999999999996e-06 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159753 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3369748890000004, 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057459524999999997, 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159753 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336369+0000", 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.078e-06 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336376+0000", 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4500000000000001e-06 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336381+0000", 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4099999999999999e-06 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393818+0000", 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057436755999999999 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393825+0000", 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3209999999999999e-06 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159754 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3369366630000004, 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057447610000000003, 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159754 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336407+0000", 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336413+0000", 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0950000000000001e-06 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336418+0000", 2024-04-23T23:39:24.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393845+0000", 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057426665000000002 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393852+0000", 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0509999999999999e-06 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159755 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3369159589999997, 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057453822000000002, 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159755 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:24.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336427+0000", 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9719999999999999e-06 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336433+0000", 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5790000000000003e-06 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336437+0000", 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393871+0000", 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057433937999999997 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393879+0000", 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2989999999999999e-06 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159756 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336443+0000", 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.3368973620000002, 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057461853, 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159756 2024-04-23T23:39:24.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336443+0000", 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336443+0000", 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336444+0000", 2024-04-23T23:39:24.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0400000000000002e-07 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336446+0000", 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0470000000000001e-06 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.337204+0000", 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075841500000000002 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.337213+0000", 2024-04-23T23:39:24.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5290000000000008e-06 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393898+0000", 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.056685467000000003 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393905+0000", 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9909999999999996e-06 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:24.741 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:24.742 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:24.743 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:24.755+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:24.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:24.844 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:24.857+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:24.846 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:24.846 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:24.846 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:24.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:24.945 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:24.958+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:24.957 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:24.957 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:24.957 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:24.957 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:24.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:25.046 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:25.059+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:25.049 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97726417299999, 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.075 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:25.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.977250528, 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:25.079 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:25.083 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97723747800001, 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:25.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97722645899999, 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:25.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.977217384, 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.092 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97720544000001, 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.096 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:25.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:25.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:25.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97719632899999, 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.100 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:25.104 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.975550957, 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:25.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:25.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.975538708, 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:25.112 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.971360115, 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.113 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:25.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:25.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97134833299999, 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.117 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.120 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.971338264, 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.121 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.124 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.971326605, 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:25.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.971317285, 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.132 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97130677299999, 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:25.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:25.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.971297333, 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:25.136 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97110223999999, 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.140 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:25.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:25.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.971081207, 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.144 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.97106731700001, 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:25.151 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 92.367910812000005, 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:25.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:25.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:25.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.156 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:25.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:25.158 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone48 from 0xb44677b (overlap 0x6dd59ba) to 0x62d9d8d 2024-04-23T23:39:25.158 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:25.170+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:25.258 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:25.271+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:226918 3.4 3:20bed9dd:::rbd_data.1194ff239744.000000000000018c:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,truncate 139264] snapc 33=[33] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:25.331475+0000", 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.002019818, 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0020431099999999999, 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.321 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 226918 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331475+0000", 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331475+0000", 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331475+0000", 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6000000000000003e-07 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331479+0000", 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6459999999999999e-06 2024-04-23T23:39:25.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331487+0000", 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0730000000000005e-06 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331494+0000", 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4399999999999999e-06 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331540+0000", 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330999999999997e-05 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331660+0000", 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012069399999999999 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.331825+0000", 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016422 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332687+0000", 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00086288399999999996 2024-04-23T23:39:25.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333429+0000", 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00074174799999999997 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333480+0000", 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0793e-05 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333518+0000", 2024-04-23T23:39:25.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620999999999998e-05 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:226913 3.16 e114/103 3:6bd77fe3:::rbd_data.1194ff239744.0000000000000187:head v 114'552, mlcod=112'550)", 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:25.332137+0000", 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0013574349999999999, 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014968679999999999, 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332137+0000", 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332137+0000", 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332137+0000", 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8400000000000004e-07 2024-04-23T23:39:25.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332142+0000", 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.386e-06 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332152+0000", 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.9429999999999995e-06 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332158+0000", 2024-04-23T23:39:25.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2099999999999998e-06 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332361+0000", 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00020268 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332377+0000", 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6395000000000001e-05 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:226919 3.0 3:00406312:::rbd_data.1194ff239744.000000000000018d:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,truncate 139264] snapc 33=[33] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:25.332404+0000", 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.001090424, 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001301202, 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 226919 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.331 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332404+0000", 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332404+0000", 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332405+0000", 2024-04-23T23:39:25.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7599999999999996e-07 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332410+0000", 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1939999999999997e-06 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332420+0000", 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0239e-05 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332427+0000", 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332468+0000", 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1347999999999998e-05 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332583+0000", 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000114521 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.332765+0000", 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00018194000000000001 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333413+0000", 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00064793000000000001 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333689+0000", 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000276338 2024-04-23T23:39:25.335 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:226920 3.18 3:18bc42e0:::rbd_data.1194ff239744.000000000000018e:head [call rbd.sparse_copyup in=24b,set-alloc-hint object_size 262144 write_size 262144,truncate 139264] snapc 33=[33] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:25.333331+0000", 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.00016292100000000001, 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00046963099999999998, 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.336 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 226920 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333331+0000", 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333331+0000", 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333332+0000", 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333338+0000", 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333352+0000", 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4307e-05 2024-04-23T23:39:25.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333360+0000", 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1310000000000006e-06 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333414+0000", 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4163999999999998e-05 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333527+0000", 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112464 2024-04-23T23:39:25.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333687+0000", 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016056100000000001 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop_reply(client.4500.0:226919 3.0 e114/21 ondisk, result = 0)", 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:25.333624+0000", 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4294967295.9998703, 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00023137, 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333624+0000", 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333624+0000", 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333624+0000", 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2300000000000001e-07 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333628+0000", 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7560000000000001e-06 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333637+0000", 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333642+0000", 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4070000000000001e-06 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333679+0000", 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6634000000000002e-05 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333685+0000", 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7660000000000004e-06 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333855+0000", 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017054900000000001 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:226921 3.18 3.503683f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:25.333710+0000", 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4294967295.9997845, 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000204806, 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:25.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "queued for pg", 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 226921 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333710+0000", 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:25.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333710+0000", 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333710+0000", 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000001e-07 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333715+0000", 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2379999999999999e-06 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333724+0000", 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4609999999999997e-06 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:25.333731+0000", 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4559999999999997e-06 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 6 2024-04-23T23:39:25.347 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:25.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:25.358 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:25.371+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:25.413 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #47, image image_client.0-clone47 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent48 2024-04-23T23:39:25.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:25.459 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:25.472+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:25.466 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:25.466 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:25.467 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:25.467 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:25.467 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:25.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:25.558 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:25.560 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:25.573+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:5536 read 0x193a272 thru 0x1949fa7 (0xfd36 bytes) 2024-04-23T23:39:25.575 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:25.576 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:25.577 INFO:teuthology.orchestra.run.smithi077.stdout:5539 write 0x7de5ebd thru 0x7df2cda (0xce1e bytes) 2024-04-23T23:39:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:5540 writesame 0xcff0d82 thru 0xcffa68e data_size 0x1(0x990d bytes) 2024-04-23T23:39:25.593 INFO:teuthology.orchestra.run.smithi077.stdout:5541 read 0x6dab859 thru 0x6db7fcb (0xc773 bytes) 2024-04-23T23:39:25.595 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:25.602 INFO:teuthology.orchestra.run.smithi077.stdout:5542 write 0xe579e71 thru 0xe582b1b (0x8cab bytes) 2024-04-23T23:39:25.605 INFO:teuthology.orchestra.run.smithi077.stdout:5544 punch from 0x3821603 to 0x38284c5, (0x6ec2 bytes) 2024-04-23T23:39:25.608 INFO:teuthology.orchestra.run.smithi077.stdout:5546 trunc from 0xe582b1c to 0xc5c0df5 2024-04-23T23:39:25.613 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:25.614 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:25.617 INFO:teuthology.orchestra.run.smithi077.stdout:5547 read 0x9adbef3 thru 0x9ae6dfc (0xaf0a bytes) 2024-04-23T23:39:25.619 INFO:teuthology.orchestra.run.smithi077.stdout:5549 trunc from 0xc5c0df5 to 0xe257ff9 2024-04-23T23:39:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:5551 read 0x5bf4e5f thru 0x5bf8910 (0x3ab2 bytes) 2024-04-23T23:39:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:5552 read 0x638f127 thru 0x639e739 (0xf613 bytes) 2024-04-23T23:39:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:5553 writesame 0x1f6c827 thru 0x1f6ce0b data_size 0x1(0x5e5 bytes) 2024-04-23T23:39:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:25.634 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:25.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:25.646 INFO:teuthology.orchestra.run.smithi077.stdout:5554 trunc from 0xe257ff9 to 0xa6c2d40 2024-04-23T23:39:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:25.661 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:25.674+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:5555 punch from 0x5b74328 to 0x5b7c863, (0x853b bytes) 2024-04-23T23:39:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:5556 clone 50 order 25 su 524288 sc 8 2024-04-23T23:39:25.673 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:25.674 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:25.676 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:25.677 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:25.748 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:25.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:25.799 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:25.812+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:25.858 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:25.862 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:25.875+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:25.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:25.963 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:25.976+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.010 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.019 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:26.064 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:26.076+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:26.122 INFO:teuthology.orchestra.run.smithi077.stdout:leaving image image_client.0-clone49 intact 2024-04-23T23:39:26.131 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.131 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.140 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:26.165 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:26.177+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:26.248 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.248 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.256 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #48, image image_client.0-clone48 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent49 2024-04-23T23:39:26.258 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:26.315 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:26.322+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:26.367 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:26.380+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:26.418 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.418 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.431 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:26.476 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:26.489+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:26.569 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:26.581+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:26.656 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.657 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:26.670 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:26.682+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:26.770 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:26.782+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:26.843 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.843 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.856 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:26.871 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:26.883+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:26.971 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:26.984+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:26.990 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:26.990 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:26.999 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:27.048 INFO:teuthology.orchestra.run.smithi077.stdout:5558 read 0x5a59708 thru 0x5a67bdf (0xe4d8 bytes) 2024-04-23T23:39:27.058 INFO:teuthology.orchestra.run.smithi077.stdout:5561 trunc from 0xa6c2d40 to 0x2694495 2024-04-23T23:39:27.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:39:27.108 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:27.120+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:27.173 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:27.185+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:27.188 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:27.188 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:27.202 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:27.290 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:27.303+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:27.374 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:27.386+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:27.424 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:27.424 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:27.437 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:27.475 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:27.487+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:27.576 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:27.588+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:27.635 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:27.644 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:27.676 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:27.689+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:27.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:27.746 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:27.746 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:27.755 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:27.777 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:27.789+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:27.796 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:27.813 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:27.813 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:27.832 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:27.832 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:27.832 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:27.856 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:27.857 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:27.878 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:27.890+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:27.885 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:27.886 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:27.900 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:27.952 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:27.952 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:27.977 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:27.978 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:27.979 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:27.991+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:28.002 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:28.002 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:28.005 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:28.006 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:28.069 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 19.269302832000001, 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.077 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159390 3.d 3:b6dfbb6e:::rbd_data.11943a52a299.0000000000000009:30 [read 3268608~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.315023+0000", 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7729305239999995, 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057622829, 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.082 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159390 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315023+0000", 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315023+0000", 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315024+0000", 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7899999999999998e-07 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315027+0000", 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.472e-06 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315034+0000", 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3779999999999998e-06 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315039+0000", 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3410000000000002e-06 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372236+0000", 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057197018000000002 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372551+0000", 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00031490899999999999 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372646+0000", 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5131999999999997e-05 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.086 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159405 3.1d 3:bcc83cc3:::rbd_data.11943a52a299.000000000000000b:30 [read 3236864~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.315144+0000", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7728094550000009, 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057338431000000002, 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159405 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315144+0000", 2024-04-23T23:39:28.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.315144+0000", 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316019+0000", 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00087469800000000003 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316024+0000", 2024-04-23T23:39:28.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6580000000000001e-06 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316044+0000", 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0863999999999999e-05 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.316052+0000", 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9899999999999997e-06 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372308+0000", 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.056255538000000001 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372395+0000", 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7307999999999998e-05 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.372483+0000", 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7374999999999996e-05 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.090 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159697 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.330585+0000", 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7573682109999993, 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062867790000000007, 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159697 2024-04-23T23:39:28.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330585+0000", 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330585+0000", 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330887+0000", 2024-04-23T23:39:28.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00030158799999999999 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330898+0000", 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.136e-05 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330909+0000", 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0705e-05 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330915+0000", 2024-04-23T23:39:28.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3439999999999997e-06 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393445+0000", 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062529888000000006 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393453+0000", 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9049999999999997e-06 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159698 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.330944+0000", 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7570096250000002, 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062543163999999998, 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159698 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330944+0000", 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330944+0000", 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330945+0000", 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2799999999999996e-07 2024-04-23T23:39:28.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330948+0000", 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0309999999999999e-06 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330955+0000", 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.238e-06 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330961+0000", 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4840000000000001e-06 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393480+0000", 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062518435999999997 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393487+0000", 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.447e-06 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.098 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159699 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.330971+0000", 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7569830290000006, 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062544927, 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159699 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330971+0000", 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.330971+0000", 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331501+0000", 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053055400000000003 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331505+0000", 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1749999999999998e-06 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331515+0000", 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0011e-05 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331522+0000", 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0890000000000002e-06 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393508+0000", 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061985712999999998 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393516+0000", 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3849999999999996e-06 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159700 3.d 3.76ddfb6d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.102 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.331534+0000", 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7564195680000001, 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062007701999999998, 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159700 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331534+0000", 2024-04-23T23:39:28.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331534+0000", 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331535+0000", 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1200000000000003e-07 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331537+0000", 2024-04-23T23:39:28.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4499999999999998e-06 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331544+0000", 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7959999999999998e-06 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331549+0000", 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3800000000000002e-06 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393535+0000", 2024-04-23T23:39:28.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061985798000000002 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393542+0000", 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7660000000000001e-06 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159710 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.331556+0000", 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7563974410000007, 2024-04-23T23:39:28.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062016031999999999, 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159710 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331556+0000", 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331556+0000", 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331557+0000", 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331559+0000", 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0779999999999998e-06 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331565+0000", 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3980000000000004e-06 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331570+0000", 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1080000000000001e-06 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393565+0000", 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061994448000000001 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393572+0000", 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.576e-06 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159711 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.331577+0000", 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7563770470000009, 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.062024016000000001, 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.110 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159711 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331577+0000", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331577+0000", 2024-04-23T23:39:28.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331844+0000", 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026689999999999998 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331848+0000", 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6539999999999998e-06 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331857+0000", 2024-04-23T23:39:28.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4740000000000005e-06 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.331863+0000", 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7630000000000003e-06 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393592+0000", 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061728389000000002 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393601+0000", 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8359999999999998e-06 2024-04-23T23:39:28.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159712 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332089+0000", 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7558641880000003, 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061543016999999998, 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.114 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159712 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332089+0000", 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332089+0000", 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332090+0000", 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5799999999999999e-07 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332094+0000", 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.552e-06 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332102+0000", 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0539999999999995e-06 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332108+0000", 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5629999999999997e-06 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393625+0000", 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061516690999999998 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393632+0000", 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5989999999999996e-06 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159713 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332129+0000", 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7558242489999998, 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061530006999999998, 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159713 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332129+0000", 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332129+0000", 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332130+0000", 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332138+0000", 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1310000000000006e-06 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332145+0000", 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1969999999999999e-06 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332152+0000", 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5180000000000001e-06 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393652+0000", 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061500566999999999 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393659+0000", 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1470000000000004e-06 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.121 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159714 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332178+0000", 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.755775302, 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061507889000000003, 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159714 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332178+0000", 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332178+0000", 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332576+0000", 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039763800000000002 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332581+0000", 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.062e-06 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332592+0000", 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0740000000000001e-05 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332599+0000", 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.148e-06 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393679+0000", 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061080417999999997 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393686+0000", 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.125 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159715 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332611+0000", 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7553425049999998, 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061102712000000003, 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159715 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332611+0000", 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332611+0000", 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332612+0000", 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:39:28.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332614+0000", 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332621+0000", 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9500000000000004e-06 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332627+0000", 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5539999999999997e-06 2024-04-23T23:39:28.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393706+0000", 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061079732999999997 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393714+0000", 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4170000000000003e-06 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.129 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159716 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.332634+0000", 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7553196240000002, 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.061106413999999998, 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159716 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332634+0000", 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.332634+0000", 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333305+0000", 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000670825 2024-04-23T23:39:28.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333309+0000", 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6140000000000002e-06 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333318+0000", 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.568e-06 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333324+0000", 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.285e-06 2024-04-23T23:39:28.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393733+0000", 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.060409138000000001 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393740+0000", 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159717 3.1d 3.c33c133d (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.333337+0000", 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7546165810000005, 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.060429972999999998, 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159717 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333337+0000", 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333337+0000", 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333338+0000", 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9800000000000004e-07 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333340+0000", 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7470000000000001e-06 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333347+0000", 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.333352+0000", 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0950000000000003e-06 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393760+0000", 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.060408236999999997 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393767+0000", 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1160000000000001e-06 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159751 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7518279079999992, 2024-04-23T23:39:28.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057671965999999998, 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159751 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336126+0000", 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336137+0000", 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1054e-05 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336144+0000", 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8299999999999998e-06 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336150+0000", 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5380000000000002e-06 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393791+0000", 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057640907999999998 2024-04-23T23:39:28.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393798+0000", 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0809999999999996e-06 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159753 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7515878960000002, 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057459524999999997, 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.141 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159753 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336366+0000", 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336369+0000", 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.078e-06 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336376+0000", 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4500000000000001e-06 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336381+0000", 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4099999999999999e-06 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393818+0000", 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057436755999999999 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393825+0000", 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3209999999999999e-06 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159754 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7515496699999993, 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057447610000000003, 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159754 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336404+0000", 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336407+0000", 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.48e-06 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336413+0000", 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0950000000000001e-06 2024-04-23T23:39:28.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336418+0000", 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393845+0000", 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057426665000000002 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393852+0000", 2024-04-23T23:39:28.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0509999999999999e-06 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159755 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.7515289660000004, 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057453822000000002, 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159755 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336425+0000", 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336427+0000", 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9719999999999999e-06 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336433+0000", 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5790000000000003e-06 2024-04-23T23:39:28.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336437+0000", 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393871+0000", 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057433937999999997 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393879+0000", 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2989999999999999e-06 2024-04-23T23:39:28.152 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:159756 3.1d 3.fb61c9bd (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.336443+0000", 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.751510369, 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.057461853, 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.153 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 159756 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336443+0000", 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336443+0000", 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:28.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336444+0000", 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0400000000000002e-07 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.336446+0000", 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0470000000000001e-06 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.337204+0000", 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075841500000000002 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.337213+0000", 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5290000000000008e-06 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393898+0000", 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.056685467000000003 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.393905+0000", 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9909999999999996e-06 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:28.156 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:28.157 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:28.158 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:28.171+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:28.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:28.259 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:28.271+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:28.275 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:28.275 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:28.275 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:28.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:28.292 INFO:teuthology.orchestra.run.smithi077.stdout:5562 write 0x56427d3 thru 0x5646033 (0x3861 bytes) 2024-04-23T23:39:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:5563 read 0x2e94520 thru 0x2e9b5b4 (0x7095 bytes) 2024-04-23T23:39:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:5566 read 0x2013364 thru 0x2022c2e (0xf8cb bytes) 2024-04-23T23:39:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.294 INFO:teuthology.orchestra.run.smithi077.stdout:5571 read 0x4bc7fcc thru 0x4bca9df (0x2a14 bytes) 2024-04-23T23:39:28.297 INFO:teuthology.orchestra.run.smithi077.stdout:5573 trunc from 0x5646034 to 0x2774c8a 2024-04-23T23:39:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:5574 read 0x2010c7c thru 0x2018107 (0x748c bytes) 2024-04-23T23:39:28.305 INFO:teuthology.orchestra.run.smithi077.stdout:5575 punch from 0x9a7b72 to 0x9afae3, (0x7f71 bytes) 2024-04-23T23:39:28.316 INFO:teuthology.orchestra.run.smithi077.stdout:5577 writesame 0x7492d66 thru 0x749a9d0 data_size 0x3(0x7c6b bytes) 2024-04-23T23:39:28.328 INFO:teuthology.orchestra.run.smithi077.stdout:5578 write 0xc9a2787 thru 0xc9a4e5f (0x26d9 bytes) 2024-04-23T23:39:28.330 INFO:teuthology.orchestra.run.smithi077.stdout:5580 write 0x8011880 thru 0x8016af8 (0x5279 bytes) 2024-04-23T23:39:28.331 INFO:teuthology.orchestra.run.smithi077.stdout:5582 read 0xf17a39 thru 0xf1fc36 (0x81fe bytes) 2024-04-23T23:39:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.332 INFO:teuthology.orchestra.run.smithi077.stdout:5585 write 0x610f7f2 thru 0x611a6cf (0xaede bytes) 2024-04-23T23:39:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:5586 punch from 0x6b8589f to 0x6b8bfb3, (0x6714 bytes) 2024-04-23T23:39:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:5587 read 0x1ac17cd thru 0x1ac2dbe (0x15f2 bytes) 2024-04-23T23:39:28.334 INFO:teuthology.orchestra.run.smithi077.stdout:5590 punch from 0x6cbd78e to 0x6cbd8a2, (0x114 bytes) 2024-04-23T23:39:28.334 INFO:teuthology.orchestra.run.smithi077.stdout:5593 write 0x661b0cc thru 0x6627b25 (0xca5a bytes) 2024-04-23T23:39:28.336 INFO:teuthology.orchestra.run.smithi077.stdout:5594 write 0x95f0101 thru 0x95f547f (0x537f bytes) 2024-04-23T23:39:28.339 INFO:teuthology.orchestra.run.smithi077.stdout:5595 read 0x2cb83cc thru 0x2cc0239 (0x7e6e bytes) 2024-04-23T23:39:28.347 INFO:teuthology.orchestra.run.smithi077.stdout:5596 write 0xed26694 thru 0xed2abf3 (0x4560 bytes) 2024-04-23T23:39:28.349 INFO:teuthology.orchestra.run.smithi077.stdout:5598 write 0xbd9a9ab thru 0xbda4af6 (0xa14c bytes) 2024-04-23T23:39:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:5599 read 0x47089be thru 0x4716320 (0xd963 bytes) 2024-04-23T23:39:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:5600 writesame 0x5502892 thru 0x5506115 data_size 0x2(0x3884 bytes) 2024-04-23T23:39:28.356 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.358 INFO:teuthology.orchestra.run.smithi077.stdout:5603 trunc from 0xed2abf4 to 0xd5e5645 2024-04-23T23:39:28.360 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:28.372+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:5607 punch from 0x2e9eb7d to 0x2ea0cde, (0x2161 bytes) 2024-04-23T23:39:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:5608 read 0xaaee057 thru 0xaaeec14 (0xbbe bytes) 2024-04-23T23:39:28.365 INFO:teuthology.orchestra.run.smithi077.stdout:5610 writesame 0x1e986e1 thru 0x1ea6b24 data_size 0xe(0xe444 bytes) 2024-04-23T23:39:28.368 INFO:teuthology.orchestra.run.smithi077.stdout:5611 writesame 0x35c1e60 thru 0x35c75d8 data_size 0x7(0x5779 bytes) 2024-04-23T23:39:28.376 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4] out_osds: [3, 0, 7] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:28.376 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:28.376 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-04-23T23:39:28.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-04-23T23:39:28.379 INFO:teuthology.orchestra.run.smithi077.stdout:5612 trunc from 0xd5e5645 to 0x6cf1d3f 2024-04-23T23:39:28.397 INFO:teuthology.orchestra.run.smithi077.stdout:5614 write 0xb6eea39 thru 0xb6f9331 (0xa8f9 bytes) 2024-04-23T23:39:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:5615 punch from 0xb54ec2b to 0xb55c04a, (0xd41f bytes) 2024-04-23T23:39:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:5616 read 0x6f0283b thru 0x6f0ca3d (0xa203 bytes) 2024-04-23T23:39:28.405 INFO:teuthology.orchestra.run.smithi077.stdout:5619 writesame 0xc2d37d9 thru 0xc2df53b data_size 0x3(0xbd63 bytes) 2024-04-23T23:39:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:5623 punch from 0x85578a6 to 0x8563d5f, (0xc4b9 bytes) 2024-04-23T23:39:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:5624 read 0x95e3a59 thru 0x95e5257 (0x17ff bytes) 2024-04-23T23:39:28.407 INFO:teuthology.orchestra.run.smithi077.stdout:5626 write 0x8968f43 thru 0x8977a13 (0xead1 bytes) 2024-04-23T23:39:28.408 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:28.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:28.408 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:28.408 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:5628 punch from 0x75fa6bf to 0x7609be2, (0xf523 bytes) 2024-04-23T23:39:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.409 INFO:teuthology.orchestra.run.smithi077.stdout:5630 writesame 0x389c652 thru 0x38a4e94 data_size 0x1(0x8843 bytes) 2024-04-23T23:39:28.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:5631 read 0x4b25efb thru 0x4b32c00 (0xcd06 bytes) 2024-04-23T23:39:28.423 INFO:teuthology.orchestra.run.smithi077.stdout:5632 read 0x6b5356 thru 0x6b71dd (0x1e88 bytes) 2024-04-23T23:39:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:5633 read 0x32c56da thru 0x32d2e9f (0xd7c6 bytes) 2024-04-23T23:39:28.425 INFO:teuthology.orchestra.run.smithi077.stdout:5634 write 0x637c1fe thru 0x6383c31 (0x7a34 bytes) 2024-04-23T23:39:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:5636 punch from 0x7bf5107 to 0x7bf9dcb, (0x4cc4 bytes) 2024-04-23T23:39:28.426 INFO:teuthology.orchestra.run.smithi077.stdout:5638 write 0x1c45f88 thru 0x1c4b9fc (0x5a75 bytes) 2024-04-23T23:39:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:5639 read 0x780d614 thru 0x7814b80 (0x756d bytes) 2024-04-23T23:39:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.428 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.436 INFO:teuthology.orchestra.run.smithi077.stdout:5642 write 0xe2a6a39 thru 0xe2b5061 (0xe629 bytes) 2024-04-23T23:39:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:5643 read 0x9b1a0f7 thru 0x9b1e841 (0x474b bytes) 2024-04-23T23:39:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:5645 read 0xda49cf3 thru 0xda5899c (0xecaa bytes) 2024-04-23T23:39:28.438 INFO:teuthology.orchestra.run.smithi077.stdout:5646 write 0x2cd4160 thru 0x2cd7fe4 (0x3e85 bytes) 2024-04-23T23:39:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:5647 read 0xd6ec2e3 thru 0xd6eefc7 (0x2ce5 bytes) 2024-04-23T23:39:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:5648 punch from 0x2e45880 to 0x2e528e7, (0xd067 bytes) 2024-04-23T23:39:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:5650 read 0x2e3f894 thru 0x2e481c6 (0x8933 bytes) 2024-04-23T23:39:28.440 INFO:teuthology.orchestra.run.smithi077.stdout:5651 read 0xbe23b24 thru 0xbe32031 (0xe50e bytes) 2024-04-23T23:39:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:5654 read 0x9b37b33 thru 0x9b3e210 (0x66de bytes) 2024-04-23T23:39:28.441 INFO:teuthology.orchestra.run.smithi077.stdout:5658 read 0x4b81c97 thru 0x4b87333 (0x569d bytes) 2024-04-23T23:39:28.446 INFO:teuthology.orchestra.run.smithi077.stdout:5659 write 0xe369909 thru 0xe378461 (0xeb59 bytes) 2024-04-23T23:39:28.448 INFO:teuthology.orchestra.run.smithi077.stdout:5660 write 0x41cec40 thru 0x41d50af (0x6470 bytes) 2024-04-23T23:39:28.455 INFO:teuthology.orchestra.run.smithi077.stdout:5661 writesame 0xe469ab9 thru 0xe476cc4 data_size 0x6(0xd20c bytes) 2024-04-23T23:39:28.456 INFO:teuthology.orchestra.run.smithi077.stdout:5662 read 0xd6bf382 thru 0xd6cc1bb (0xce3a bytes) 2024-04-23T23:39:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:5663 punch from 0xb8f08ee to 0xb8f395d, (0x306f bytes) 2024-04-23T23:39:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:5664 punch from 0x73a894 to 0x74a224, (0xf990 bytes) 2024-04-23T23:39:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:5665 punch from 0x29aca5c to 0x29b04b0, (0x3a54 bytes) 2024-04-23T23:39:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:5666 read 0xbcbb98f thru 0xbcbf7bb (0x3e2d bytes) 2024-04-23T23:39:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:5667 punch from 0xcff0aff to 0xcff3051, (0x2552 bytes) 2024-04-23T23:39:28.457 INFO:teuthology.orchestra.run.smithi077.stdout:5668 write 0xa486bcc thru 0xa4936f0 (0xcb25 bytes) 2024-04-23T23:39:28.458 INFO:teuthology.orchestra.run.smithi077.stdout:5669 read 0xe2a6f93 thru 0xe2af547 (0x85b5 bytes) 2024-04-23T23:39:28.461 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:28.474+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:28.462 INFO:teuthology.orchestra.run.smithi077.stdout:5670 trunc from 0xe476cc5 to 0xb91db11 2024-04-23T23:39:28.470 INFO:teuthology.orchestra.run.smithi077.stdout:5673 read 0x11e5c7c thru 0x11f3446 (0xd7cb bytes) 2024-04-23T23:39:28.479 INFO:teuthology.orchestra.run.smithi077.stdout:5674 trunc from 0xb91db11 to 0x4e138ab 2024-04-23T23:39:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:5675 read 0xadbc11 thru 0xae3a9f (0x7e8f bytes) 2024-04-23T23:39:28.487 INFO:teuthology.orchestra.run.smithi077.stdout:5676 clone 51 order 23 su 262144 sc 9 2024-04-23T23:39:28.553 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:28.553 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:28.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.455599654, 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:28.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:28.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:28.558 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.455586009, 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:28.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.562 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.45557295899999, 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.563 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.45556194, 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.567 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.571 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.455552865, 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:28.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:28.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.577 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.45554092099999, 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:28.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:28.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.45553181, 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.583 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.587 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.453886438, 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.590 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.591 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.453874189, 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.592 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:28.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:28.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:28.595 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449695596, 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:28.599 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449683814, 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.600 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449673745, 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.604 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:28.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:28.608 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449662086, 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.609 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.612 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449652766, 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:28.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:28.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449642254, 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449632814, 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:28.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:28.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449437721, 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.625 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:28.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:28.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.449416688, 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.632 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 107.44940279799999, 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:28.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:28.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:28.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 95.846246292999993, 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:28.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:28.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:28.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.641 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.642 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:28.642 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:28.642 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:28.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:28.644 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:28.655+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:28.711 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:39:28.723+0000 7f7374a68640 -1 mon.a@0(leader).osd e116 definitely_dead 0 2024-04-23T23:39:28.745 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:28.757+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:28.786 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:28.786 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:28.786 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:28.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:28.845 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:28.858+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:28.938 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:28.938 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:28.938 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:28.938 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:28.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:28.947 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:28.959+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:29.048 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:29.060+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:29.050 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:29.050 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:29.050 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:29.050 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:29.050 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.050 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 100.66797027, 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.051 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.052 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 91.669319642000005, 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.056 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.061 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 70.229666229000003, 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.062 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:29.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:29.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90590 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3441664~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.060132674000002, 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051386827000000003, 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.068 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90590 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001684+0000", 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001690+0000", 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1480000000000003e-06 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001694+0000", 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052909+0000", 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051214519 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052978+0000", 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8738000000000005e-05 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.053068+0000", 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0068000000000006e-05 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90651 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3556352~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:29.072 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.056250032000001, 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051409877, 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90651 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005566+0000", 2024-04-23T23:39:29.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9489999999999999e-06 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005572+0000", 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1179999999999997e-06 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005577+0000", 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7060000000000003e-06 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056808+0000", 2024-04-23T23:39:29.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051230879999999999 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056879+0000", 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1261999999999996e-05 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056973+0000", 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4569999999999997e-05 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90653 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3563520~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.056230911, 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051620653000000002, 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90653 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005585+0000", 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.883e-06 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005591+0000", 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005596+0000", 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:29.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057017+0000", 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051421175999999999 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057094+0000", 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7040999999999996e-05 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057203+0000", 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010935 2024-04-23T23:39:29.080 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90655 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3570688~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.056212260999999, 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051736068000000003, 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.081 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90655 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005602+0000", 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005603+0000", 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005609+0000", 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005614+0000", 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6190000000000002e-06 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057238+0000", 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051623872000000001 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057281+0000", 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3259e-05 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057337+0000", 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6298999999999997e-05 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90662 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3613696~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.054628074999997, 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051308223, 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90662 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007186+0000", 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007188+0000", 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.945e-06 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007195+0000", 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:39:29.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007200+0000", 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058336+0000", 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051136231999999997 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058404+0000", 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8613000000000002e-05 2024-04-23T23:39:29.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058494+0000", 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9314999999999994e-05 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90663 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3620864~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.054606900000003, 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051524557999999998, 2024-04-23T23:39:29.089 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90663 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007209+0000", 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.813e-06 2024-04-23T23:39:29.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007215+0000", 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3899999999999998e-06 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007220+0000", 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8189999999999999e-06 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058536+0000", 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051315847999999997 2024-04-23T23:39:29.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058621+0000", 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5453999999999999e-05 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058731+0000", 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010982800000000001 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.093 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90664 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3628032~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.054587683000001, 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051704831, 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90664 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007228+0000", 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.829e-06 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007233+0000", 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007238+0000", 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5159999999999996e-06 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058770+0000", 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051532124999999998 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058839+0000", 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9356999999999993e-05 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058931+0000", 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1230000000000006e-05 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.097 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90665 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3635200~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.054569790000002, 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051935859000000001, 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90665 2024-04-23T23:39:29.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008976+0000", 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017323939999999999 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008980+0000", 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0910000000000003e-06 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008987+0000", 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.131e-06 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008992+0000", 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6670000000000004e-06 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058981+0000", 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049988772000000001 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059068+0000", 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7640999999999997e-05 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059180+0000", 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011116300000000001 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90674 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4484096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.052630088999997, 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051442084999999999, 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.102 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90674 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009184+0000", 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009186+0000", 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009192+0000", 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:39:29.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009198+0000", 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060463+0000", 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051264788999999998 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060543+0000", 2024-04-23T23:39:29.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0344000000000002e-05 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060626+0000", 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2576000000000004e-05 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90675 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4491264~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.052609326000002, 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051599027999999998, 2024-04-23T23:39:29.106 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90675 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009205+0000", 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009207+0000", 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009212+0000", 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7479999999999999e-06 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009218+0000", 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1919999999999996e-06 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060663+0000", 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051445554999999997 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060732+0000", 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9041000000000005e-05 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060803+0000", 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1135000000000002e-05 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.110 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90676 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4498432~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.052590348000003, 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051792194999999999, 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90676 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009224+0000", 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009225+0000", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009232+0000", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5089999999999999e-06 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009238+0000", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060845+0000", 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051607346999999998 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060927+0000", 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1644999999999995e-05 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061015+0000", 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8642999999999998e-05 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.114 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90677 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4505600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.052569761999997, 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051967037000000001, 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90677 2024-04-23T23:39:29.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010979+0000", 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017348070000000001 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010985+0000", 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010995+0000", 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0370000000000001e-05 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011002+0000", 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2960000000000001e-06 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061051+0000", 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.050048603999999997 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061134+0000", 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3219000000000004e-05 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061211+0000", 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6724999999999995e-05 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90686 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4562944~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:29.119 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.050561043999998, 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051380604000000003, 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90686 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011253+0000", 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.34e-07 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011254+0000", 2024-04-23T23:39:29.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011258+0000", 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7050000000000001e-06 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011261+0000", 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9349999999999999e-06 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062492+0000", 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051231454000000003 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062563+0000", 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0461000000000002e-05 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062633+0000", 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0548000000000003e-05 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90687 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4570112~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.050549899000004, 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051576652000000001, 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90687 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9299999999999999e-07 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011265+0000", 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2109999999999999e-06 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011268+0000", 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1470000000000001e-06 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011271+0000", 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6309999999999999e-06 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062678+0000", 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051406962 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062759+0000", 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0803000000000005e-05 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062840+0000", 2024-04-23T23:39:29.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1605000000000002e-05 2024-04-23T23:39:29.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.128 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.129 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90688 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4577280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:29.129 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.05053977, 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051748664999999999, 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90688 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012977+0000", 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017037109999999999 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012982+0000", 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5979999999999999e-06 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013006+0000", 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4300000000000001e-05 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013015+0000", 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4649999999999994e-06 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062879+0000", 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049864420999999999 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062949+0000", 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9728999999999996e-05 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.063022+0000", 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3441000000000004e-05 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.133 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 28.167806457000001, 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.134 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.194976938, 2024-04-23T23:39:29.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:39:29.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:39:29.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:39:29.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.144 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:29.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:29.147 INFO:teuthology.orchestra.run.smithi077.stderr:marked in osd.7. 2024-04-23T23:39:29.147 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-04-23T23:39:29.190 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:29.202+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:29.249 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:29.261+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:29.291 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:29.291 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:29.291 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:29.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:29.384 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:29.396+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:29.441 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:29.442 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:29.442 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:29.442 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:29.442 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:29.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:29.451 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:29.463+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:29.551 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:29.563+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:29.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 101.196822633, 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:29.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:29.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 92.197126779000001, 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.599 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:29.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:29.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:29.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 79.517869681999997, 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:39:29.603 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:39:29.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.607 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336671490000001, 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:39:29.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:39:29.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336643303999999, 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:39:29.612 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:39:29.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:39:29.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:39:29.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336627599000003, 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.617 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:39:29.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336616616000001, 2024-04-23T23:39:29.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336602245000002, 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336564906, 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.631 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:39:29.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:39:29.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336542586999997, 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:39:29.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.639 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336515372999997, 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:29.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:39:29.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336495319999997, 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:29.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:39:29.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336475943000003, 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:39:29.648 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:39:29.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.336456519000002, 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:29.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 56.425107369999999, 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.657 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:39:29.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:39:29.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:39:29.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:39:29.661 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.217265142000002, 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:39:29.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:39:29.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.049266123000002, 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.666 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:29.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:29.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:29.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.030697891999999, 2024-04-23T23:39:29.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.674 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.354199323, 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:29.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:39:29.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 1.349573675, 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:29.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:39:29.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:39:29.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:29.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:29.683 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:29.684 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:29.685 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:29.697+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:29.786 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:29.798+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:29.798 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:29.799 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:29.799 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:29.799 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:29.808 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:29.886 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:29.899+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:29.910 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:29.910 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:29.910 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:29.910 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:29.911 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:29.919 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:30.003 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:30.016+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:30.007 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:30.064 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 85.087302428000001, 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:30.065 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:30.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:30.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 30.183548010999999, 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.072 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:30.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:30.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:30.076 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 20.067297761999999, 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:30.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171143 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4296704~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116111+0000", 2024-04-23T23:39:30.081 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9601037629999993, 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069801009999999997, 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171143 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116111+0000", 2024-04-23T23:39:30.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116111+0000", 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116111+0000", 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116113+0000", 2024-04-23T23:39:30.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.057e-06 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116120+0000", 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1380000000000001e-06 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116125+0000", 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9429999999999999e-06 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.185753+0000", 2024-04-23T23:39:30.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069627748000000003 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.185849+0000", 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5477999999999996e-05 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.185912+0000", 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3225000000000005e-05 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171144 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4312064~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116132+0000", 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9600830729999998, 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069970276999999997, 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171144 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.086 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116132+0000", 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116132+0000", 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116132+0000", 2024-04-23T23:39:30.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116134+0000", 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116140+0000", 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116145+0000", 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:39:30.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.185948+0000", 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069802815000000004 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186021+0000", 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2706999999999994e-05 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186102+0000", 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0988000000000005e-05 2024-04-23T23:39:30.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171189 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 3955712~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116548+0000", 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9596663420000002, 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069901851000000001, 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171189 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116548+0000", 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116548+0000", 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116550+0000", 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116552+0000", 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1679999999999998e-06 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116558+0000", 2024-04-23T23:39:30.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4130000000000003e-06 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116563+0000", 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1880000000000001e-06 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186283+0000", 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069720167999999999 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186358+0000", 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4719000000000001e-05 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186450+0000", 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1964000000000002e-05 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171190 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 3971072~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116570+0000", 2024-04-23T23:39:30.094 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9596448110000004, 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070036801999999995, 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171190 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116570+0000", 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116570+0000", 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116570+0000", 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4400000000000001e-07 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116572+0000", 2024-04-23T23:39:30.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9460000000000001e-06 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116579+0000", 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116585+0000", 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5570000000000003e-06 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186484+0000", 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069898863000000006 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186545+0000", 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1476999999999994e-05 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186607+0000", 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1434999999999997e-05 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.098 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171191 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 3986432~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116591+0000", 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9596233420000004, 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070175733000000004, 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.099 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171191 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116591+0000", 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116591+0000", 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116592+0000", 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6899999999999998e-07 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116594+0000", 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.029e-06 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116600+0000", 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.998e-06 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116606+0000", 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9649999999999996e-06 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186630+0000", 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070023963999999994 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186691+0000", 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1446999999999996e-05 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186767+0000", 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5860999999999998e-05 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171192 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4017152~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116612+0000", 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9596021510000003, 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070314369000000002, 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.103 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171192 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116612+0000", 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116612+0000", 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116613+0000", 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116615+0000", 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.995e-06 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116621+0000", 2024-04-23T23:39:30.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1829999999999999e-06 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116627+0000", 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3980000000000004e-06 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186799+0000", 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070171222000000005 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186863+0000", 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4709000000000007e-05 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186927+0000", 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3462999999999999e-05 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171193 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4001792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116634+0000", 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9595809370000001, 2024-04-23T23:39:30.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070432081999999993, 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171193 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116634+0000", 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116634+0000", 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116634+0000", 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116636+0000", 2024-04-23T23:39:30.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9350000000000001e-06 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116642+0000", 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9499999999999998e-06 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116647+0000", 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.916e-06 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.186951+0000", 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070304053000000005 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187004+0000", 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3297999999999997e-05 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187066+0000", 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1511000000000001e-05 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171194 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4032512~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116653+0000", 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9595618130000005, 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070559755000000002, 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171194 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.112 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116653+0000", 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116653+0000", 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116653+0000", 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3099999999999998e-07 2024-04-23T23:39:30.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116655+0000", 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116661+0000", 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0379999999999996e-06 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116667+0000", 2024-04-23T23:39:30.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3539999999999999e-06 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187090+0000", 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070423105999999999 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187150+0000", 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0244000000000001e-05 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.187213+0000", 2024-04-23T23:39:30.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2465000000000006e-05 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171195 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4047872~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.116673+0000", 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9595419280000002, 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.071863943999999999, 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171195 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116673+0000", 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116673+0000", 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116673+0000", 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116675+0000", 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8929999999999999e-06 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116681+0000", 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0650000000000004e-06 2024-04-23T23:39:30.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.116686+0000", 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5820000000000003e-06 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188363+0000", 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.071677155000000006 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188447+0000", 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4328999999999998e-05 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.188537+0000", 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9485000000000001e-05 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171298 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4188160~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.122806+0000", 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.953408671, 2024-04-23T23:39:30.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.071331285999999994, 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171298 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.122806+0000", 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.122806+0000", 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.122806+0000", 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.122808+0000", 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1040000000000001e-06 2024-04-23T23:39:30.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.122815+0000", 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.122821+0000", 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3530000000000002e-06 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.193037+0000", 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070216789000000002 2024-04-23T23:39:30.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.194057+0000", 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0010195600000000001 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.194137+0000", 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0245000000000002e-05 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.124 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171451 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4048896~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.130344+0000", 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9458710769999996, 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069956985999999999, 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171451 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.130344+0000", 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.130344+0000", 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.130344+0000", 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.130346+0000", 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0040000000000002e-06 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.130353+0000", 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4499999999999998e-06 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.130359+0000", 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200122+0000", 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.069763045999999995 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200213+0000", 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1096999999999999e-05 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.200301+0000", 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7624e-05 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.128 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171807 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4144128~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.142718+0000", 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9334962769999997, 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.071835261999999997, 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171807 2024-04-23T23:39:30.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142718+0000", 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142718+0000", 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142719+0000", 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4600000000000005e-07 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142721+0000", 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9530000000000002e-06 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142728+0000", 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4780000000000002e-06 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142734+0000", 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1290000000000001e-06 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.211409+0000", 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.068674177000000003 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.211487+0000", 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8647999999999996e-05 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214554+0000", 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0030663309999999998 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171808 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4159488~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.142741+0000", 2024-04-23T23:39:30.133 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9334737939999993, 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.072012533000000004, 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171808 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142741+0000", 2024-04-23T23:39:30.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142741+0000", 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142741+0000", 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142743+0000", 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0360000000000001e-06 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142749+0000", 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7540000000000003e-06 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142754+0000", 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9479999999999999e-06 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214584+0000", 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.071830499000000006 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214663+0000", 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8257999999999995e-05 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214753+0000", 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0603e-05 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171809 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4174848~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.142761+0000", 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9334533490000005, 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.072188749999999996, 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171809 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142761+0000", 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142761+0000", 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142773+0000", 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1309e-05 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142775+0000", 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3010000000000001e-06 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142782+0000", 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8070000000000002e-06 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142787+0000", 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4609999999999999e-06 2024-04-23T23:39:30.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214782+0000", 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.071994452 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214859+0000", 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7187999999999993e-05 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.214950+0000", 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1231999999999997e-05 2024-04-23T23:39:30.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:171810 3.a 3:5594891f:::rbd_data.11943a52a299.0000000000000000:30 [read 4190208~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.142794+0000", 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9334204699999997, 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.073288628999999994, 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 171810 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142794+0000", 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142794+0000", 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142795+0000", 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5499999999999998e-07 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142812+0000", 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7076e-05 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142820+0000", 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9929999999999995e-06 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.142828+0000", 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7759999999999997e-06 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.215906+0000", 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.073078886999999995 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.215992+0000", 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5507999999999995e-05 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.216083+0000", 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0834000000000005e-05 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172023 3.1a 3:5bce93d6:::rbd_data.11943a52a299.0000000000000007:30 [read 4055040~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.154126+0000", 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9220882219999993, 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070537561999999998, 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.146 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.147 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172023 2024-04-23T23:39:30.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.147 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.154126+0000", 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.154126+0000", 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.154127+0000", 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.154128+0000", 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7489999999999999e-06 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.154134+0000", 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9379999999999997e-06 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.154140+0000", 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7300000000000002e-06 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.224506+0000", 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070365391999999999 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.224582+0000", 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6717000000000004e-05 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.224664+0000", 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1686000000000004e-05 2024-04-23T23:39:30.152 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:172125 3.1a 3:5bce93d6:::rbd_data.11943a52a299.0000000000000007:30 [read 4179968~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:20.158190+0000", 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 9.9180243309999998, 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070751953000000006, 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:30.153 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 172125 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158190+0000", 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158190+0000", 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158191+0000", 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158193+0000", 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0990000000000001e-06 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158199+0000", 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2319999999999998e-06 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.158205+0000", 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5589999999999996e-06 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.228803+0000", 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.070598190000000005 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.228879+0000", 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6161999999999993e-05 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:30.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:20.228942+0000", 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3270999999999998e-05 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:30.157 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:30.158 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:30.159 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:30.159 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:30.160 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:30.160 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:30.160 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:30.170+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:30.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:39:30.165 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:30.165 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:30.183 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:30.183 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:30.201 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:30.201 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:30.218 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:30.219 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:30.236 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:30.237 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:30.239 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:30.240 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:30.259 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:30.272+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:30.303 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:30.304 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:30.312 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:30.396 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:30.409+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:30.456 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:30.456 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:30.461 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:30.474+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:30.465 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:30.562 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:30.575+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:30.608 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:30.609 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:30.617 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:30.663 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:30.676+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:30.762 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:30.762 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:30.763 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:30.776+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:30.769 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:30.865 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:30.877+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:30.912 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:30.912 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:30.922 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:30.966 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:30.979+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:31.026 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:31.026 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:31.035 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:31.067 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:31.080+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:31.080 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:39:31.146 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:31.146 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:31.155 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:31.198 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:31.211+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:31.258 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:31.514 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:31.515 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone50 from 0x4e138ab (overlap 0x2694495) to 0x1b01668 2024-04-23T23:39:31.516 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:31.516 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:31.528+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:31.559 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #49, image image_client.0-clone49 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent50 2024-04-23T23:39:31.616 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:31.628+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:31.705 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:31.706 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:31.717 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:31.728+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:31.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:31.818 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:31.830+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:31.850 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:31.850 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:31.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:31.919 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:31.931+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:31.981 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:31.981 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:31.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:32.036 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:32.047+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:32.120 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:32.132+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:32.135 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:32.135 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:32.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:32.232 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:32.244+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:32.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:32.316 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:32.317 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:32.321 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:32.332+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:32.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:32.395 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:32.395 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:32.418 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:32.418 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:32.421 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:32.433+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:32.435 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:32.436 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:32.436 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:32.479 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:32.480 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:32.480 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:32.480 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:32.480 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:32.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:32.522 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:32.535+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:32.623 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:32.634+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:10670 3.0 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 9286759~9070] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 104.253539897, 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090064020999999994, 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 10670 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393843+0000", 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.393846+0000", 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.39e-06 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405429+0000", 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011583662999999999 2024-04-23T23:39:32.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405457+0000", 2024-04-23T23:39:32.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259000000000001e-05 2024-04-23T23:39:32.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405467+0000", 2024-04-23T23:39:32.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0603e-05 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405555+0000", 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7452000000000002e-05 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.405707+0000", 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151946 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.407361+0000", 2024-04-23T23:39:32.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001654705 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483336+0000", 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.075975153000000004 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483791+0000", 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00045455300000000001 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483850+0000", 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9401000000000003e-05 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483907+0000", 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6895999999999999e-05 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:14872 3.0 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write 471225~53063] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 95.254889269000003, 2024-04-23T23:39:32.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.10578035, 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 14872 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392494+0000", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.392496+0000", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-06 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405368+0000", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012871854 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405391+0000", 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3337999999999999e-05 2024-04-23T23:39:32.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405401+0000", 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6600000000000007e-06 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405492+0000", 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0717000000000006e-05 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.405607+0000", 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011582900000000001 2024-04-23T23:39:32.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 2", 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.406608+0000", 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0010001529999999999 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497303+0000", 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.090695805000000004 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498153+0000", 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00084918799999999996 2024-04-23T23:39:32.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498218+0000", 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5371999999999997e-05 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.498274+0000", 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6304000000000002e-05 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 73.815235856000001, 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90590 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3441664~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.645702301, 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051386827000000003, 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90590 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001681+0000", 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001684+0000", 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1689999999999999e-06 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001690+0000", 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1480000000000003e-06 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.001694+0000", 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6120000000000001e-06 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052909+0000", 2024-04-23T23:39:32.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051214519 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.052978+0000", 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8738000000000005e-05 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.053068+0000", 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0068000000000006e-05 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90651 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3556352~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.641819658999999, 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051409877, 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90651 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005564+0000", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005566+0000", 2024-04-23T23:39:32.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9489999999999999e-06 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005572+0000", 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1179999999999997e-06 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005577+0000", 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7060000000000003e-06 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056808+0000", 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051230879999999999 2024-04-23T23:39:32.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056879+0000", 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1261999999999996e-05 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.056973+0000", 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4569999999999997e-05 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90653 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3563520~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.665 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.641800537999998, 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051620653000000002, 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90653 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005583+0000", 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005585+0000", 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.883e-06 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005591+0000", 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9020000000000004e-06 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005596+0000", 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057017+0000", 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051421175999999999 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057094+0000", 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7040999999999996e-05 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057203+0000", 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010935 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90655 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3570688~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.641781887999997, 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051736068000000003, 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90655 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005601+0000", 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005602+0000", 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005603+0000", 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005609+0000", 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.005614+0000", 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6190000000000002e-06 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057238+0000", 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051623872000000001 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057281+0000", 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3259e-05 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.057337+0000", 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6298999999999997e-05 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.674 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90662 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3613696~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.640197702000002, 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051308223, 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90662 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007185+0000", 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007186+0000", 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007188+0000", 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.945e-06 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007195+0000", 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007200+0000", 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058336+0000", 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051136231999999997 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058404+0000", 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8613000000000002e-05 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058494+0000", 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.9314999999999994e-05 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90663 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3620864~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.640176527000001, 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051524557999999998, 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90663 2024-04-23T23:39:32.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007207+0000", 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007209+0000", 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.813e-06 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007215+0000", 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3899999999999998e-06 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007220+0000", 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8189999999999999e-06 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058536+0000", 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051315847999999997 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058621+0000", 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5453999999999999e-05 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058731+0000", 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010982800000000001 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90664 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3628032~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.640157309999999, 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051704831, 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90664 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007226+0000", 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9700000000000002e-07 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007228+0000", 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.829e-06 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007233+0000", 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007238+0000", 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5159999999999996e-06 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058770+0000", 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051532124999999998 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058839+0000", 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9356999999999993e-05 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058931+0000", 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1230000000000006e-05 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90665 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 3635200~1024] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.640139417, 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051935859000000001, 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.687 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90665 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.007244+0000", 2024-04-23T23:39:32.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008976+0000", 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017323939999999999 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008980+0000", 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0910000000000003e-06 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008987+0000", 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.131e-06 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.008992+0000", 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6670000000000004e-06 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.058981+0000", 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049988772000000001 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059068+0000", 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.7640999999999997e-05 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.059180+0000", 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00011116300000000001 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90674 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4484096~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.691 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.638199716000003, 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051442084999999999, 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90674 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009183+0000", 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009184+0000", 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009186+0000", 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009192+0000", 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6039999999999998e-06 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009198+0000", 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060463+0000", 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051264788999999998 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060543+0000", 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0344000000000002e-05 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060626+0000", 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2576000000000004e-05 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90675 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4491264~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.638178953000001, 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051599027999999998, 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.696 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90675 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009204+0000", 2024-04-23T23:39:32.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009205+0000", 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9799999999999999e-07 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009207+0000", 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009212+0000", 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7479999999999999e-06 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009218+0000", 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1919999999999996e-06 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060663+0000", 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051445554999999997 2024-04-23T23:39:32.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060732+0000", 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9041000000000005e-05 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060803+0000", 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1135000000000002e-05 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90676 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4498432~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.638159975000001, 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051792194999999999, 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90676 2024-04-23T23:39:32.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009223+0000", 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009224+0000", 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9900000000000001e-07 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009225+0000", 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8470000000000001e-06 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009232+0000", 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5089999999999999e-06 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009238+0000", 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8050000000000003e-06 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060845+0000", 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051607346999999998 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.060927+0000", 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1644999999999995e-05 2024-04-23T23:39:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061015+0000", 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8642999999999998e-05 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90677 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4505600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.638139389000003, 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051967037000000001, 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.705 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90677 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.009244+0000", 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010979+0000", 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017348070000000001 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010985+0000", 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0159999999999997e-06 2024-04-23T23:39:32.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.010995+0000", 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0370000000000001e-05 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011002+0000", 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2960000000000001e-06 2024-04-23T23:39:32.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061051+0000", 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.050048603999999997 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061134+0000", 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3219000000000004e-05 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.061211+0000", 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6724999999999995e-05 2024-04-23T23:39:32.709 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90686 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4562944~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.636130670999997, 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051380604000000003, 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.710 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90686 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011252+0000", 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011253+0000", 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.34e-07 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011254+0000", 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2669999999999999e-06 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011258+0000", 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7050000000000001e-06 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011261+0000", 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9349999999999999e-06 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062492+0000", 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051231454000000003 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062563+0000", 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0461000000000002e-05 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062633+0000", 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0548000000000003e-05 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90687 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4570112~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.714 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.636119526000002, 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051576652000000001, 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90687 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011264+0000", 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.9299999999999999e-07 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011265+0000", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2109999999999999e-06 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011268+0000", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1470000000000001e-06 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011271+0000", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6309999999999999e-06 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062678+0000", 2024-04-23T23:39:32.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051406962 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062759+0000", 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0803000000000005e-05 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062840+0000", 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1605000000000002e-05 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:90688 3.8 3:1071d746:::rbd_data.1194fe023ae4.0000000000000000:23 [read 4577280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e86)", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.636109396999998, 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051748664999999999, 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 90688 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:32.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.011274+0000", 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012977+0000", 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0017037109999999999 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.012982+0000", 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5979999999999999e-06 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013006+0000", 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4300000000000001e-05 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.013015+0000", 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4649999999999994e-06 2024-04-23T23:39:32.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062879+0000", 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.049864420999999999 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.062949+0000", 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.9728999999999996e-05 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:51.063022+0000", 2024-04-23T23:39:32.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3441000000000004e-05 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.753376083999999, 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.723 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:39:32.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.780546565000002, 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:39:32.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:39:32.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:39:32.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:39:32.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:39:32.734 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.734 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.734 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.734 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:32.734 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:32.734 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:32.736 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:32.736 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:32.746+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:32.836 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:32.848+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:32.879 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:32.879 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:32.879 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:32.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:32.937 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:32.949+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:33.029 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:33.030 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:33.030 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:33.030 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:33.030 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:33.037 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:33.050+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:33.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:33.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:39:33.139 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:33.151+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:33.143 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 104.760261998, 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:33.158 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:33.162 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 95.760566143999995, 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:33.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:32786 3.4 e48/21 3:216639ce:::rbd_data.1194db69ebd1.0000000000000006:head v 48'68, mlcod=45'66)", 2024-04-23T23:39:33.166 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 83.081309047000005, 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014972310000000001, 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.087989+0000", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090123+0000", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.002134005 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090144+0000", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1064e-05 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090156+0000", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1882000000000001e-05 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090219+0000", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2836000000000006e-05 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.090241+0000", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1826000000000001e-05 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102924+0000", 2024-04-23T23:39:33.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012683312 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:10.102961+0000", 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6940000000000002e-05 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56714 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25821184~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.900110855000001, 2024-04-23T23:39:33.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013330438, 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56714 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269187+0000", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.22e-07 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269197+0000", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0553e-05 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269201+0000", 2024-04-23T23:39:33.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8850000000000001e-06 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269211+0000", 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1600000000000004e-06 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282328+0000", 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013117355000000001 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282416+0000", 2024-04-23T23:39:33.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8265999999999998e-05 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282517+0000", 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000100997 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56788 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 2359296~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.900082669, 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01351835, 2024-04-23T23:39:33.174 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56788 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:33.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269215+0000", 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2500000000000001e-07 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269216+0000", 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.254e-06 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269221+0000", 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5750000000000002e-06 2024-04-23T23:39:33.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269225+0000", 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.811e-06 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282565+0000", 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013340533 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282638+0000", 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2967999999999997e-05 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282733+0000", 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4883999999999995e-05 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56789 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 4980736~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.900066963999997, 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013744467999999999, 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56789 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269231+0000", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269232+0000", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5030000000000001e-06 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269236+0000", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5269999999999999e-06 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269239+0000", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4990000000000001e-06 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282776+0000", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013537153 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282870+0000", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4369000000000004e-05 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.282975+0000", 2024-04-23T23:39:33.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000105035 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56790 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 7602176~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.900055981000001, 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013948952000000001, 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56790 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269242+0000", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.35e-07 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269244+0000", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269247+0000", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0340000000000001e-06 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269253+0000", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283010+0000", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013757109999999999 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283095+0000", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4911000000000001e-05 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283191+0000", 2024-04-23T23:39:33.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5705000000000006e-05 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56791 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 10223616~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.900041610000002, 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014139252, 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.186 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56791 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269256+0000", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6100000000000002e-07 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269257+0000", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269260+0000", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0510000000000001e-06 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269263+0000", 2024-04-23T23:39:33.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4229999999999999e-06 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283223+0000", 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013959693 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283300+0000", 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7082000000000005e-05 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283395+0000", 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.5598000000000002e-05 2024-04-23T23:39:33.189 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56792 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 12845056~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.900004271, 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014298317, 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56792 2024-04-23T23:39:33.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269293+0000", 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269294+0000", 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7e-07 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269296+0000", 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5069999999999999e-06 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269303+0000", 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4710000000000004e-06 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269308+0000", 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2299999999999999e-06 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283425+0000", 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014116759 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283504+0000", 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8855000000000003e-05 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283592+0000", 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.8024999999999998e-05 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56793 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 15466496~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.899981951999997, 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014476476, 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56793 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269316+0000", 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269324+0000", 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6260000000000003e-06 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269330+0000", 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7109999999999998e-06 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269336+0000", 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2700000000000004e-06 2024-04-23T23:39:33.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283624+0000", 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014288571999999999 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283702+0000", 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7515000000000006e-05 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283792+0000", 2024-04-23T23:39:33.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.0272999999999994e-05 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56794 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 18087936~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.899954737999998, 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014621528999999999, 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.198 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56794 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269343+0000", 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.51e-07 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269345+0000", 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0329999999999998e-06 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269352+0000", 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5479999999999998e-06 2024-04-23T23:39:33.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269357+0000", 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283832+0000", 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014475023 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283889+0000", 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6579999999999997e-05 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.283964+0000", 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5661999999999995e-05 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56795 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 20709376~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.899934684999998, 2024-04-23T23:39:33.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014857883000000001, 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56795 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269363+0000", 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0999999999999999e-07 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269365+0000", 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269371+0000", 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269376+0000", 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284015+0000", 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014638877 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284109+0000", 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.3739999999999994e-05 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284221+0000", 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000111743 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56796 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 23330816~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:33.206 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.899915307999997, 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015058897999999999, 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56796 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269382+0000", 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269383+0000", 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269385+0000", 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:39:33.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269391+0000", 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1970000000000001e-06 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269396+0000", 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9359999999999998e-06 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284266+0000", 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.014870367000000001 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284346+0000", 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0198999999999996e-05 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284441+0000", 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4877000000000007e-05 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:56797 3.1e 3:7d646283:::rbd_data.1194dbf22edf.0000000000000005:18 [sparse-read 25952256~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e66)", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.899895884000003, 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015252409, 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 56797 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:33.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269402+0000", 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269404+0000", 2024-04-23T23:39:33.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.889e-06 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269412+0000", 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7000000000000008e-06 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.269417+0000", 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0579999999999997e-06 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284468+0000", 2024-04-23T23:39:33.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015051788999999999 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284555+0000", 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6748000000000004e-05 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:29.284654+0000", 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8845999999999995e-05 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:63696 3.5 e70/56 3:a4dfcc9a:::rbd_data.119412e0677c.0000000000000000:head v 70'159, mlcod=67'157)", 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.988546735, 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015196454999999999, 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180751+0000", 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.180752+0000", 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6339999999999999e-06 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184519+0000", 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0037665620000000002 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184545+0000", 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6316e-05 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184557+0000", 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1598e-05 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184629+0000", 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.2387999999999999e-05 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.184657+0000", 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7535999999999999e-05 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195887+0000", 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011230314 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:33.195947+0000", 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0106999999999999e-05 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.218 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:75388 3.1a e75/62 3:599c65f2:::rbd_data.1194696b8826.0000000000000001:head v 75'389, mlcod=74'387)", 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 54.780704507000003, 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.015030751, 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:33.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388593+0000", 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.388594+0000", 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.42e-06 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391007+0000", 2024-04-23T23:39:33.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0024124010000000002 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391029+0000", 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2368999999999999e-05 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391043+0000", 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3548e-05 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391107+0000", 2024-04-23T23:39:33.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3985000000000005e-05 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.391133+0000", 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6336e-05 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403566+0000", 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012432613 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.403624+0000", 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8078999999999997e-05 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 54.612705488000003, 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.223 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:33.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:33.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:33.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 54.594137257, 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.227 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:33.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:33.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.9176386880000003, 2024-04-23T23:39:33.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:39:33.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.235 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.9130130400000001, 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:33.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.239 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:33.240 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:33.240 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:33.241 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:33.242 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:33.242 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:33.242 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:33.242 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:33.243 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:33.243 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:33.243 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:33.244 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:33.244 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:33.253+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:33.342 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:33.355+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:33.377 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:33.377 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:33.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.377 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269363 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.377 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187657+0000", 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18607944200000001, 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.186100188, 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269363 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187657+0000", 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187657+0000", 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187658+0000", 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1399999999999997e-07 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187660+0000", 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6699999999999998e-06 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187667+0000", 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.455e-06 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187672+0000", 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4589999999999997e-06 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187714+0000", 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1350000000000002e-05 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187721+0000", 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.695e-06 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269441 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.381 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207988+0000", 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165748795, 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16581626399999999, 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269441 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207988+0000", 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207988+0000", 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207988+0000", 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.79e-07 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207990+0000", 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.917e-06 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207996+0000", 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.823e-06 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207999+0000", 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3739999999999998e-06 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208394+0000", 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039503200000000002 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208401+0000", 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1409999999999999e-06 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.385 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269383 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211713+0000", 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.162023689, 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.162125516, 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269383 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211713+0000", 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211713+0000", 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211713+0000", 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5699999999999998e-07 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211715+0000", 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8029999999999999e-06 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211721+0000", 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7520000000000002e-06 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211725+0000", 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6600000000000003e-06 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212340+0000", 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00061405100000000001 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212347+0000", 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8089999999999993e-06 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272290 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230567+0000", 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14316910499999999, 2024-04-23T23:39:33.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.143304137, 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272290 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230567+0000", 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230567+0000", 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230568+0000", 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-07 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230570+0000", 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.906e-06 2024-04-23T23:39:33.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230576+0000", 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230581+0000", 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.994e-06 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230723+0000", 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014207900000000001 2024-04-23T23:39:33.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230731+0000", 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8180000000000004e-06 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269371 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187732+0000", 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.186004961, 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.186174688, 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.393 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269371 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187732+0000", 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187732+0000", 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187732+0000", 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9999999999999998e-07 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187735+0000", 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.757e-06 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187742+0000", 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7309999999999996e-06 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187747+0000", 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3700000000000003e-06 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187803+0000", 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5809e-05 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187813+0000", 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0190000000000001e-05 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269442 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208030+0000", 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165706988, 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16590917199999999, 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.397 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269442 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208030+0000", 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208030+0000", 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208030+0000", 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-07 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208033+0000", 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.836e-06 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208039+0000", 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9039999999999997e-06 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208044+0000", 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0490000000000003e-06 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208434+0000", 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039005799999999998 2024-04-23T23:39:33.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208441+0000", 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.396e-06 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269440 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211744+0000", 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16199226999999999, 2024-04-23T23:39:33.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16222666299999999, 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269440 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211744+0000", 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211744+0000", 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211745+0000", 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8199999999999998e-07 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211749+0000", 2024-04-23T23:39:33.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.104e-06 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211757+0000", 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8560000000000007e-06 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211764+0000", 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7479999999999996e-06 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212385+0000", 2024-04-23T23:39:33.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00062149799999999995 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212393+0000", 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7789999999999996e-06 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272401 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232692+0000", 2024-04-23T23:39:33.405 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.141044961, 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14131313000000001, 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272401 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232692+0000", 2024-04-23T23:39:33.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232692+0000", 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232692+0000", 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.77e-07 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232694+0000", 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.801e-06 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232699+0000", 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6269999999999997e-06 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232704+0000", 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2039999999999999e-06 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232734+0000", 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9916e-05 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232742+0000", 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272622 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.409 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.238535+0000", 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13520184099999999, 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.13550277399999999, 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272622 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.410 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238535+0000", 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238535+0000", 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238535+0000", 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238538+0000", 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3750000000000001e-06 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238544+0000", 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.404e-06 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238549+0000", 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0980000000000001e-06 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238598+0000", 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9057000000000001e-05 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238608+0000", 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.025e-05 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269372 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.413 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187765+0000", 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185971996, 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18630534600000001, 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269372 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187765+0000", 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187765+0000", 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187765+0000", 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4600000000000005e-07 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.415 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187781+0000", 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5523999999999999e-05 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187793+0000", 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.274e-05 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187799+0000", 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6060000000000002e-06 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.416 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187848+0000", 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9456999999999998e-05 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187857+0000", 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1159999999999999e-06 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207055+0000", 2024-04-23T23:39:33.417 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16668113600000001, 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167047003, 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207055+0000", 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.418 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207055+0000", 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207056+0000", 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.419 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207060+0000", 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207068+0000", 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5830000000000007e-06 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207075+0000", 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9659999999999999e-06 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.420 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207126+0000", 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0540000000000001e-05 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207135+0000", 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3260000000000002e-06 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269443 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.421 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208061+0000", 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16567570000000001, 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.166074051, 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269443 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.422 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208061+0000", 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208061+0000", 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208061+0000", 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.423 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208063+0000", 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0660000000000002e-06 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208069+0000", 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7579999999999998e-06 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208073+0000", 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4580000000000002e-06 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.424 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208476+0000", 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040356799999999998 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208483+0000", 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3019999999999997e-06 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.425 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269441 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211787+0000", 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16194967099999999, 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16238037699999999, 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269441 2024-04-23T23:39:33.426 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211787+0000", 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211787+0000", 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.427 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211787+0000", 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211790+0000", 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2299999999999998e-06 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211794+0000", 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4580000000000003e-06 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.428 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211798+0000", 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212433+0000", 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00063507099999999996 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212441+0000", 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3080000000000008e-06 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.429 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272406 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232712+0000", 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14102493999999999, 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.141487955, 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.430 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272406 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232712+0000", 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232712+0000", 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.431 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232712+0000", 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232714+0000", 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.838e-06 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232719+0000", 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5389999999999998e-06 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.432 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232728+0000", 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3909999999999998e-06 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232762+0000", 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4542999999999998e-05 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232769+0000", 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0140000000000001e-06 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.433 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272627 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.238559+0000", 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13517781200000001, 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.13567600799999999, 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.434 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272627 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238559+0000", 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238559+0000", 2024-04-23T23:39:33.435 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238559+0000", 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7e-07 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238561+0000", 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0880000000000002e-06 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238567+0000", 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0249999999999999e-06 2024-04-23T23:39:33.436 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238576+0000", 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5699999999999993e-06 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238638+0000", 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1795e-05 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238646+0000", 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9009999999999994e-06 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.437 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269373 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187868+0000", 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185868481, 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18639920500000001, 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269373 2024-04-23T23:39:33.438 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187868+0000", 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187868+0000", 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187869+0000", 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7000000000000005e-07 2024-04-23T23:39:33.439 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187871+0000", 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6230000000000001e-06 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187878+0000", 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1670000000000002e-06 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187884+0000", 2024-04-23T23:39:33.440 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3770000000000004e-06 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188042+0000", 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015822699999999999 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188051+0000", 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.1589999999999999e-06 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.441 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207135+0000", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16660197700000001, 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167165073, 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207135+0000", 2024-04-23T23:39:33.442 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207135+0000", 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207135+0000", 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4399999999999999e-07 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207139+0000", 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8260000000000003e-06 2024-04-23T23:39:33.443 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207148+0000", 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0899999999999994e-06 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207153+0000", 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5240000000000002e-06 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207227+0000", 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4214000000000005e-05 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.444 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207236+0000", 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8810000000000002e-06 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269454 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208077+0000", 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16565970199999999, 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.166255079, 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.445 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269454 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208077+0000", 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.446 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208077+0000", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208077+0000", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-07 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208078+0000", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.347e-06 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208082+0000", 2024-04-23T23:39:33.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.056e-06 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208086+0000", 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208504+0000", 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041809200000000001 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208510+0000", 2024-04-23T23:39:33.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3879999999999997e-06 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269442 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211804+0000", 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16193294499999999, 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16256063700000001, 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.449 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269442 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211804+0000", 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211804+0000", 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211804+0000", 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211814+0000", 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0345e-05 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211821+0000", 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3060000000000003e-06 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211826+0000", 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3109999999999996e-06 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212481+0000", 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00065501999999999997 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212489+0000", 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5360000000000004e-06 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272315 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230753+0000", 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14298323900000001, 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14364349500000001, 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272315 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230753+0000", 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230753+0000", 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230754+0000", 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3799999999999998e-07 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230761+0000", 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2799999999999998e-06 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230768+0000", 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5579999999999997e-06 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230773+0000", 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3650000000000003e-06 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230814+0000", 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0893999999999998e-05 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230822+0000", 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272409 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232736+0000", 2024-04-23T23:39:33.456 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14100078299999999, 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14169357299999999, 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272409 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232736+0000", 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232736+0000", 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232736+0000", 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1699999999999998e-07 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232738+0000", 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0420000000000001e-06 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232744+0000", 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9880000000000001e-06 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232749+0000", 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9749999999999998e-06 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232785+0000", 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5185999999999998e-05 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232788+0000", 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6629999999999999e-06 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272629 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.460 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.238583+0000", 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13515393000000001, 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.13587876199999999, 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272629 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238583+0000", 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238583+0000", 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238583+0000", 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238590+0000", 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.472e-06 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238596+0000", 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238601+0000", 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6779999999999997e-06 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238671+0000", 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9833999999999996e-05 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.238679+0000", 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2449999999999998e-06 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269374 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187899+0000", 2024-04-23T23:39:33.464 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185837264, 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.186611744, 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269374 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187899+0000", 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187899+0000", 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187900+0000", 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.82e-07 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187902+0000", 2024-04-23T23:39:33.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2630000000000002e-06 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187915+0000", 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2897e-05 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187921+0000", 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1689999999999997e-06 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188092+0000", 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017080400000000001 2024-04-23T23:39:33.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188100+0000", 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5859999999999999e-06 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207180+0000", 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166556334, 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16739574099999999, 2024-04-23T23:39:33.468 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207180+0000", 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207180+0000", 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207181+0000", 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.37e-07 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207184+0000", 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.309e-06 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207191+0000", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7390000000000002e-06 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207197+0000", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6489999999999996e-06 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207262+0000", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5355e-05 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207270+0000", 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7360000000000001e-06 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269455 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208120+0000", 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165616084, 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16652017499999999, 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.472 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269455 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208120+0000", 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208120+0000", 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208121+0000", 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-07 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208124+0000", 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6280000000000001e-06 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208130+0000", 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1210000000000003e-06 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208135+0000", 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4750000000000001e-06 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208537+0000", 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040160400000000001 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208544+0000", 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211003+0000", 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16273406400000001, 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16370284800000001, 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.476 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211003+0000", 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211003+0000", 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211003+0000", 2024-04-23T23:39:33.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1999999999999999e-07 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211007+0000", 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7079999999999999e-06 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211015+0000", 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8650000000000001e-06 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211021+0000", 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211067+0000", 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5386000000000002e-05 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211075+0000", 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2959999999999999e-06 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269443 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211833+0000", 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16190344600000001, 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16291636900000001, 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269443 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.480 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211833+0000", 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211833+0000", 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211834+0000", 2024-04-23T23:39:33.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211836+0000", 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9199999999999998e-06 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211842+0000", 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9220000000000002e-06 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211846+0000", 2024-04-23T23:39:33.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8840000000000002e-06 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212527+0000", 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00068100500000000004 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212536+0000", 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4460000000000001e-06 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269375 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188067+0000", 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185669957, 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18671728200000001, 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269375 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188067+0000", 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188067+0000", 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188067+0000", 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7100000000000001e-07 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188072+0000", 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188082+0000", 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0628999999999999e-05 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188089+0000", 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.951e-06 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188148+0000", 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8816000000000001e-05 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188157+0000", 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0860000000000008e-06 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.487 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207253+0000", 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166483784, 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16759765500000001, 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207253+0000", 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207253+0000", 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207254+0000", 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4600000000000004e-07 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207257+0000", 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4149999999999999e-06 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207263+0000", 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3999999999999997e-06 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207269+0000", 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7219999999999996e-06 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207307+0000", 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8189000000000003e-05 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207315+0000", 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2819999999999999e-06 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269473 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208159+0000", 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165577371, 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16672411400000001, 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.491 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269473 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208159+0000", 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208159+0000", 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208160+0000", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.08e-07 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208161+0000", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7e-06 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208165+0000", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.172e-06 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208169+0000", 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.072e-06 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208570+0000", 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040142599999999997 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208577+0000", 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0099999999999998e-06 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211037+0000", 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16269966299999999, 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16388019300000001, 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211037+0000", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211037+0000", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211037+0000", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7000000000000005e-07 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211040+0000", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7149999999999998e-06 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211047+0000", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4219999999999997e-06 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211051+0000", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7180000000000004e-06 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211097+0000", 2024-04-23T23:39:33.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5377999999999998e-05 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211102+0000", 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2750000000000003e-06 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269454 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211871+0000", 2024-04-23T23:39:33.498 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.161865913, 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.163080063, 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269454 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211871+0000", 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211871+0000", 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211871+0000", 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211873+0000", 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7829999999999999e-06 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211877+0000", 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1439999999999996e-06 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211880+0000", 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212571+0000", 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00069114299999999997 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212579+0000", 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1249999999999993e-06 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272320 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230807+0000", 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14293004400000001, 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14417702499999999, 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.502 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272320 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230807+0000", 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230807+0000", 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230807+0000", 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230809+0000", 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9420000000000002e-06 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230815+0000", 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8109999999999999e-06 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230820+0000", 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1710000000000001e-06 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230848+0000", 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8421000000000001e-05 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230855+0000", 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8469999999999998e-06 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269383 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188110+0000", 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18562611600000001, 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18690672899999999, 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269383 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188110+0000", 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188110+0000", 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188111+0000", 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9900000000000001e-07 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188114+0000", 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8550000000000002e-06 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188121+0000", 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6040000000000004e-06 2024-04-23T23:39:33.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188127+0000", 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8209999999999998e-06 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188183+0000", 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6242999999999997e-05 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188192+0000", 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0630000000000006e-06 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.509 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207285+0000", 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16645126299999999, 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16776434200000001, 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207285+0000", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207285+0000", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207286+0000", 2024-04-23T23:39:33.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2099999999999996e-07 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207295+0000", 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.619e-06 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207302+0000", 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0339999999999999e-06 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207308+0000", 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3550000000000001e-06 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207339+0000", 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1482000000000001e-05 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207347+0000", 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2110000000000001e-06 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269474 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208173+0000", 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16556364300000001, 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16691087900000001, 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269474 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208173+0000", 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208173+0000", 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208173+0000", 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6800000000000001e-07 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208175+0000", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4130000000000001e-06 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208178+0000", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9380000000000001e-06 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208182+0000", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8680000000000001e-06 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208605+0000", 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00042338400000000001 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208615+0000", 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0220999999999999e-05 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211061+0000", 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.162675824, 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16405535900000001, 2024-04-23T23:39:33.517 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211061+0000", 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211061+0000", 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211061+0000", 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.75e-07 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211064+0000", 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2749999999999998e-06 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211069+0000", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4949999999999999e-06 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211074+0000", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1660000000000002e-06 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211119+0000", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4842999999999997e-05 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211123+0000", 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8360000000000002e-06 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269455 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211884+0000", 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16185222599999999, 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.163265517, 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.521 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269455 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211884+0000", 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211884+0000", 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211885+0000", 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211886+0000", 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.156e-06 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211890+0000", 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1470000000000003e-06 2024-04-23T23:39:33.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211895+0000", 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4920000000000004e-06 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212618+0000", 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00072297400000000003 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212626+0000", 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0590000000000003e-06 2024-04-23T23:39:33.524 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272326 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230827+0000", 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.142909811, 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14435769500000001, 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272326 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.525 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230827+0000", 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230827+0000", 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230827+0000", 2024-04-23T23:39:33.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.01e-07 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230829+0000", 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8989999999999999e-06 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230835+0000", 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230840+0000", 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.023e-06 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230869+0000", 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8867999999999999e-05 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230872+0000", 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5319999999999998e-06 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.528 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269440 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188143+0000", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18559321400000001, 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18707383999999999, 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269440 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188143+0000", 2024-04-23T23:39:33.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188143+0000", 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188144+0000", 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6699999999999999e-07 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188146+0000", 2024-04-23T23:39:33.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5959999999999998e-06 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188153+0000", 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8920000000000003e-06 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188159+0000", 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6010000000000002e-06 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188214+0000", 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5563000000000003e-05 2024-04-23T23:39:33.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188221+0000", 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6930000000000001e-06 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207316+0000", 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16642063200000001, 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16793565899999999, 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.532 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207316+0000", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207316+0000", 2024-04-23T23:39:33.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207317+0000", 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9800000000000003e-07 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207319+0000", 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207325+0000", 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9039999999999997e-06 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207330+0000", 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0019999999999997e-06 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207380+0000", 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0368999999999998e-05 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207388+0000", 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6869999999999994e-06 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269476 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208185+0000", 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16555187499999999, 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167098993, 2024-04-23T23:39:33.536 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269476 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208185+0000", 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208185+0000", 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208185+0000", 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1600000000000002e-07 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208186+0000", 2024-04-23T23:39:33.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.167e-06 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208189+0000", 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.931e-06 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208192+0000", 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7499999999999999e-06 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208638+0000", 2024-04-23T23:39:33.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000446045 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208645+0000", 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3939999999999998e-06 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211082+0000", 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16265474399999999, 2024-04-23T23:39:33.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16423564500000001, 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211082+0000", 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211082+0000", 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211082+0000", 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211085+0000", 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6589999999999999e-06 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211091+0000", 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2140000000000001e-06 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211096+0000", 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0969999999999996e-06 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211165+0000", 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8601000000000003e-05 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211174+0000", 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4110000000000002e-06 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269473 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211907+0000", 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16182949799999999, 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.163442853, 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269473 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211907+0000", 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211907+0000", 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211908+0000", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211909+0000", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211917+0000", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1609999999999997e-06 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211922+0000", 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1379999999999998e-06 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212658+0000", 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00073663299999999999 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212666+0000", 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0790000000000001e-06 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272329 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230846+0000", 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14289032300000001, 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14453751400000001, 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272329 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230846+0000", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230846+0000", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230847+0000", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1399999999999997e-07 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230849+0000", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9410000000000001e-06 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230854+0000", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5350000000000004e-06 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230859+0000", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8029999999999996e-06 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230888+0000", 2024-04-23T23:39:33.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9496e-05 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230892+0000", 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8029999999999998e-06 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272431 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232816+0000", 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14092048800000001, 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14260103599999999, 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.551 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272431 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232816+0000", 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232816+0000", 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232817+0000", 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999998e-07 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232826+0000", 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7280000000000007e-06 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232832+0000", 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1879999999999999e-06 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232838+0000", 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7899999999999996e-06 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232870+0000", 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1680999999999997e-05 2024-04-23T23:39:33.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232874+0000", 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8229999999999997e-06 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.195517573, 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19723084399999999, 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.555 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269441 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188178+0000", 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18555864899999999, 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18731599600000001, 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269441 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188178+0000", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188178+0000", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188178+0000", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188186+0000", 2024-04-23T23:39:33.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5290000000000003e-06 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188197+0000", 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0859000000000001e-05 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188209+0000", 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1909000000000001e-05 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188279+0000", 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0018999999999995e-05 2024-04-23T23:39:33.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188284+0000", 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5940000000000001e-06 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207336+0000", 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16640085299999999, 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16819104400000001, 2024-04-23T23:39:33.562 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207336+0000", 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207336+0000", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207336+0000", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5000000000000003e-07 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207338+0000", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207344+0000", 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6729999999999997e-06 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207350+0000", 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6069999999999998e-06 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207422+0000", 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2829000000000004e-05 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207430+0000", 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2899999999999997e-06 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269481 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208196+0000", 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165541035, 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167365453, 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.566 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269481 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208196+0000", 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208196+0000", 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208196+0000", 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.72e-07 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208197+0000", 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5090000000000001e-06 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208203+0000", 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3700000000000003e-06 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208206+0000", 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.05e-06 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208674+0000", 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00046855699999999998 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208681+0000", 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0169999999999999e-06 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.569 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211103+0000", 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16263313900000001, 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.164491207, 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211103+0000", 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211103+0000", 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211104+0000", 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.32e-07 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211106+0000", 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1069999999999999e-06 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211112+0000", 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2049999999999999e-06 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211117+0000", 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0590000000000002e-06 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211222+0000", 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010467300000000001 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211251+0000", 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8764000000000001e-05 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269474 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211928+0000", 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.161808286, 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.163698919, 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269474 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211928+0000", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211928+0000", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211929+0000", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211931+0000", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4320000000000002e-06 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211937+0000", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211941+0000", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0799999999999999e-06 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212706+0000", 2024-04-23T23:39:33.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00076533999999999999 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212715+0000", 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6889999999999993e-06 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272432 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232847+0000", 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14088917400000001, 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14281354199999999, 2024-04-23T23:39:33.577 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272432 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232847+0000", 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232847+0000", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232890+0000", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2815000000000003e-05 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232893+0000", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0639999999999998e-06 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232900+0000", 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7780000000000002e-06 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232905+0000", 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2499999999999997e-06 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232939+0000", 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3971999999999999e-05 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232946+0000", 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8889999999999996e-06 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269442 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188256+0000", 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185481065, 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18743791100000001, 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.581 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269442 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188256+0000", 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188256+0000", 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188256+0000", 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7299999999999995e-07 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188260+0000", 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1579999999999998e-06 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188269+0000", 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5669999999999995e-06 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188276+0000", 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7449999999999998e-06 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188298+0000", 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2005999999999999e-05 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188304+0000", 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6189999999999996e-06 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207403+0000", 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16633395400000001, 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16832528199999999, 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207403+0000", 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207403+0000", 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207403+0000", 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4199999999999995e-07 2024-04-23T23:39:33.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207406+0000", 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8140000000000001e-06 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207413+0000", 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.669e-06 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207418+0000", 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3009999999999997e-06 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207454+0000", 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5561000000000001e-05 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207460+0000", 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8340000000000001e-06 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269487 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.588 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208221+0000", 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16551599, 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16753963299999999, 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269487 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208221+0000", 2024-04-23T23:39:33.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208221+0000", 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208221+0000", 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4600000000000005e-07 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208223+0000", 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.137e-06 2024-04-23T23:39:33.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208229+0000", 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6740000000000002e-06 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208234+0000", 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1970000000000004e-06 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208709+0000", 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00047525900000000001 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208716+0000", 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0310000000000001e-06 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211124+0000", 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16261271399999999, 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.164738196, 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.592 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211124+0000", 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211124+0000", 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211124+0000", 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211126+0000", 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9609999999999999e-06 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211133+0000", 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6150000000000002e-06 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211137+0000", 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6619999999999996e-06 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211294+0000", 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015627300000000001 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211303+0000", 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7909999999999993e-06 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269476 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211946+0000", 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16179052299999999, 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16395047300000001, 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269476 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211946+0000", 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211946+0000", 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211946+0000", 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211948+0000", 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.198e-06 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211952+0000", 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0110000000000002e-06 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211955+0000", 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4649999999999999e-06 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212741+0000", 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00078563500000000002 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212745+0000", 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6500000000000004e-06 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272439 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232916+0000", 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.140820325, 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14301262300000001, 2024-04-23T23:39:33.599 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272439 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232916+0000", 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232916+0000", 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232917+0000", 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3000000000000001e-07 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232919+0000", 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1660000000000001e-06 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232925+0000", 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0650000000000004e-06 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232930+0000", 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7129999999999996e-06 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232962+0000", 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.252e-05 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232966+0000", 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6389999999999998e-06 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.187993724, 2024-04-23T23:39:33.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19021970599999999, 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:39:33.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269443 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188290+0000", 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18544638499999999, 2024-04-23T23:39:33.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18770457700000001, 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269443 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188290+0000", 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188290+0000", 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188291+0000", 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188293+0000", 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.689e-06 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188300+0000", 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0280000000000003e-06 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188306+0000", 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5779999999999998e-06 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188385+0000", 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9408999999999998e-05 2024-04-23T23:39:33.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188393+0000", 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9950000000000005e-06 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207426+0000", 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16631047400000001, 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.168603373, 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.611 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207426+0000", 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207426+0000", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207427+0000", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207429+0000", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.142e-06 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207434+0000", 2024-04-23T23:39:33.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5779999999999998e-06 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207439+0000", 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.04e-06 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207497+0000", 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7760000000000003e-05 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207504+0000", 2024-04-23T23:39:33.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2069999999999998e-06 2024-04-23T23:39:33.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.615 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269488 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208240+0000", 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16549640099999999, 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167823949, 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.618 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269488 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208240+0000", 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208240+0000", 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208241+0000", 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208250+0000", 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6539999999999994e-06 2024-04-23T23:39:33.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208257+0000", 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2809999999999997e-06 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208262+0000", 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4049999999999999e-06 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208744+0000", 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00048229300000000001 2024-04-23T23:39:33.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208751+0000", 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.153e-06 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211152+0000", 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.162584699, 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16494535199999999, 2024-04-23T23:39:33.622 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211152+0000", 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211152+0000", 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211152+0000", 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1e-07 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211154+0000", 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0679999999999999e-06 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211159+0000", 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1399999999999999e-06 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211164+0000", 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7559999999999999e-06 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211345+0000", 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018118100000000001 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211353+0000", 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8839999999999994e-06 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269481 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211959+0000", 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16177797499999999, 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16417264200000001, 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269481 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211959+0000", 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211959+0000", 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211959+0000", 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4299999999999999e-07 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211960+0000", 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.203e-06 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211964+0000", 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9709999999999998e-06 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211970+0000", 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7010000000000001e-06 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212768+0000", 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00079849999999999995 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212773+0000", 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3329999999999998e-06 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272442 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232938+0000", 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14079810600000001, 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.143225403, 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272442 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232938+0000", 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232938+0000", 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234474+0000", 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001535378 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234477+0000", 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5039999999999998e-06 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234484+0000", 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7299999999999999e-06 2024-04-23T23:39:33.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234489+0000", 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7090000000000001e-06 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234535+0000", 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6570000000000003e-05 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234544+0000", 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2840000000000006e-06 2024-04-23T23:39:33.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18794117099999999, 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19040505199999999, 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.634 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:39:33.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:39:33.637 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272100 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204031+0000", 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16970521899999999, 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17220133300000001, 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272100 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204031+0000", 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204031+0000", 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204032+0000", 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204034+0000", 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.99e-06 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204039+0000", 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4020000000000001e-06 2024-04-23T23:39:33.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204044+0000", 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8330000000000001e-06 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204091+0000", 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6678000000000003e-05 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204097+0000", 2024-04-23T23:39:33.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5749999999999997e-06 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207446+0000", 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16629087200000001, 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.168820795, 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207446+0000", 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207446+0000", 2024-04-23T23:39:33.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207446+0000", 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207448+0000", 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9429999999999999e-06 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207454+0000", 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7119999999999997e-06 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207476+0000", 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2283999999999999e-05 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207534+0000", 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7525999999999998e-05 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207540+0000", 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2129999999999996e-06 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269489 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208271+0000", 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16546596499999999, 2024-04-23T23:39:33.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16802940499999999, 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269489 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208271+0000", 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208271+0000", 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208271+0000", 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7000000000000005e-07 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208273+0000", 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1119999999999999e-06 2024-04-23T23:39:33.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208279+0000", 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6489999999999996e-06 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208284+0000", 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000003e-06 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208781+0000", 2024-04-23T23:39:33.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00049750700000000001 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208789+0000", 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.255e-06 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211178+0000", 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16255839899999999, 2024-04-23T23:39:33.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16515453399999999, 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211178+0000", 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211178+0000", 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211179+0000", 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5700000000000002e-07 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211181+0000", 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4849999999999999e-06 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211187+0000", 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3970000000000002e-06 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211190+0000", 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6500000000000002e-06 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211390+0000", 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000199166 2024-04-23T23:39:33.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211398+0000", 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0020000000000006e-06 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269487 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211974+0000", 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16176251799999999, 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.164392291, 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.654 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269487 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211974+0000", 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211974+0000", 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211974+0000", 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6600000000000002e-07 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211976+0000", 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.826e-06 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211982+0000", 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.767e-06 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211987+0000", 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8199999999999996e-06 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212809+0000", 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00082178800000000005 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212813+0000", 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999999e-06 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272449 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.234500+0000", 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13923614100000001, 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14189854299999999, 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.658 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272449 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234500+0000", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234500+0000", 2024-04-23T23:39:33.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234501+0000", 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3500000000000002e-07 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234502+0000", 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4619999999999999e-06 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234507+0000", 2024-04-23T23:39:33.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7419999999999997e-06 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234510+0000", 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.168e-06 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234573+0000", 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2516999999999998e-05 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234580+0000", 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5739999999999998e-06 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18791437, 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19061038799999999, 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.662 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:39:33.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:39:33.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269454 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188355+0000", 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18538111500000001, 2024-04-23T23:39:33.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.188115961, 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269454 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188355+0000", 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188355+0000", 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188356+0000", 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9999999999999997e-07 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188360+0000", 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4989999999999999e-06 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188366+0000", 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9099999999999999e-06 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188372+0000", 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8669999999999999e-06 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188418+0000", 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6060000000000003e-05 2024-04-23T23:39:33.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188426+0000", 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2309999999999999e-06 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272103 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204054+0000", 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.169683001, 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17245273, 2024-04-23T23:39:33.670 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272103 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204054+0000", 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204054+0000", 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204054+0000", 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4099999999999999e-07 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204056+0000", 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204062+0000", 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4150000000000004e-06 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204068+0000", 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4149999999999998e-06 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204128+0000", 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9639000000000003e-05 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204136+0000", 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.405e-06 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207500+0000", 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16623678, 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16904993400000001, 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207500+0000", 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207500+0000", 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207500+0000", 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6599999999999996e-07 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207503+0000", 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8090000000000001e-06 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207509+0000", 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.224e-06 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207515+0000", 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4450000000000004e-06 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207574+0000", 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9227000000000001e-05 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207581+0000", 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3200000000000002e-06 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269490 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208301+0000", 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16543528699999999, 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16831264900000001, 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269490 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208301+0000", 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208301+0000", 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208302+0000", 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208304+0000", 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5840000000000002e-06 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208311+0000", 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1e-06 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208316+0000", 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1939999999999997e-06 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208816+0000", 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00050062299999999995 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208824+0000", 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4680000000000003e-06 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211212+0000", 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16252482200000001, 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16547108499999999, 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211212+0000", 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211212+0000", 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211212+0000", 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7000000000000005e-07 2024-04-23T23:39:33.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211215+0000", 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3259999999999998e-06 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211221+0000", 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5690000000000001e-06 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211226+0000", 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1359999999999996e-06 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211434+0000", 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000207235 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211441+0000", 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8639999999999996e-06 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269488 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.685 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211992+0000", 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16174412599999999, 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.164755291, 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269488 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211992+0000", 2024-04-23T23:39:33.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211992+0000", 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211993+0000", 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1099999999999996e-07 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211995+0000", 2024-04-23T23:39:33.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8560000000000001e-06 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212000+0000", 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212006+0000", 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4539999999999998e-06 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212837+0000", 2024-04-23T23:39:33.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00083126000000000001 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212841+0000", 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1520000000000002e-06 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272100 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.223780+0000", 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14995625900000001, 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.153008908, 2024-04-23T23:39:33.689 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272100 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.223780+0000", 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.223780+0000", 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225472+0000", 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016912450000000001 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225476+0000", 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9339999999999997e-06 2024-04-23T23:39:33.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225485+0000", 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3559999999999993e-06 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225493+0000", 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0229999999999992e-06 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225549+0000", 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5897999999999999e-05 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225557+0000", 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5159999999999994e-06 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272522 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.236874+0000", 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136862701, 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.13994948300000001, 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.693 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272522 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236874+0000", 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236874+0000", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236874+0000", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.89e-07 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236876+0000", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9350000000000001e-06 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236881+0000", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.78e-06 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236886+0000", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5719999999999996e-06 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236923+0000", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7518000000000002e-05 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236932+0000", 2024-04-23T23:39:33.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9979999999999992e-06 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18789049199999999, 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19101021100000001, 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.697 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.700 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269455 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188383+0000", 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18535338700000001, 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18850708199999999, 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269455 2024-04-23T23:39:33.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188383+0000", 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188383+0000", 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188384+0000", 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4099999999999999e-07 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188386+0000", 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1720000000000001e-06 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188392+0000", 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9909999999999999e-06 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188397+0000", 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.395e-06 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188451+0000", 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3888000000000003e-05 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188459+0000", 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6699999999999994e-06 2024-04-23T23:39:33.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272107 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204097+0000", 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16963925999999999, 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17282535800000001, 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.705 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272107 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204097+0000", 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204097+0000", 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204098+0000", 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204101+0000", 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.909e-06 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204108+0000", 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7750000000000004e-06 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204113+0000", 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9730000000000002e-06 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204155+0000", 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1513e-05 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204159+0000", 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8700000000000002e-06 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207523+0000", 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16621348399999999, 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.169433588, 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207523+0000", 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207523+0000", 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207524+0000", 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:33.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207526+0000", 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9700000000000002e-06 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207532+0000", 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9939999999999997e-06 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207536+0000", 2024-04-23T23:39:33.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7929999999999997e-06 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207612+0000", 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5186999999999997e-05 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207616+0000", 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5290000000000002e-06 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.712 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269495 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208322+0000", 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16541449599999999, 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16866752199999999, 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269495 2024-04-23T23:39:33.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208322+0000", 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208322+0000", 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208323+0000", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8699999999999995e-07 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208325+0000", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208330+0000", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5820000000000001e-06 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208335+0000", 2024-04-23T23:39:33.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3270000000000002e-06 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208851+0000", 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00051694700000000002 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208858+0000", 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8480000000000003e-06 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.716 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211234+0000", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16250292899999999, 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16579113500000001, 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211234+0000", 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211234+0000", 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211234+0000", 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211236+0000", 2024-04-23T23:39:33.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.968e-06 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211242+0000", 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3400000000000003e-06 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211253+0000", 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0539e-05 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211497+0000", 2024-04-23T23:39:33.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00024363999999999999 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211507+0000", 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0298e-05 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269489 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.212030+0000", 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16170653500000001, 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16502844699999999, 2024-04-23T23:39:33.720 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269489 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212030+0000", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212030+0000", 2024-04-23T23:39:33.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212031+0000", 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4000000000000002e-07 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212033+0000", 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.295e-06 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212040+0000", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7610000000000002e-06 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212046+0000", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9800000000000003e-06 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212862+0000", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000816221 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212866+0000", 2024-04-23T23:39:33.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.799e-06 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272103 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225566+0000", 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14817063699999999, 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.151524672, 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.724 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272103 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225566+0000", 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225566+0000", 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225567+0000", 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9500000000000002e-07 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225570+0000", 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9969999999999999e-06 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225576+0000", 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7399999999999998e-06 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225582+0000", 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8420000000000001e-06 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225624+0000", 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2074999999999999e-05 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225632+0000", 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6850000000000001e-06 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272459 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.234540+0000", 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13919704699999999, 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14258432700000001, 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272459 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234540+0000", 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234540+0000", 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234540+0000", 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6600000000000002e-07 2024-04-23T23:39:33.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234542+0000", 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0880000000000002e-06 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234548+0000", 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234552+0000", 2024-04-23T23:39:33.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5759999999999999e-06 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234608+0000", 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5352000000000001e-05 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234613+0000", 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5860000000000004e-06 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272525 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.236894+0000", 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136842568, 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14026193300000001, 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272525 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236894+0000", 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236894+0000", 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236894+0000", 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236897+0000", 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2259999999999999e-06 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236902+0000", 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6629999999999998e-06 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236907+0000", 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0440000000000003e-06 2024-04-23T23:39:33.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236957+0000", 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0129000000000001e-05 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236965+0000", 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2339999999999997e-06 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18786865, 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19132185099999999, 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:33.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.739 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269473 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188416+0000", 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185320173, 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18880597499999999, 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.740 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269473 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188416+0000", 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188416+0000", 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188417+0000", 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188419+0000", 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.238e-06 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188427+0000", 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.413e-06 2024-04-23T23:39:33.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188432+0000", 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4779999999999999e-06 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188483+0000", 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1263e-05 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188487+0000", 2024-04-23T23:39:33.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7680000000000002e-06 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207541+0000", 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16619584600000001, 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16971588600000001, 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.744 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207541+0000", 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207541+0000", 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207541+0000", 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1e-07 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207543+0000", 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.79e-06 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207549+0000", 2024-04-23T23:39:33.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.896e-06 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207553+0000", 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7679999999999999e-06 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207637+0000", 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3078999999999995e-05 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207644+0000", 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3030000000000002e-06 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269496 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208388+0000", 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165348099, 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.168903048, 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.748 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269496 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208388+0000", 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208388+0000", 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208389+0000", 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5499999999999998e-07 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208392+0000", 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6299999999999998e-06 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208398+0000", 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6239999999999996e-06 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208404+0000", 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5119999999999999e-06 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208888+0000", 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00048387899999999999 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208895+0000", 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2230000000000001e-06 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211283+0000", 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16245395000000001, 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.166041511, 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.752 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211283+0000", 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211283+0000", 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211283+0000", 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211285+0000", 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6419999999999999e-06 2024-04-23T23:39:33.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211289+0000", 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1710000000000004e-06 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211292+0000", 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1669999999999999e-06 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211553+0000", 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026080199999999997 2024-04-23T23:39:33.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211561+0000", 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8099999999999998e-06 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269490 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.212059+0000", 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16167795800000001, 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16529982800000001, 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.756 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269490 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212059+0000", 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212059+0000", 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212059+0000", 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212061+0000", 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0159999999999998e-06 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212065+0000", 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4070000000000003e-06 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212068+0000", 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1329999999999999e-06 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212886+0000", 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00081781699999999998 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212890+0000", 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272107 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225642+0000", 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14809444699999999, 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.151748883, 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.760 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272107 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225642+0000", 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.761 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225642+0000", 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225643+0000", 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0100000000000005e-07 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225646+0000", 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8150000000000002e-06 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225652+0000", 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3350000000000003e-06 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225657+0000", 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2510000000000002e-06 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225729+0000", 2024-04-23T23:39:33.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2224999999999994e-05 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225738+0000", 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7730000000000005e-06 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272464 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.234564+0000", 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13917268299999999, 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14286091100000001, 2024-04-23T23:39:33.764 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272464 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234564+0000", 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234564+0000", 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234564+0000", 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234566+0000", 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3230000000000001e-06 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234569+0000", 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.535e-06 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234573+0000", 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9890000000000003e-06 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234653+0000", 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9727000000000004e-05 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234663+0000", 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0108e-05 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272530 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.236914+0000", 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13682282800000001, 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14054481399999999, 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.768 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272530 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236914+0000", 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236914+0000", 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236914+0000", 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9299999999999998e-07 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236916+0000", 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.863e-06 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236922+0000", 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236926+0000", 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5589999999999999e-06 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236990+0000", 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3212000000000004e-05 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236997+0000", 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0690000000000004e-06 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.187659096, 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.191418378, 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.772 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269474 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188446+0000", 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185290654, 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.189084218, 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.776 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269474 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188446+0000", 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188446+0000", 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188446+0000", 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188460+0000", 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3933e-05 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188475+0000", 2024-04-23T23:39:33.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.4248e-05 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188480+0000", 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8810000000000001e-06 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188511+0000", 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0261e-05 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188517+0000", 2024-04-23T23:39:33.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5080000000000002e-06 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207566+0000", 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16617036900000001, 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.169996227, 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207566+0000", 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207566+0000", 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207567+0000", 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207569+0000", 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.137e-06 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207575+0000", 2024-04-23T23:39:33.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8629999999999996e-06 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207580+0000", 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000004e-06 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207676+0000", 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6265000000000001e-05 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207684+0000", 2024-04-23T23:39:33.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6320000000000008e-06 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269497 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208415+0000", 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16532121, 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16918098100000001, 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.784 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269497 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208415+0000", 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208415+0000", 2024-04-23T23:39:33.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208416+0000", 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2500000000000005e-07 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208419+0000", 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5790000000000002e-06 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208424+0000", 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9209999999999997e-06 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208429+0000", 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.006e-06 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208923+0000", 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00049319999999999995 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208930+0000", 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0870000000000001e-06 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211297+0000", 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16243923699999999, 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16633150699999999, 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211297+0000", 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211297+0000", 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211298+0000", 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211300+0000", 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211303+0000", 2024-04-23T23:39:33.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.76e-06 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211307+0000", 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6119999999999999e-06 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211612+0000", 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00030521200000000002 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211621+0000", 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7050000000000005e-06 2024-04-23T23:39:33.791 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269495 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.212085+0000", 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16165205799999999, 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.165578327, 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269495 2024-04-23T23:39:33.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212085+0000", 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212085+0000", 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212085+0000", 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7599999999999998e-07 2024-04-23T23:39:33.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212092+0000", 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9059999999999996e-06 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212096+0000", 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2660000000000003e-06 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212101+0000", 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5879999999999999e-06 2024-04-23T23:39:33.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212909+0000", 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00080866900000000003 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212913+0000", 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7799999999999998e-06 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272133 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.795 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225672+0000", 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14806427, 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.152041378, 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272133 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225672+0000", 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225672+0000", 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225673+0000", 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9900000000000001e-07 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225676+0000", 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.717e-06 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225682+0000", 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1879999999999999e-06 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225687+0000", 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2850000000000002e-06 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225784+0000", 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6503999999999996e-05 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225791+0000", 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0249999999999997e-06 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272468 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.799 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.234577+0000", 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.139159435, 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.143192868, 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272468 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234577+0000", 2024-04-23T23:39:33.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234577+0000", 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234577+0000", 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3999999999999997e-07 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234579+0000", 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0440000000000001e-06 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234582+0000", 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.994e-06 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234584+0000", 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8250000000000001e-06 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234687+0000", 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000103138 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.234695+0000", 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0679999999999999e-06 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272533 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.236933+0000", 2024-04-23T23:39:33.803 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13680366599999999, 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.140902948, 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272533 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236933+0000", 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236933+0000", 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236933+0000", 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0200000000000003e-07 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236935+0000", 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.751e-06 2024-04-23T23:39:33.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236942+0000", 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4880000000000004e-06 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236947+0000", 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9599999999999999e-06 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237021+0000", 2024-04-23T23:39:33.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4071000000000003e-05 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237028+0000", 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0949999999999998e-06 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18760985799999999, 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19177165600000001, 2024-04-23T23:39:33.807 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:39:33.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269476 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188490+0000", 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18524611199999999, 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18957758799999999, 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.811 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269476 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188490+0000", 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188490+0000", 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188491+0000", 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1600000000000001e-07 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188493+0000", 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3300000000000001e-06 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188500+0000", 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4289999999999998e-06 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188505+0000", 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3519999999999997e-06 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188540+0000", 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4487999999999999e-05 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188547+0000", 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4780000000000002e-06 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207586+0000", 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166150406, 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17051624600000001, 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.815 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207586+0000", 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207586+0000", 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207587+0000", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207589+0000", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9300000000000002e-06 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207594+0000", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7420000000000003e-06 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207606+0000", 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1416999999999999e-05 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207712+0000", 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000105954 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207716+0000", 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0550000000000001e-06 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269498 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.208436+0000", 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165300897, 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16970244900000001, 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269498 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.819 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208436+0000", 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208436+0000", 2024-04-23T23:39:33.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208436+0000", 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6100000000000001e-07 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208438+0000", 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208444+0000", 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.083e-06 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208450+0000", 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3159999999999996e-06 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208954+0000", 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00050474700000000005 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208962+0000", 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211333+0000", 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16240396300000001, 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16683925499999999, 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.824 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211333+0000", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211333+0000", 2024-04-23T23:39:33.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211333+0000", 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3300000000000002e-07 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211336+0000", 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5859999999999999e-06 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211342+0000", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1160000000000004e-06 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211347+0000", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.826e-06 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211658+0000", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00031105 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211665+0000", 2024-04-23T23:39:33.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4610000000000002e-06 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269496 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.212107+0000", 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16162918700000001, 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16609741, 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.828 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269496 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212107+0000", 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212107+0000", 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212108+0000", 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212110+0000", 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212116+0000", 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0240000000000003e-06 2024-04-23T23:39:33.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212121+0000", 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3970000000000002e-06 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212938+0000", 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00081677900000000001 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212943+0000", 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0459999999999996e-06 2024-04-23T23:39:33.831 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272134 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225758+0000", 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.147978743, 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15248070599999999, 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.832 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272134 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225758+0000", 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225758+0000", 2024-04-23T23:39:33.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225758+0000", 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2300000000000001e-07 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225774+0000", 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5543e-05 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225802+0000", 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8155999999999999e-05 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225808+0000", 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9109999999999998e-06 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225843+0000", 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.54e-05 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225850+0000", 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0709999999999997e-06 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272541 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.236952+0000", 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136784286, 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.141318586, 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.836 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272541 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236952+0000", 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236952+0000", 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236953+0000", 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236955+0000", 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8920000000000001e-06 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236960+0000", 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7440000000000004e-06 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236965+0000", 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8690000000000003e-06 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237052+0000", 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6734e-05 2024-04-23T23:39:33.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237059+0000", 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.187564854, 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.192132621, 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.840 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:33.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:39:33.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269481 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188513+0000", 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18522381600000001, 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.18982569099999999, 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269481 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188513+0000", 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188513+0000", 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188513+0000", 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188515+0000", 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9300000000000002e-06 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188521+0000", 2024-04-23T23:39:33.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.976e-06 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188526+0000", 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.215e-06 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188578+0000", 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1498000000000001e-05 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188586+0000", 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1880000000000002e-06 2024-04-23T23:39:33.847 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272133 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204382+0000", 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.169354588, 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17398870399999999, 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.848 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272133 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204382+0000", 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204382+0000", 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204383+0000", 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4700000000000001e-07 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204386+0000", 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3409999999999999e-06 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204393+0000", 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.781e-06 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204398+0000", 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4020000000000001e-06 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204436+0000", 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7604000000000001e-05 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204443+0000", 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1969999999999999e-06 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.851 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207613+0000", 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166123832, 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.170791424, 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.852 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207613+0000", 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207613+0000", 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207613+0000", 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.53e-07 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207615+0000", 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.119e-06 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207619+0000", 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9380000000000002e-06 2024-04-23T23:39:33.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207622+0000", 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1030000000000002e-06 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207760+0000", 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00013758600000000001 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207768+0000", 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5529999999999993e-06 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.855 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211354+0000", 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16238307599999999, 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167083234, 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.856 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211354+0000", 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211354+0000", 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211354+0000", 2024-04-23T23:39:33.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0699999999999997e-07 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211356+0000", 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9300000000000002e-06 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211362+0000", 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1990000000000003e-06 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211367+0000", 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6489999999999999e-06 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211702+0000", 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033532899999999999 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211710+0000", 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6820000000000003e-06 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269497 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.212128+0000", 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16160872000000001, 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.166348897, 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269497 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212128+0000", 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212128+0000", 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212128+0000", 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7700000000000004e-07 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212131+0000", 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3159999999999999e-06 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212137+0000", 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.998e-06 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212141+0000", 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-06 2024-04-23T23:39:33.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212964+0000", 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00082276199999999999 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212968+0000", 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8820000000000003e-06 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272141 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225820+0000", 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14791663199999999, 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15268964199999999, 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272141 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225820+0000", 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225820+0000", 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225820+0000", 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.13e-07 2024-04-23T23:39:33.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225828+0000", 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3490000000000003e-06 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225854+0000", 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6046000000000001e-05 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225870+0000", 2024-04-23T23:39:33.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5763000000000001e-05 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225903+0000", 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3447e-05 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225910+0000", 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7689999999999999e-06 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272542 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.236982+0000", 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13675425399999999, 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.141560983, 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272542 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236982+0000", 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236982+0000", 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236983+0000", 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.68e-07 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236985+0000", 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.57e-06 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236991+0000", 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8560000000000003e-06 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.236997+0000", 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5999999999999997e-06 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237083+0000", 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6020000000000007e-05 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237090+0000", 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9439999999999999e-06 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:33.871 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18752983600000001, 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19237203, 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:39:33.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:39:33.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269487 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188594+0000", 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18514250700000001, 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.190027999, 2024-04-23T23:39:33.875 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269487 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188594+0000", 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188594+0000", 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188595+0000", 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188597+0000", 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7e-06 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188604+0000", 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6080000000000001e-06 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188609+0000", 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5589999999999996e-06 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188651+0000", 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1511999999999998e-05 2024-04-23T23:39:33.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188658+0000", 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4819999999999997e-06 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272134 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204410+0000", 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16932628199999999, 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.174249442, 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.879 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272134 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204410+0000", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204410+0000", 2024-04-23T23:39:33.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204411+0000", 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0299999999999999e-07 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204413+0000", 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1670000000000002e-06 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204419+0000", 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9739999999999999e-06 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204424+0000", 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3700000000000003e-06 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204755+0000", 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033041499999999997 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204763+0000", 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7190000000000007e-06 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269337 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207632+0000", 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16610472800000001, 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.171062359, 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.883 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269337 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207632+0000", 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207632+0000", 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207632+0000", 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8500000000000002e-07 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207640+0000", 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1119999999999996e-06 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207644+0000", 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.941e-06 2024-04-23T23:39:33.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207647+0000", 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.027e-06 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207805+0000", 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015763299999999999 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207813+0000", 2024-04-23T23:39:33.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211382+0000", 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16235469, 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.167346989, 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.887 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211382+0000", 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211382+0000", 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211382+0000", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211384+0000", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7010000000000001e-06 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211388+0000", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8190000000000002e-06 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211391+0000", 2024-04-23T23:39:33.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9270000000000001e-06 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211753+0000", 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036184299999999998 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211761+0000", 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.405e-06 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269498 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.212147+0000", 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16158940999999999, 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.166615136, 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269498 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.891 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212147+0000", 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212147+0000", 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212148+0000", 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5999999999999999e-07 2024-04-23T23:39:33.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212150+0000", 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3379999999999999e-06 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212156+0000", 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6629999999999998e-06 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212160+0000", 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5870000000000003e-06 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212984+0000", 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00082374599999999998 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212990+0000", 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9680000000000003e-06 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272147 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.894 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225881+0000", 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14785516100000001, 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15291816999999999, 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272147 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225881+0000", 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225881+0000", 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225882+0000", 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225884+0000", 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0159999999999998e-06 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225888+0000", 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4159999999999997e-06 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225892+0000", 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3550000000000001e-06 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225933+0000", 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1749999999999998e-05 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225940+0000", 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2330000000000003e-06 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272549 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237015+0000", 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136722011, 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14181917399999999, 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272549 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237015+0000", 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237015+0000", 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237015+0000", 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3499999999999996e-07 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237017+0000", 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0880000000000002e-06 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237023+0000", 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8730000000000004e-06 2024-04-23T23:39:33.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237028+0000", 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8860000000000003e-06 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237119+0000", 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0645999999999999e-05 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237127+0000", 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7749999999999998e-06 2024-04-23T23:39:33.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.187188453, 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19231974499999999, 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.902 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:39:33.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269488 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188666+0000", 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.185070333, 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19024865799999999, 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.906 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269488 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188666+0000", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188666+0000", 2024-04-23T23:39:33.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188667+0000", 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188669+0000", 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.475e-06 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188675+0000", 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2280000000000003e-06 2024-04-23T23:39:33.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188680+0000", 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9019999999999998e-06 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188735+0000", 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4462999999999997e-05 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188744+0000", 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2669999999999995e-06 2024-04-23T23:39:33.909 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272141 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204723+0000", 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16901354299999999, 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17422620999999999, 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.910 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272141 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204723+0000", 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204723+0000", 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204724+0000", 2024-04-23T23:39:33.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5600000000000005e-07 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204727+0000", 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5420000000000001e-06 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204734+0000", 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.109e-06 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204740+0000", 2024-04-23T23:39:33.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204791+0000", 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0553999999999997e-05 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204799+0000", 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0460000000000006e-06 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269338 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207670+0000", 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166066359, 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17131436899999999, 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269338 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.914 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207670+0000", 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207670+0000", 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207671+0000", 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.46e-07 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.915 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207673+0000", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.481e-06 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207680+0000", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6420000000000001e-06 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207685+0000", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1309999999999997e-06 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207843+0000", 2024-04-23T23:39:33.916 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000157944 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207849+0000", 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5309999999999998e-06 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211394+0000", 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16234233300000001, 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16762566600000001, 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.917 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211394+0000", 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.918 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211394+0000", 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211394+0000", 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211396+0000", 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1170000000000001e-06 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.919 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211399+0000", 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0120000000000001e-06 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211402+0000", 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0580000000000002e-06 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211791+0000", 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00038981699999999998 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.920 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211799+0000", 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5680000000000002e-06 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272148 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225898+0000", 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14783868999999999, 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15315456999999999, 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.921 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272148 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225898+0000", 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.922 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225898+0000", 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225898+0000", 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1600000000000001e-07 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225901+0000", 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2589999999999999e-06 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.923 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225906+0000", 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.395e-06 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225909+0000", 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.734e-06 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225961+0000", 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1761000000000001e-05 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.924 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225967+0000", 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.314e-06 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272550 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237046+0000", 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13669020800000001, 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14203971800000001, 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.925 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272550 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237046+0000", 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237046+0000", 2024-04-23T23:39:33.926 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237047+0000", 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.37e-07 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237049+0000", 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.984e-06 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.927 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237055+0000", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3369999999999996e-06 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237060+0000", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7539999999999997e-06 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237153+0000", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2983000000000001e-05 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237160+0000", 2024-04-23T23:39:33.928 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3690000000000001e-06 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18715368900000001, 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.192536499, 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.929 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.930 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:39:33.931 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.932 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269489 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188699+0000", 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18503793900000001, 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19047534499999999, 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269489 2024-04-23T23:39:33.933 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188699+0000", 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188699+0000", 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.934 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188699+0000", 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0900000000000002e-07 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188702+0000", 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3949999999999999e-06 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188709+0000", 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5730000000000002e-06 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.935 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188715+0000", 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6420000000000004e-06 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188772+0000", 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7324999999999997e-05 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188781+0000", 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8279999999999992e-06 2024-04-23T23:39:33.936 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272147 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204751+0000", 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16898598500000001, 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17446305000000001, 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.937 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272147 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204751+0000", 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204751+0000", 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.938 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204751+0000", 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204753+0000", 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2129999999999998e-06 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204760+0000", 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3160000000000002e-06 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204765+0000", 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2290000000000002e-06 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204821+0000", 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6393e-05 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204829+0000", 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4039999999999998e-06 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.940 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269339 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207710+0000", 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16602693199999999, 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17154024200000001, 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269339 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.941 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207710+0000", 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207710+0000", 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207710+0000", 2024-04-23T23:39:33.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8800000000000002e-07 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207713+0000", 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7690000000000001e-06 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207719+0000", 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207725+0000", 2024-04-23T23:39:33.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2410000000000003e-06 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207883+0000", 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015870200000000001 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207891+0000", 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5769999999999996e-06 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269337 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211435+0000", 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16230129600000001, 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16784860200000001, 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269337 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211435+0000", 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211435+0000", 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211436+0000", 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.99e-07 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211439+0000", 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4920000000000002e-06 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211445+0000", 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211451+0000", 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0020000000000003e-06 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211835+0000", 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00038349199999999998 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211843+0000", 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0239999999999997e-06 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272164 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.948 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225914+0000", 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14782265, 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15340290700000001, 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272164 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225914+0000", 2024-04-23T23:39:33.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225914+0000", 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225914+0000", 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225916+0000", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9800000000000001e-06 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225922+0000", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.677e-06 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225927+0000", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6800000000000001e-06 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225988+0000", 2024-04-23T23:39:33.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1135000000000003e-05 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225994+0000", 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3740000000000003e-06 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272243 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.228385+0000", 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.145351806, 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.150966613, 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.952 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272243 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228385+0000", 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228385+0000", 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228385+0000", 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3799999999999998e-07 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228387+0000", 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.12e-06 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228391+0000", 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4479999999999999e-06 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228393+0000", 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228436+0000", 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2451999999999999e-05 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228445+0000", 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0899999999999994e-06 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.187130934, 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.192779846, 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.956 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269490 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188722+0000", 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18501461499999999, 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.190724537, 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.960 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269490 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188722+0000", 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188722+0000", 2024-04-23T23:39:33.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188722+0000", 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7399999999999999e-07 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188724+0000", 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0090000000000002e-06 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188730+0000", 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1449999999999996e-06 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188736+0000", 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.181e-06 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188807+0000", 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0970000000000007e-05 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188814+0000", 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5079999999999999e-06 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272148 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204787+0000", 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16894977799999999, 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.174729256, 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.964 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272148 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204787+0000", 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204787+0000", 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204787+0000", 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9100000000000004e-07 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204790+0000", 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7089999999999998e-06 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204797+0000", 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5830000000000003e-06 2024-04-23T23:39:33.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204802+0000", 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5289999999999999e-06 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204847+0000", 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4644000000000001e-05 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204854+0000", 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0759999999999997e-06 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.967 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269340 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207731+0000", 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.166005496, 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.171853278, 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.968 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269340 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207731+0000", 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207731+0000", 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207731+0000", 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207734+0000", 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.075e-06 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207738+0000", 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9030000000000003e-06 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207743+0000", 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4989999999999996e-06 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207926+0000", 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018328999999999999 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207933+0000", 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2150000000000004e-06 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.971 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269338 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211463+0000", 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16227377700000001, 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16817980699999999, 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269338 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211463+0000", 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211463+0000", 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211463+0000", 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211470+0000", 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3799999999999999e-06 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211480+0000", 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0428000000000001e-05 2024-04-23T23:39:33.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211485+0000", 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2750000000000003e-06 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211878+0000", 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039221299999999998 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211885+0000", 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0190000000000001e-06 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.975 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272170 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.225941+0000", 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14779567399999999, 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.153735382, 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272170 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.976 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225941+0000", 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225941+0000", 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225942+0000", 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1799999999999995e-07 2024-04-23T23:39:33.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225945+0000", 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0649999999999999e-06 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225952+0000", 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3509999999999996e-06 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.225958+0000", 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6380000000000001e-06 2024-04-23T23:39:33.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226016+0000", 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8329999999999999e-05 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226022+0000", 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3090000000000001e-06 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272248 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.979 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.228405+0000", 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14533204699999999, 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.151305565, 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272248 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228405+0000", 2024-04-23T23:39:33.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228405+0000", 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228405+0000", 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3099999999999998e-07 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228407+0000", 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9369999999999998e-06 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228413+0000", 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.604e-06 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228418+0000", 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9339999999999997e-06 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228478+0000", 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0089e-05 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228509+0000", 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1649000000000001e-05 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269495 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188742+0000", 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18499489299999999, 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19100224599999999, 2024-04-23T23:39:33.983 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269495 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188742+0000", 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188742+0000", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188742+0000", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8599999999999999e-07 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188744+0000", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9520000000000001e-06 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188750+0000", 2024-04-23T23:39:33.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7239999999999997e-06 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188755+0000", 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9400000000000001e-06 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188842+0000", 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7373000000000005e-05 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188850+0000", 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7589999999999997e-06 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272164 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204817+0000", 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.168919878, 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17498180099999999, 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.987 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272164 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204817+0000", 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204817+0000", 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204817+0000", 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7800000000000002e-07 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204820+0000", 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3350000000000001e-06 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204826+0000", 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5470000000000002e-06 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204831+0000", 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.006e-06 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204872+0000", 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0621999999999998e-05 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204879+0000", 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8789999999999997e-06 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.990 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.186858303, 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.192990255, 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.991 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:39:33.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269496 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.994 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188762+0000", 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18497454699999999, 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19117574200000001, 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269496 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188762+0000", 2024-04-23T23:39:33.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188762+0000", 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188762+0000", 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:33.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188764+0000", 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9889999999999999e-06 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188770+0000", 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8939999999999998e-06 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188775+0000", 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8749999999999999e-06 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:33.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188876+0000", 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100958 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188884+0000", 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2099999999999993e-06 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269362 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207749+0000", 2024-04-23T23:39:33.998 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16598763, 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.172238159, 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269362 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:33.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207749+0000", 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207749+0000", 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207749+0000", 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.39e-07 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207752+0000", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1490000000000001e-06 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207755+0000", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.529e-06 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207759+0000", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1320000000000004e-06 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207976+0000", 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00021705699999999999 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207985+0000", 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4579999999999993e-06 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269339 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211495+0000", 2024-04-23T23:39:34.002 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16224118700000001, 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16852546800000001, 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269339 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211495+0000", 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211495+0000", 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211496+0000", 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1900000000000003e-07 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211508+0000", 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1765e-05 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211523+0000", 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5585000000000001e-05 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211533+0000", 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0152999999999999e-05 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211916+0000", 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00038297800000000002 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211924+0000", 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.401e-06 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272252 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.228523+0000", 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14521402, 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15153260700000001, 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.006 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272252 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228523+0000", 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228523+0000", 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228523+0000", 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4099999999999998e-07 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228527+0000", 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4709999999999999e-06 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228534+0000", 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0779999999999998e-06 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228540+0000", 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8420000000000001e-06 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228592+0000", 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2747000000000002e-05 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228600+0000", 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6359999999999994e-06 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272577 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237150+0000", 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136586551, 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14293825199999999, 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272577 2024-04-23T23:39:34.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237150+0000", 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237150+0000", 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237151+0000", 2024-04-23T23:39:34.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2399999999999998e-07 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237163+0000", 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2252000000000001e-05 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237168+0000", 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6459999999999998e-06 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237173+0000", 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8389999999999997e-06 2024-04-23T23:39:34.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237230+0000", 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6614999999999999e-05 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237238+0000", 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6190000000000002e-06 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.186825673, 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.193214049, 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269497 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188783+0000", 2024-04-23T23:39:34.017 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.184953915, 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.191376449, 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269497 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188783+0000", 2024-04-23T23:39:34.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188783+0000", 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188783+0000", 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4999999999999998e-07 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188785+0000", 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.874e-06 2024-04-23T23:39:34.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188791+0000", 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0090000000000004e-06 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188796+0000", 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6840000000000004e-06 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188911+0000", 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00011589 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188920+0000", 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9029999999999993e-06 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272170 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.204860+0000", 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16887687800000001, 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17533206400000001, 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.021 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272170 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204860+0000", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204860+0000", 2024-04-23T23:39:34.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204860+0000", 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7000000000000001e-07 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204861+0000", 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.128e-06 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204864+0000", 2024-04-23T23:39:34.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.117e-06 2024-04-23T23:39:34.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204867+0000", 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.852e-06 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204896+0000", 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8742999999999999e-05 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.204900+0000", 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7610000000000001e-06 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269363 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207765+0000", 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165971744, 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17246038299999999, 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.027 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269363 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207765+0000", 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207765+0000", 2024-04-23T23:39:34.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207765+0000", 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5899999999999996e-07 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207767+0000", 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207774+0000", 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4960000000000001e-06 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207779+0000", 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8579999999999999e-06 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208023+0000", 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00024448200000000002 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208031+0000", 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1750000000000005e-06 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269340 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211544+0000", 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.162193003, 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16871419800000001, 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.031 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269340 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211544+0000", 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211544+0000", 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211544+0000", 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0999999999999999e-07 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211546+0000", 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4150000000000002e-06 2024-04-23T23:39:34.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211552+0000", 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8629999999999996e-06 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211558+0000", 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4269999999999999e-06 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211953+0000", 2024-04-23T23:39:34.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00039554500000000002 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211960+0000", 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7769999999999997e-06 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272187 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.226011+0000", 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.147725632, 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.154280425, 2024-04-23T23:39:34.035 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272187 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226011+0000", 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226011+0000", 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226011+0000", 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4900000000000001e-07 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226014+0000", 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2199999999999999e-06 2024-04-23T23:39:34.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226020+0000", 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6880000000000002e-06 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226025+0000", 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.651e-06 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226056+0000", 2024-04-23T23:39:34.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1608e-05 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226063+0000", 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6220000000000003e-06 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272578 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237180+0000", 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13655624399999999, 2024-04-23T23:39:34.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14314328400000001, 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272578 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237180+0000", 2024-04-23T23:39:34.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237180+0000", 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237181+0000", 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237183+0000", 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.86e-06 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237188+0000", 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3789999999999997e-06 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237193+0000", 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9729999999999997e-06 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237263+0000", 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9617999999999997e-05 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237270+0000", 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6389999999999992e-06 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:34.043 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18662045899999999, 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19324159399999999, 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:39:34.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269498 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.188802+0000", 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.184934082, 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.191588912, 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.047 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269498 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188802+0000", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188802+0000", 2024-04-23T23:39:34.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188803+0000", 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188805+0000", 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.968e-06 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188811+0000", 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7620000000000001e-06 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188815+0000", 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2690000000000001e-06 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188947+0000", 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00013221700000000001 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.188955+0000", 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5989999999999996e-06 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269371 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207784+0000", 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165952563, 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17263975500000001, 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.051 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269371 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207784+0000", 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207784+0000", 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207784+0000", 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.72e-07 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207786+0000", 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8959999999999999e-06 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207792+0000", 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6400000000000002e-06 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207796+0000", 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4900000000000002e-06 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208071+0000", 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00027460499999999998 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208078+0000", 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4370000000000001e-06 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.054 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269362 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211566+0000", 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16217026000000001, 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16889520399999999, 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269362 2024-04-23T23:39:34.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211566+0000", 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211566+0000", 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211567+0000", 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211569+0000", 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1890000000000001e-06 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211575+0000", 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8590000000000001e-06 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211579+0000", 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5600000000000004e-06 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211996+0000", 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041634700000000002 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212003+0000", 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5329999999999997e-06 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.058 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272188 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.226036+0000", 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14770069399999999, 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.154464621, 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272188 2024-04-23T23:39:34.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226036+0000", 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226036+0000", 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226036+0000", 2024-04-23T23:39:34.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0699999999999997e-07 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226039+0000", 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.12e-06 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226045+0000", 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3210000000000001e-06 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226050+0000", 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8910000000000003e-06 2024-04-23T23:39:34.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226084+0000", 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4450999999999999e-05 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.226091+0000", 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3779999999999998e-06 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272584 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237200+0000", 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136537028, 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14333504799999999, 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272584 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237200+0000", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237200+0000", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237200+0000", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1899999999999998e-07 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237202+0000", 2024-04-23T23:39:34.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.66e-06 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237207+0000", 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4140000000000002e-06 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237211+0000", 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.301e-06 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237296+0000", 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4263000000000003e-05 2024-04-23T23:39:34.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237449+0000", 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00015296299999999999 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.066 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18653746199999999, 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.193369603, 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:39:34.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269372 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207803+0000", 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16593323500000001, 2024-04-23T23:39:34.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17279765399999999, 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269372 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207803+0000", 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207803+0000", 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207804+0000", 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9999999999999999e-07 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207805+0000", 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3489999999999999e-06 2024-04-23T23:39:34.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207809+0000", 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9589999999999997e-06 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207817+0000", 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4349999999999997e-06 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208128+0000", 2024-04-23T23:39:34.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00031094199999999998 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208136+0000", 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7710000000000006e-06 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269363 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211586+0000", 2024-04-23T23:39:34.074 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16215080800000001, 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16904913099999999, 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269363 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211586+0000", 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211586+0000", 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211586+0000", 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8099999999999998e-07 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211588+0000", 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8810000000000001e-06 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211594+0000", 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8969999999999996e-06 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211599+0000", 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7720000000000002e-06 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212037+0000", 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00043783100000000002 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212042+0000", 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5879999999999997e-06 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272271 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.228657+0000", 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14507962499999999, 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15201034999999999, 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.078 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272271 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228657+0000", 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228657+0000", 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228658+0000", 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5799999999999999e-07 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228660+0000", 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1469999999999999e-06 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228666+0000", 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8340000000000001e-06 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228671+0000", 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.006e-06 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228716+0000", 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4603e-05 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228724+0000", 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2989999999999997e-06 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272591 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237218+0000", 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.136519005, 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14348293200000001, 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.082 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272591 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237218+0000", 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237218+0000", 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237218+0000", 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5900000000000003e-07 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237220+0000", 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9750000000000001e-06 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237226+0000", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8370000000000002e-06 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237231+0000", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8130000000000003e-06 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237478+0000", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000247834 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237484+0000", 2024-04-23T23:39:34.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6019999999999999e-06 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269337 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187273+0000", 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.186463563, 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19346002400000001, 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.086 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269337 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187273+0000", 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187273+0000", 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187274+0000", 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7299999999999996e-07 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187276+0000", 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.74e-06 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187283+0000", 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.562e-06 2024-04-23T23:39:34.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187288+0000", 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4079999999999997e-06 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187329+0000", 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1077e-05 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187337+0000", 2024-04-23T23:39:34.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8390000000000007e-06 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272187 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.205111+0000", 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16862580499999999, 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.175655968, 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272187 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205111+0000", 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205111+0000", 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205111+0000", 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205118+0000", 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9179999999999997e-06 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205124+0000", 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2580000000000001e-06 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205130+0000", 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205166+0000", 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6263000000000002e-05 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205173+0000", 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3309999999999998e-06 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.093 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269373 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207837+0000", 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16589949600000001, 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17296488800000001, 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.094 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269373 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207837+0000", 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207837+0000", 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207838+0000", 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6400000000000002e-07 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207840+0000", 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.125e-06 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207846+0000", 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7429999999999999e-06 2024-04-23T23:39:34.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207850+0000", 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.977e-06 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208184+0000", 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033336100000000001 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208192+0000", 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0199999999999994e-06 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.097 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269371 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211606+0000", 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16213058699999999, 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.169228499, 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.098 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269371 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211606+0000", 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211606+0000", 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211606+0000", 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.77e-07 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211608+0000", 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211614+0000", 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8250000000000001e-06 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211619+0000", 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7369999999999997e-06 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212060+0000", 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00044082700000000003 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212064+0000", 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.811e-06 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272272 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.228685+0000", 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14505200700000001, 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.152183395, 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272272 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.102 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228685+0000", 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228685+0000", 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228685+0000", 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:39:34.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228687+0000", 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1490000000000001e-06 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228693+0000", 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9309999999999996e-06 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228698+0000", 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1170000000000003e-06 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228748+0000", 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0068000000000002e-05 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228755+0000", 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9310000000000002e-06 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272592 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237237+0000", 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13649973900000001, 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14366327300000001, 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272592 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237237+0000", 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237237+0000", 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237297+0000", 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9848e-05 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237303+0000", 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237310+0000", 2024-04-23T23:39:34.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7510000000000002e-06 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237316+0000", 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.57e-06 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237498+0000", 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018189500000000001 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237501+0000", 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6169999999999998e-06 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269338 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187348+0000", 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.186388582, 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19358551800000001, 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269338 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187348+0000", 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187348+0000", 2024-04-23T23:39:34.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187349+0000", 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7599999999999997e-07 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187352+0000", 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1810000000000001e-06 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187359+0000", 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1520000000000003e-06 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187365+0000", 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.246e-06 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187406+0000", 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0546000000000001e-05 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187413+0000", 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7149999999999998e-06 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272188 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.205140+0000", 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16859675800000001, 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.175826708, 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272188 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205140+0000", 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205140+0000", 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205140+0000", 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3600000000000004e-07 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205142+0000", 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0880000000000002e-06 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205148+0000", 2024-04-23T23:39:34.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6969999999999998e-06 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205155+0000", 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0010000000000004e-06 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205190+0000", 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5011000000000001e-05 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.205195+0000", 2024-04-23T23:39:34.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4800000000000003e-06 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269374 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207880+0000", 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16585639299999999, 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17311985299999999, 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269374 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207880+0000", 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207880+0000", 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207881+0000", 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1800000000000001e-07 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207883+0000", 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7460000000000001e-06 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207890+0000", 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2940000000000002e-06 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207895+0000", 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.801e-06 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208228+0000", 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033276999999999997 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208236+0000", 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5109999999999997e-06 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.121 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269372 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211625+0000", 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16211183600000001, 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16940865199999999, 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269372 2024-04-23T23:39:34.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211625+0000", 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211625+0000", 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211625+0000", 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.96e-07 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211627+0000", 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9139999999999998e-06 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211634+0000", 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211639+0000", 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7040000000000002e-06 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212092+0000", 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00045321599999999999 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212102+0000", 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0052e-05 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272604 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237325+0000", 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13641163100000001, 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14374076799999999, 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272604 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.126 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237325+0000", 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237325+0000", 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237325+0000", 2024-04-23T23:39:34.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5000000000000003e-07 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237328+0000", 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5349999999999999e-06 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237334+0000", 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4400000000000002e-06 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237340+0000", 2024-04-23T23:39:34.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0090000000000004e-06 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237513+0000", 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000172106 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237516+0000", 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5140000000000002e-06 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269339 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187424+0000", 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18631281699999999, 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19367562199999999, 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269339 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187424+0000", 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187424+0000", 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187424+0000", 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7599999999999997e-07 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187427+0000", 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5639999999999999e-06 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187433+0000", 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1029999999999998e-06 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187438+0000", 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187488+0000", 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0166e-05 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187496+0000", 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269375 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207917+0000", 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16581969399999999, 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17321495100000001, 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269375 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207917+0000", 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207917+0000", 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207917+0000", 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1600000000000001e-07 2024-04-23T23:39:34.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207920+0000", 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3929999999999998e-06 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207927+0000", 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9160000000000004e-06 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207932+0000", 2024-04-23T23:39:34.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208275+0000", 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00034313099999999999 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208283+0000", 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6529999999999994e-06 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269373 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211650+0000", 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16208661099999999, 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16951535700000001, 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269373 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.138 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211650+0000", 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211650+0000", 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211650+0000", 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2500000000000001e-07 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211652+0000", 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211658+0000", 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6289999999999998e-06 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211661+0000", 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1879999999999998e-06 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212199+0000", 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053812100000000002 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212211+0000", 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1345999999999999e-05 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272279 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.228705+0000", 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14503164700000001, 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15249521799999999, 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272279 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228705+0000", 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.228705+0000", 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230472+0000", 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001766611 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230476+0000", 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6360000000000002e-06 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230487+0000", 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0613e-05 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230494+0000", 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9040000000000003e-06 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230556+0000", 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2408000000000003e-05 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230566+0000", 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.482e-06 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.145 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272387 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232614+0000", 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.141122213, 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14861824500000001, 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272387 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232614+0000", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232614+0000", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232615+0000", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3299999999999998e-07 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232617+0000", 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.84e-06 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232622+0000", 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6960000000000002e-06 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232627+0000", 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6609999999999999e-06 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232668+0000", 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0664000000000002e-05 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232674+0000", 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3369999999999996e-06 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269340 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.149 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187507+0000", 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.186229488, 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.193759141, 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269340 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187507+0000", 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187507+0000", 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187508+0000", 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187510+0000", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.757e-06 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187517+0000", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5309999999999998e-06 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187522+0000", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9239999999999998e-06 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187563+0000", 2024-04-23T23:39:34.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1430000000000001e-05 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187572+0000", 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.4759999999999998e-06 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269383 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207939+0000", 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16579759499999999, 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.173359443, 2024-04-23T23:39:34.153 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269383 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207939+0000", 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207939+0000", 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207940+0000", 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999996e-07 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207942+0000", 2024-04-23T23:39:34.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207947+0000", 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7819999999999999e-06 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207952+0000", 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8779999999999997e-06 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208321+0000", 2024-04-23T23:39:34.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036906999999999999 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208329+0000", 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7810000000000005e-06 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269374 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211666+0000", 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.162071037, 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.16966690600000001, 2024-04-23T23:39:34.157 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269374 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211666+0000", 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211666+0000", 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211666+0000", 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5800000000000001e-07 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211667+0000", 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.313e-06 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211671+0000", 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.279e-06 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211676+0000", 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9989999999999999e-06 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212249+0000", 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00057247999999999999 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212257+0000", 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2460000000000003e-06 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272283 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230519+0000", 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.143217807, 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15084597999999999, 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.161 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272283 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230519+0000", 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230519+0000", 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230519+0000", 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9200000000000001e-07 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230522+0000", 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.948e-06 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230531+0000", 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9160000000000007e-06 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230537+0000", 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2670000000000003e-06 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230606+0000", 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8181000000000003e-05 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230614+0000", 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3839999999999997e-06 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272388 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.232636+0000", 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14110043999999999, 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.14876231300000001, 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.165 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272388 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232636+0000", 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232636+0000", 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232637+0000", 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232638+0000", 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5460000000000001e-06 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232643+0000", 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9300000000000002e-06 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232646+0000", 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7879999999999998e-06 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232695+0000", 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.952e-05 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.232700+0000", 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.318e-06 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272609 3.14 3.aa7cb594 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.237370+0000", 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.13636627200000001, 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.144069323, 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272609 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237370+0000", 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237370+0000", 2024-04-23T23:39:34.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237402+0000", 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.1408999999999997e-05 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237405+0000", 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8270000000000002e-06 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237412+0000", 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5220000000000001e-06 2024-04-23T23:39:34.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237418+0000", 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8440000000000003e-06 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237528+0000", 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00010966100000000001 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.237531+0000", 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4460000000000001e-06 2024-04-23T23:39:34.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269362 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187582+0000", 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.18615446599999999, 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.19389371699999999, 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269362 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187582+0000", 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187582+0000", 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187583+0000", 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8999999999999996e-07 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187585+0000", 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.7350000000000001e-06 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187592+0000", 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0639999999999999e-06 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187596+0000", 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9989999999999999e-06 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187637+0000", 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0568000000000002e-05 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187646+0000", 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5299999999999996e-06 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269440 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.207971+0000", 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.165765997, 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.17354645799999999, 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269440 2024-04-23T23:39:34.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207971+0000", 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207971+0000", 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207971+0000", 2024-04-23T23:39:34.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207973+0000", 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207978+0000", 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8420000000000004e-06 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.207983+0000", 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1050000000000003e-06 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208359+0000", 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000376287 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.208366+0000", 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1470000000000004e-06 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269375 3.14 3.17f8e454 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.211692+0000", 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.16204425, 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.169866724, 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269375 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211692+0000", 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211692+0000", 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211693+0000", 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211695+0000", 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0820000000000001e-06 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211701+0000", 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7699999999999998e-06 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.211707+0000", 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8420000000000001e-06 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212295+0000", 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00058799199999999996 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.212304+0000", 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.3700000000000001e-06 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:272289 3.14 3.2f64a3b4 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.230547+0000", 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.14318995200000001, 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.15104810900000001, 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for peered", 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 272289 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230547+0000", 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230547+0000", 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230547+0000", 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5300000000000004e-07 2024-04-23T23:39:34.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230550+0000", 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230556+0000", 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6409999999999996e-06 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230561+0000", 2024-04-23T23:39:34.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0640000000000001e-06 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230640+0000", 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8473999999999994e-05 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.230648+0000", 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9500000000000001e-06 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.189 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:39:34.189 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 207 2024-04-23T23:39:34.189 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:34.189 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7] out_osds: [3, 0] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:34.189 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:34.189 INFO:tasks.thrashosds.thrasher:Reweighting osd 4 to 0.8255171257358875 2024-04-23T23:39:34.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 0.8255171257358875 2024-04-23T23:39:34.191 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:39:34.192 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:34.192 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:34.203+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:34.291 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:34.303+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:34.334 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:34.334 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:34.334 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:34.335 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:34.335 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:34.343 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:34.391 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:34.403+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:34.446 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 89.469263241999997, 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:34.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:34.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:34.453 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.565508825000002, 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:34.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 24.449258575999998, 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:34.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:34.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:34.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.463 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.279956425, 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2724325759999999, 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.468 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.472 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.272380023, 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.473 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:39:34.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:39:34.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:39:34.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.272353222, 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.477 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.481 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2723293440000001, 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:34.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:39:34.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:39:34.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:39:34.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2723075019999999, 2024-04-23T23:39:34.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:39:34.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:39:34.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2720979479999999, 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.491 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:39:34.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:39:34.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.27204871, 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.496 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:39:34.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.500 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.272003706, 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:39:34.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2719686880000001, 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:39:34.505 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:39:34.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:39:34.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.271627305, 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:34.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:39:34.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.271592541, 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:39:34.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:39:34.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2715697859999999, 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.519 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:34.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:39:34.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2712971550000001, 2024-04-23T23:39:34.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:39:34.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:39:34.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2712645249999999, 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:39:34.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.532 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2710593110000001, 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:39:34.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.536 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 1.2709763139999999, 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:34.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:39:34.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:39:34.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:34.541 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:34.542 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:34.543 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:34.554+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:34.642 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:34.654+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:34.684 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:34.684 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:34.685 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:34.685 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:34.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:34.779 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:34.791+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:34.799 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.4 to 0.825517 (d355) 2024-04-23T23:39:34.845 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:34.845 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:34.845 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:34.845 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:34.845 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:34.854 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:34.855 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:34.867+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:34.946 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:34.958+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:34.997 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:34.997 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629883422000001, 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:34.998 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:34.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:39:35.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629864685999999, 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:39:35.002 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.006 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629846305999999, 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:35.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:39:35.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:39:35.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.010 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629827109000001, 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.014 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629590822000001, 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:39:35.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629564662, 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.019 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:35.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:39:35.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:39:35.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629544993, 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.023 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:35.027 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629526573, 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:39:35.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.031 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.629379878, 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:39:35.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.035 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.628224448999999, 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:39:35.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:39:35.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:39:35.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.627908737, 2024-04-23T23:39:35.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:39:35.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.044 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.627886706, 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.046 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.62786614, 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.049 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:39:35.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:39:35.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.627845316, 2024-04-23T23:39:35.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:39:35.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:39:35.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:39:35.057 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.625396951999999, 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.058 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:39:35.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.129383176999999, 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.062 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.066 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.129366949, 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.067 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.068 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.069 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.070 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.129350708, 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:39:35.071 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:39:35.072 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:39:35.073 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.074 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.129335465, 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 15.12931938, 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:35.079 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:35.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:35.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:39:35.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:35.083 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:35.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5678 read 0x26aa60c thru 0x26b1c19 (0x760e bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5679 punch from 0x26f9ff1 to 0x2708970, (0xe97f bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5681 write 0x84f8082 thru 0x84fe573 (0x64f2 bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5682 read 0x7bb6414 thru 0x7bbcf27 (0x6b14 bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5685 write 0x2561bd3 thru 0x2564d66 (0x3194 bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5686 punch from 0x6df5e4 to 0x6e1106, (0x1b22 bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5687 read 0x16c2257 thru 0x16cf387 (0xd131 bytes) 2024-04-23T23:39:35.086 INFO:teuthology.orchestra.run.smithi077.stdout:5688 read 0x65d4f7d thru 0x65dad31 (0x5db5 bytes) 2024-04-23T23:39:35.087 INFO:teuthology.orchestra.run.smithi077.stdout:5689 writesame 0x25a0ce6 thru 0x25a6875 data_size 0x10(0x5b90 bytes) 2024-04-23T23:39:35.087 INFO:teuthology.orchestra.run.smithi077.stdout:5691 write 0x22b97ef thru 0x22bc641 (0x2e53 bytes) 2024-04-23T23:39:35.087 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:35.097+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:35.185 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:35.197+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:35.228 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:35.229 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:35.229 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:35.229 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:35.237 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:35.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:35.291 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:35.303+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:35.363 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:35.364 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:35.380 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:35.381 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:35.381 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:35.381 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:35.381 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:35.381 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:35.381 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:35.389 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:35.392 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:35.398+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:35.397 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:35.397 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:35.397 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:35.414 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:35.414 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:35.431 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:35.432 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:35.449 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:35.449 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:35.466 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:35.469 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:35.470 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:35.487 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:35.499+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:35.496 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:35.496 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:35.504 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:35.588 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:35.600+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:35.646 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:35.647 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:35.655 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:35.689 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:35.701+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:35.757 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:35.757 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:35.765 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:35.809 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:35.821+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:35.871 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:35.871 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:35.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:35.925 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:35.937+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:35.982 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:35.982 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:35.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:36.032 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:36.044+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:36.093 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:36.105+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:36.133 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:36.133 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:36.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:36.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:39:36.193 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:36.205+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:36.287 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:36.287 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:36.294 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:36.306+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:36.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:36.396 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:36.408+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:36.440 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:36.440 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:36.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:36.496 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:36.508+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:36.590 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:36.590 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:36.596 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:36.609+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:36.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:36.698 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:36.709+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:36.740 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:36.740 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:36.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:36.798 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:36.811+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:39:36.855 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:36.855 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:36.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:36.899 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:36.911+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:37.000 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:37.012+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:37.004 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:37.005 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:37.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:37.100 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:37.112+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:37.118 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:37.118 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:37.127 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:37.201 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:37.214+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:37.252 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:37.255 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:37.255 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:37.259 INFO:teuthology.orchestra.run.smithi077.stdout:5695 write 0x97de744 thru 0x97ec168 (0xda25 bytes) 2024-04-23T23:39:37.264 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:37.266 INFO:teuthology.orchestra.run.smithi077.stdout:5697 trunc from 0x97ec169 to 0xbb54dbf 2024-04-23T23:39:37.267 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:37.272 INFO:teuthology.orchestra.run.smithi077.stdout:5698 punch from 0x39a2d20 to 0x39a9391, (0x6671 bytes) 2024-04-23T23:39:37.272 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:37.272 INFO:teuthology.orchestra.run.smithi077.stdout:5700 write 0x8fcbfa4 thru 0x8fd5b23 (0x9b80 bytes) 2024-04-23T23:39:37.276 INFO:teuthology.orchestra.run.smithi077.stdout:5701 writesame 0xc0276b thru 0xc077d1 data_size 0x3(0x5067 bytes) 2024-04-23T23:39:37.282 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:37.282 INFO:teuthology.orchestra.run.smithi077.stdout:5704 read 0x4283d96 thru 0x4293c38 (0xfea3 bytes) 2024-04-23T23:39:37.291 INFO:teuthology.orchestra.run.smithi077.stdout:5705 write 0xe07884b thru 0xe07d5c2 (0x4d78 bytes) 2024-04-23T23:39:37.296 INFO:teuthology.orchestra.run.smithi077.stdout:5706 write 0xd08b1b2 thru 0xd0941aa (0x8ff9 bytes) 2024-04-23T23:39:37.300 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:37.300 INFO:teuthology.orchestra.run.smithi077.stdout:5709 write 0xb03f77 thru 0xb0f856 (0xb8e0 bytes) 2024-04-23T23:39:37.302 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:37.314+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:37.317 INFO:teuthology.orchestra.run.smithi077.stdout:5710 write 0x9af5783 thru 0x9af94e8 (0x3d66 bytes) 2024-04-23T23:39:37.321 INFO:teuthology.orchestra.run.smithi077.stdout:5711 punch from 0xd4e6711 to 0xd4ef028, (0x8917 bytes) 2024-04-23T23:39:37.321 INFO:teuthology.orchestra.run.smithi077.stdout:5714 write 0x98753bc thru 0x9882314 (0xcf59 bytes) 2024-04-23T23:39:37.323 INFO:teuthology.orchestra.run.smithi077.stdout:5715 read 0x8ba78d2 thru 0x8bb3ec9 (0xc5f8 bytes) 2024-04-23T23:39:37.323 INFO:teuthology.orchestra.run.smithi077.stdout:5716 write 0x494e003 thru 0x4957c26 (0x9c24 bytes) 2024-04-23T23:39:37.329 INFO:teuthology.orchestra.run.smithi077.stdout:5719 punch from 0x827abfd to 0x8286215, (0xb618 bytes) 2024-04-23T23:39:37.336 INFO:teuthology.orchestra.run.smithi077.stdout:5720 trunc from 0xe07d5c3 to 0x83a51c4 2024-04-23T23:39:37.360 INFO:teuthology.orchestra.run.smithi077.stdout:5721 writesame 0x4134b55 thru 0x413b0b5 data_size 0x29(0x6561 bytes) 2024-04-23T23:39:37.362 INFO:teuthology.orchestra.run.smithi077.stdout:5723 write 0x117cc3 thru 0x119efa (0x2238 bytes) 2024-04-23T23:39:37.369 INFO:teuthology.orchestra.run.smithi077.stdout:5728 read 0x7742ebe thru 0x7747d48 (0x4e8b bytes) 2024-04-23T23:39:37.369 INFO:teuthology.orchestra.run.smithi077.stdout:5730 punch from 0x551e71 to 0x554108, (0x2297 bytes) 2024-04-23T23:39:37.369 INFO:teuthology.orchestra.run.smithi077.stdout:5731 write 0x6f21fa9 thru 0x6f306af (0xe707 bytes) 2024-04-23T23:39:37.371 INFO:teuthology.orchestra.run.smithi077.stdout:5732 read 0x106756e thru 0x10706b3 (0x9146 bytes) 2024-04-23T23:39:37.372 INFO:teuthology.orchestra.run.smithi077.stdout:5734 read 0xcf2430 thru 0xcff4e3 (0xd0b4 bytes) 2024-04-23T23:39:37.372 INFO:teuthology.orchestra.run.smithi077.stdout:5735 read 0xdcaa1b thru 0xdce004 (0x35ea bytes) 2024-04-23T23:39:37.373 INFO:teuthology.orchestra.run.smithi077.stdout:5737 punch from 0x78e0064 to 0x78e3d21, (0x3cbd bytes) 2024-04-23T23:39:37.382 INFO:teuthology.orchestra.run.smithi077.stdout:5738 write 0xada65bb thru 0xada919e (0x2be4 bytes) 2024-04-23T23:39:37.386 INFO:teuthology.orchestra.run.smithi077.stdout:5739 clone 52 order 21 su 16384 sc 10 2024-04-23T23:39:37.403 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:37.415+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:37.409 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:37.409 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:37.420 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:37.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:37.504 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:37.516+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:37.528 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:37.528 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:37.537 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:37.589 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:37.589 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:37.606 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:37.606 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:37.621 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:37.633+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:37.623 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:37.623 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:37.623 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:37.640 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:37.640 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:37.657 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:37.657 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:37.676 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:37.676 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:37.683 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:37.683 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:37.683 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:37.683 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:37.691 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:37.693 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:37.694 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:37.697 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:37.697 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:37.705 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:37.717+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:37.806 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:37.819+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:37.835 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:37.835 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:37.835 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:37.835 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:37.835 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:37.843 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:37.907 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:37.919+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:37.948 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.580305254999999, 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.580286519000001, 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.953 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.956 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.580268139000001, 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.957 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:37.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:37.961 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.580248942000001, 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.962 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.580012655000001, 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.579986495, 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:37.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:39:37.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.579966826, 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.974 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:37.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.976 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.978 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.579948406, 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:39:37.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:39:37.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.982 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.579801711000002, 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:37.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:39:37.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:39:37.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:39:37.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.578646282000001, 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.987 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.578330569999999, 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.991 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:37.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:39:37.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.578308538999998, 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:39:37.995 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:37.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:39:37.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:37.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.578287972999998, 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:39:37.999 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.578267148999998, 2024-04-23T23:39:38.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:39:38.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:39:38.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.007 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.575818784999999, 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:38.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:39:38.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:39:38.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.079805010000001, 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.079788782000001, 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.016 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.019 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.079772541000001, 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.020 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.021 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:39:38.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:39:38.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.079757298000001, 2024-04-23T23:39:38.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:38.028 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 18.079741212999998, 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:39:38.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:39:38.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.032 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:38.034 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:38.034 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:38.046+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:38.135 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:38.147+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:274256 3.12 3:4dd71c1b:::rbd_header.119467e9400f:head [watch unwatch cookie 140356177242960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:38.203718+0000", 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00033864799999999999, 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036380100000000002, 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.191 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 274256 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203718+0000", 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203718+0000", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203719+0000", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1699999999999997e-07 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203722+0000", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4809999999999998e-06 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203733+0000", 2024-04-23T23:39:38.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0637e-05 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203738+0000", 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2560000000000002e-06 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203780+0000", 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1662000000000002e-05 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203822+0000", 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2342000000000002e-05 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 1", 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:38.203896+0000", 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4108000000000003e-05 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 1 2024-04-23T23:39:38.195 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:38.196 INFO:teuthology.orchestra.run.smithi077.stdout:flattening image image_client.0-clone51 2024-04-23T23:39:38.202 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:38.243 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:38.255+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:38.337 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:38.349+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:38.346 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:38.346 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:38.346 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:38.346 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:38.346 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:38.355 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:38.379 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #50, image image_client.0-clone50 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent51 2024-04-23T23:39:38.421 INFO:teuthology.orchestra.run.smithi077.stdout:5742 writesame 0x7e10d27 thru 0x7e1dc7e data_size 0x14(0xcf58 bytes) 2024-04-23T23:39:38.439 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:38.451+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:38.508 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:38.508 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:38.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7063543159999996, 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:39:38.509 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:38.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:39:38.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:39:38.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:39:38.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.518 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7063238160000003, 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.519 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:39:38.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:39:38.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:39:38.526 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.526 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7062849389999997, 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:39:38.527 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:39:38.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:39:38.535 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:38.536 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7062542890000003, 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:38.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:39:38.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:39:38.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.706229928, 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:38.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:39:38.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:39:38.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:39:38.554 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.554 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.554 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.554 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.555 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:38.555 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.706208352, 2024-04-23T23:39:38.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:39:38.555 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.555 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.555 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:38.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:39:38.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:39:38.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:39:38.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:39:38.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:39:38.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:38.564 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7061885060000002, 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:39:38.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.566 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:38.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:38.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:39:38.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.572 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7061584639999996, 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:39:38.573 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:39:38.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:39:38.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:39:38.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:39:38.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7061306119999999, 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.582 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:39:38.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:39:38.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:39:38.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.589 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7061074210000005, 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.590 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:38.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:39:38.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:39:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7060012130000004, 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:39:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:39:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7059671950000004, 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:39:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:39:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:39:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7059405759999997, 2024-04-23T23:39:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:39:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:39:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:39:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7059198569999996, 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7058968879999998, 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:39:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7058778700000001, 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:39:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7058596900000005, 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:39:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:39:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.705839063, 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:39:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7054669420000002, 2024-04-23T23:39:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:39:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:39:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 4.7054116229999998, 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:39:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:39:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:38.656 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:38.658 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:38.658 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:38.669+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:38.758 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:38.770+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:38.804 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:38.804 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:38.804 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:38.804 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:38.812 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:38.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:39:38.897 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:38.909+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:38.955 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:38.955 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:38.955 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:38.955 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:38.955 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:38.959 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:38.972+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:38.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:39.060 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:39.072+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:39.108 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 30.301028189, 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2910667760000001, 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:39:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2910494010000004, 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:39:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:39:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2910319570000004, 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2908961740000002, 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:39:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2908772949999996, 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:39:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:39:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:39:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2908599199999999, 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2906882739999999, 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:39:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2906714109999999, 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.290654312, 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2900139079999997, 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:39:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2899459679999996, 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:39:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:39:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2897619459999996, 2024-04-23T23:39:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:39:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2894061370000003, 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:39:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2893376840000004, 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:39:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:39:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:39:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2892626470000002, 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2891772660000003, 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:39:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.2889130880000002, 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:39:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.288843129, 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:39:39.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:39:39.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 5.288775266, 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.202 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:39.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:39.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:39.206 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:39.207 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:39:39.208 INFO:teuthology.orchestra.run.smithi077.stdout:5743 read 0x7c69ec1 thru 0x7c714b4 (0x75f4 bytes) 2024-04-23T23:39:39.209 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:39.219+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:39.209 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:39.210 INFO:teuthology.orchestra.run.smithi077.stdout:5744 writesame 0xe4af786 thru 0xe4b066a data_size 0x3(0xee5 bytes) 2024-04-23T23:39:39.210 INFO:teuthology.orchestra.run.smithi077.stdout:5745 trunc from 0xe4b066b to 0x838a6c 2024-04-23T23:39:39.272 INFO:teuthology.orchestra.run.smithi077.stdout:5746 writesame 0x2ee0492 thru 0x2eea46e data_size 0x5(0x9fdd bytes) 2024-04-23T23:39:39.285 INFO:teuthology.orchestra.run.smithi077.stdout:5747 trunc from 0x2eea46f to 0xd569eec 2024-04-23T23:39:39.290 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.290 INFO:teuthology.orchestra.run.smithi077.stdout:5750 read 0xb357c41 thru 0xb35f33c (0x76fc bytes) 2024-04-23T23:39:39.303 INFO:teuthology.orchestra.run.smithi077.stdout:5751 trunc from 0xd569eec to 0x315ce0e 2024-04-23T23:39:39.308 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:39.320+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:39.308 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.309 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.318 INFO:teuthology.orchestra.run.smithi077.stdout:5760 writesame 0x6200390 thru 0x620d48a data_size 0x11(0xd0fb bytes) 2024-04-23T23:39:39.318 INFO:teuthology.orchestra.run.smithi077.stdout:5761 write 0xcf789 thru 0xd2aa8 (0x3320 bytes) 2024-04-23T23:39:39.319 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.326 INFO:teuthology.orchestra.run.smithi077.stdout:5765 write 0x7d8323f thru 0x7d86529 (0x32eb bytes) 2024-04-23T23:39:39.330 INFO:teuthology.orchestra.run.smithi077.stdout:5766 write 0x26d9f88 thru 0x26e6ff0 (0xd069 bytes) 2024-04-23T23:39:39.335 INFO:teuthology.orchestra.run.smithi077.stdout:5767 punch from 0xd4d4d7 to 0xd5acd1, (0xd7fa bytes) 2024-04-23T23:39:39.335 INFO:teuthology.orchestra.run.smithi077.stdout:5768 write 0x741883 thru 0x74f9a6 (0xe124 bytes) 2024-04-23T23:39:39.345 INFO:teuthology.orchestra.run.smithi077.stdout:5770 write 0x8766197 thru 0x8773708 (0xd572 bytes) 2024-04-23T23:39:39.351 INFO:teuthology.orchestra.run.smithi077.stdout:5771 punch from 0x80faabe to 0x810a9ae, (0xfef0 bytes) 2024-04-23T23:39:39.352 INFO:teuthology.orchestra.run.smithi077.stdout:5772 read 0xa27d60 thru 0xa2e6cd (0x696e bytes) 2024-04-23T23:39:39.352 INFO:teuthology.orchestra.run.smithi077.stdout:5774 write 0x14f3544 thru 0x1501652 (0xe10f bytes) 2024-04-23T23:39:39.363 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:39.363 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:39.363 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:39.363 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:39.370 INFO:teuthology.orchestra.run.smithi077.stdout:5776 write 0xdbe88cf thru 0xdbf4f42 (0xc674 bytes) 2024-04-23T23:39:39.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:5777 read 0x38a18d5 thru 0x38a26d4 (0xe00 bytes) 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:5781 read 0xbc9534b thru 0xbca4bf4 (0xf8aa bytes) 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:5783 read 0x314272e thru 0x3146395 (0x3c68 bytes) 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:5784 read 0x5c18e11 thru 0x5c24bb2 (0xbda2 bytes) 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:5785 punch from 0x6652f64 to 0x665cc77, (0x9d13 bytes) 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:5786 punch from 0x14dc8c1 to 0x14eb0ad, (0xe7ec bytes) 2024-04-23T23:39:39.377 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.378 INFO:teuthology.orchestra.run.smithi077.stdout:5788 writesame 0x92488c1 thru 0x9253dbf data_size 0x5(0xb4ff bytes) 2024-04-23T23:39:39.395 INFO:teuthology.orchestra.run.smithi077.stdout:5789 trunc from 0xdbf4f43 to 0x392fea7 2024-04-23T23:39:39.408 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:39.420+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:39.416 INFO:teuthology.orchestra.run.smithi077.stdout:5791 writesame 0x62c652f thru 0x62d19e1 data_size 0x1(0xb4b3 bytes) 2024-04-23T23:39:39.426 INFO:teuthology.orchestra.run.smithi077.stdout:5792 writesame 0x9f3f8e9 thru 0x9f4f625 data_size 0x1(0xfd3d bytes) 2024-04-23T23:39:39.426 INFO:teuthology.orchestra.run.smithi077.stdout:5794 write 0x6b857e4 thru 0x6b85d73 (0x590 bytes) 2024-04-23T23:39:39.429 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.429 INFO:teuthology.orchestra.run.smithi077.stdout:5796 writesame 0x7c59ebd thru 0x7c5b128 data_size 0x12(0x126c bytes) 2024-04-23T23:39:39.441 INFO:teuthology.orchestra.run.smithi077.stdout:5797 trunc from 0x9f4f626 to 0x218bbc0 2024-04-23T23:39:39.453 INFO:teuthology.orchestra.run.smithi077.stdout:5798 trunc from 0x218bbc0 to 0x2cc919f 2024-04-23T23:39:39.478 INFO:teuthology.orchestra.run.smithi077.stdout:5799 writesame 0xe75fc1c thru 0xe762a51 data_size 0xd(0x2e36 bytes) 2024-04-23T23:39:39.478 INFO:teuthology.orchestra.run.smithi077.stdout:5800 punch from 0xb7a0014 to 0xb7a298b, (0x2977 bytes) 2024-04-23T23:39:39.478 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.478 INFO:teuthology.orchestra.run.smithi077.stdout:5804 writesame 0x458ac37 thru 0x45967ad data_size 0x11(0xbb77 bytes) 2024-04-23T23:39:39.493 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:39.493 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:39.494 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:39.494 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:39.494 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:39.494 INFO:teuthology.orchestra.run.smithi077.stdout:5808 trunc from 0xe762a52 to 0x6048ad0 2024-04-23T23:39:39.499 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:39.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:39.515 INFO:teuthology.orchestra.run.smithi077.stdout:5811 write 0xeded5b1 thru 0xeded744 (0x194 bytes) 2024-04-23T23:39:39.515 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:39.527+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:39.517 INFO:teuthology.orchestra.run.smithi077.stdout:5812 writesame 0xc65552e thru 0xc655771 data_size 0xa(0x244 bytes) 2024-04-23T23:39:39.531 INFO:teuthology.orchestra.run.smithi077.stdout:5814 trunc from 0xeded745 to 0x578c475 2024-04-23T23:39:39.540 INFO:teuthology.orchestra.run.smithi077.stdout:5815 clone 53 order 24 su 65536 sc 15 2024-04-23T23:39:39.610 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:39.623+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:39.620 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.523364386, 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.621 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:39.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.523350741, 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.626 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:39.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:39.628 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.52333769099999, 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:39.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:39.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.631 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.632 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.523326672, 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.523317597, 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.52330565299999, 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:39.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.644 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.523296542, 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:39.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:39.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:39.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.648 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.52165117, 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:39.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.521638921, 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.653 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517460328, 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517448546, 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.661 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:39.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:39.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.664 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517438477, 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:39.668 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517426818, 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:39.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:39.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517417498, 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.672 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:39.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:39.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.675 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517406986, 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.676 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:39.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:39.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517397546, 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:39.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.517202453, 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.686 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.51718142, 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.687 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:39.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:39.690 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.51716752999999, 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 106.91401102499999, 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:39.694 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:39.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:39.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:39.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:39.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:39.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.699 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:39.699 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:39.699 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:39.699 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:39.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:39.712 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:39.724+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:39.813 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:39.825+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:39.815 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7] out_osds: [3, 0] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:39.815 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:39.815 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-23T23:39:39.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:39:39.848 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:39.848 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:39.848 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:39.848 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:39.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:39.861 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:39.862 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:39.881 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:39.881 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:39.899 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:39.899 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:39.914 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:39.927+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:39.917 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:39.917 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:39.949 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:39.950 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:39.968 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:39.978 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:39.978 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:39.985 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:39.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:39.989 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:39.989 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:40.016 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:40.027+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:40.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 127, 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:39:39.127612+0000", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:38:46.812648+0000", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:39:29.079576+0000", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5799936, 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:39:40.115 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 5, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 3, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "jewel", 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:39:40.116 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:40.117 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:40.118 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:40.119 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:40.120 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:39:40.121 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 8, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 8, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.25, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:39:40.122 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:40.123 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:40.124 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:40.125 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:40.126 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:40.127 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 3, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 3, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.75, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.25, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2.25, 2024-04-23T23:39:40.128 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "pool_client.0", 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:30.028908+0000", 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 8193, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:40.129 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 32, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 32, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 32, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 32, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 32, 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:40.130 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "126", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 54, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 126, 2024-04-23T23:39:40.131 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:40.132 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:40.133 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 2.75, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 2.75, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.75, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.059999942779541, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2.059999942779541, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 80, 2024-04-23T23:39:40.135 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.136 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.137 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:40.140 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 126, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.145 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 119, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:40.146 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 0, 2024-04-23T23:39:40.151 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 55, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 84, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.152 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.153 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.154 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/4292713565", 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/4292713565", 2024-04-23T23:39:40.156 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/4292713565", 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/4292713565", 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "exists" 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0.8255157470703125, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.157 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 122, 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.158 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.159 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 24, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 35, 2024-04-23T23:39:40.163 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 126, 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 26, 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.164 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:39:40.165 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:39:40.166 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.167 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2756265516", 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2756265516", 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2756265516", 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2756265516", 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.1546478271484375, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 117, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:40.169 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.170 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.171 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.172 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:40.173 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:39:40.174 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.744476318359375, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 123, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:40.175 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.177 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:39:40.179 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.180 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:39:40.181 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 84 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.183 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:40.184 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 26 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [], 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:39:40.186 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [], 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [], 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [], 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:40.188 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:40.190 INFO:tasks.thrashosds.thrasher:j is {'epoch': 127, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:39:39.127612+0000', 'last_up_change': '2024-04-23T23:38:46.812648+0000', 'last_in_change': '2024-04-23T23:39:29.079576+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-04-23T23:37:30.028908+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 54, 'snap_epoch': 126, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.75, 'score_stable': 2.75, 'optimal_score': 0.75, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 55, 'down_at': 84, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 4292713565}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 4292713565}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 4292713565}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 4292713565}]}, 'public_addr': '172.21.15.77:6809/4292713565', 'cluster_addr': '172.21.15.77:6811/4292713565', 'heartbeat_back_addr': '172.21.15.77:6815/4292713565', 'heartbeat_front_addr': '172.21.15.77:6813/4292713565', 'state': ['exists']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 0.8255157470703125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 24, 'up_from': 35, 'up_thru': 126, 'down_at': 26, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2756265516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2756265516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2756265516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2756265516}]}, 'public_addr': '172.21.15.170:6801/2756265516', 'cluster_addr': '172.21.15.170:6803/2756265516', 'heartbeat_back_addr': '172.21.15.170:6807/2756265516', 'heartbeat_front_addr': '172.21.15.170:6805/2756265516', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1546478271484375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.744476318359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 123, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 84}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 26}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:39:40.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:39:40.192 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:40.192 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:40.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:40.193 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:40.202+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:40.193 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone52 from 0x578c475 (overlap 0x838a6c) to 0x4eeca7 2024-04-23T23:39:40.255 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #51, image image_client.0-clone51 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent52 2024-04-23T23:39:40.290 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:40.302+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:40.350 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:40.350 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:40.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:40.391 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:40.403+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:40.464 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:40.464 INFO:teuthology.orchestra.run.smithi077.stdout:5817 read 0x138a80 thru 0x1473b4 (0xe935 bytes) 2024-04-23T23:39:40.465 INFO:teuthology.orchestra.run.smithi077.stdout:5821 writesame 0x25a948b thru 0x25b2c8f data_size 0x1(0x9805 bytes) 2024-04-23T23:39:40.468 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:40.468 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:40.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:40.491 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:40.503+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:40.505 INFO:teuthology.orchestra.run.smithi077.stdout:5822 punch from 0x4dfbff to 0x4e70fa, (0x74fb bytes) 2024-04-23T23:39:40.505 INFO:teuthology.orchestra.run.smithi077.stdout:5823 write 0x3844b69 thru 0x384d109 (0x85a1 bytes) 2024-04-23T23:39:40.528 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:40.529 INFO:teuthology.orchestra.run.smithi077.stdout:5825 writesame 0xfa9c9a thru 0xfb0272 data_size 0x3(0x65d9 bytes) 2024-04-23T23:39:40.568 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:39:40.580 INFO:teuthology.orchestra.run.smithi077.stdout:5828 write 0xc5bd3f7 thru 0xc5c89d5 (0xb5df bytes) 2024-04-23T23:39:40.587 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-04-23T23:39:40.226243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2007499798,"num_objects":2864,"num_object_clones":384,"num_object_copies":5728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2864,"num_whiteouts":1493,"num_read":324685,"num_read_kb":1082398,"num_write":20060,"num_write_kb":639706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7398,"num_bytes_recovered":437336878,"num_keys_recovered":1098,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16939,"ondisk_log_size":16939,"up":82,"acting":80,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":90,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":849856,"kb_used_data":563112,"kb_used_omap":12,"kb_used_meta":286643,"kb_avail":565381184,"statfs":{"total":579820584960,"available":578950332416,"internally_reserved":0,"allocated":576626688,"data_stored":724999476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12467,"internal_metadata":293523277},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,0,0,0,0,0,1,0,5,231],"upper_bound":2048},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":18087938,"num_objects":7,"num_object_clones":3,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-268,"num_objects_misplaced":-16,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1028,"num_read_kb":6667,"num_write":76,"num_write_kb":2182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":409,"num_bytes_recovered":37537107,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000666"},"pg_stats":[{"pgid":"3.1f","version":"114'700","reported_seq":5537,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819796+0000","last_change":"2024-04-23T23:38:44.815145+0000","last_active":"2024-04-23T23:39:36.819796+0000","last_peered":"2024-04-23T23:39:36.819796+0000","last_clean":"2024-04-23T23:39:36.819796+0000","last_became_active":"2024-04-23T23:38:44.813152+0000","last_became_peered":"2024-04-23T23:38:44.813152+0000","last_unstale":"2024-04-23T23:39:36.819796+0000","last_undegraded":"2024-04-23T23:39:36.819796+0000","last_fullsized":"2024-04-23T23:39:36.819796+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":700,"log_dups_size":0,"ondisk_log_size":700,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:24:35.197786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036166670000000001,"stat_sum":{"num_bytes":39032613,"num_objects":87,"num_object_clones":9,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":48,"num_read":7377,"num_read_kb":18903,"num_write":896,"num_write_kb":5035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":3224152,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"114'403","reported_seq":4141,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.816314+0000","last_change":"2024-04-23T23:38:29.052716+0000","last_active":"2024-04-23T23:39:34.816314+0000","last_peered":"2024-04-23T23:39:34.816314+0000","last_clean":"2024-04-23T23:39:34.816314+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:39:34.816314+0000","last_undegraded":"2024-04-23T23:39:34.816314+0000","last_fullsized":"2024-04-23T23:39:34.816314+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:13:57.246945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00061879000000000003,"stat_sum":{"num_bytes":52585846,"num_objects":104,"num_object_clones":13,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":59,"num_read":4750,"num_read_kb":21609,"num_write":346,"num_write_kb":5307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"119'522","reported_seq":23023,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:37.376779+0000","last_change":"2024-04-23T23:39:04.817002+0000","last_active":"2024-04-23T23:39:37.376779+0000","last_peered":"2024-04-23T23:39:37.376779+0000","last_clean":"2024-04-23T23:39:37.376779+0000","last_became_active":"2024-04-23T23:39:04.816060+0000","last_became_peered":"2024-04-23T23:39:04.816060+0000","last_unstale":"2024-04-23T23:39:37.376779+0000","last_undegraded":"2024-04-23T23:39:37.376779+0000","last_fullsized":"2024-04-23T23:39:37.376779+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":522,"log_dups_size":0,"ondisk_log_size":522,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:10:14.234430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013335580000000001,"stat_sum":{"num_bytes":51922713,"num_objects":108,"num_object_clones":18,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":51,"num_read":24057,"num_read_kb":38945,"num_write":557,"num_write_kb":35244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"119'530","reported_seq":14892,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819536+0000","last_change":"2024-04-23T23:39:03.818256+0000","last_active":"2024-04-23T23:39:36.819536+0000","last_peered":"2024-04-23T23:39:36.819536+0000","last_clean":"2024-04-23T23:39:36.819536+0000","last_became_active":"2024-04-23T23:39:03.817321+0000","last_became_peered":"2024-04-23T23:39:03.817321+0000","last_unstale":"2024-04-23T23:39:36.819536+0000","last_undegraded":"2024-04-23T23:39:36.819536+0000","last_fullsized":"2024-04-23T23:39:36.819536+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":530,"log_dups_size":0,"ondisk_log_size":530,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:48:55.490725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56904955,"num_objects":91,"num_object_clones":13,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":50,"num_read":16537,"num_read_kb":41272,"num_write":510,"num_write_kb":14159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"114'695","reported_seq":3549,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.822552+0000","last_change":"2024-04-23T23:39:34.822552+0000","last_active":"2024-04-23T23:39:34.822552+0000","last_peered":"2024-04-23T23:39:34.822552+0000","last_clean":"2024-04-23T23:39:34.822552+0000","last_became_active":"2024-04-23T23:39:34.821251+0000","last_became_peered":"2024-04-23T23:39:34.821251+0000","last_unstale":"2024-04-23T23:39:34.822552+0000","last_undegraded":"2024-04-23T23:39:34.822552+0000","last_fullsized":"2024-04-23T23:39:34.822552+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":695,"log_dups_size":0,"ondisk_log_size":695,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:10:36.704996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048779100000000001,"stat_sum":{"num_bytes":29548695,"num_objects":85,"num_object_clones":11,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":50,"num_read":4571,"num_read_kb":25283,"num_write":1000,"num_write_kb":27296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":390,"num_bytes_recovered":27315039,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"114'561","reported_seq":15676,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.817538+0000","last_change":"2024-04-23T23:39:03.813310+0000","last_active":"2024-04-23T23:39:34.817538+0000","last_peered":"2024-04-23T23:39:34.817538+0000","last_clean":"2024-04-23T23:39:34.817538+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:39:34.817538+0000","last_undegraded":"2024-04-23T23:39:34.817538+0000","last_fullsized":"2024-04-23T23:39:34.817538+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:16:35.702449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001109447,"stat_sum":{"num_bytes":54520331,"num_objects":81,"num_object_clones":10,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":38,"num_read":17234,"num_read_kb":29578,"num_write":700,"num_write_kb":19908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"114'552","reported_seq":7443,"reported_epoch":123,"state":"remapped+peering","last_fresh":"2024-04-23T23:39:34.817377+0000","last_change":"2024-04-23T23:39:35.817744+0000","last_active":"2024-04-23T23:39:34.817377+0000","last_peered":"2024-04-23T23:39:33.813231+0000","last_clean":"2024-04-23T23:39:33.813231+0000","last_became_active":"2024-04-23T23:39:05.823040+0000","last_became_peered":"2024-04-23T23:39:05.823040+0000","last_unstale":"2024-04-23T23:39:34.817377+0000","last_undegraded":"2024-04-23T23:39:34.817377+0000","last_fullsized":"2024-04-23T23:39:34.817377+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":552,"log_dups_size":0,"ondisk_log_size":552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044664900000000003,"stat_sum":{"num_bytes":143841273,"num_objects":114,"num_object_clones":16,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":62,"num_read":7228,"num_read_kb":42179,"num_write":553,"num_write_kb":28151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":272,"num_bytes_recovered":15840300,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"119'401","reported_seq":2346,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817156+0000","last_change":"2024-04-23T23:38:44.810906+0000","last_active":"2024-04-23T23:39:35.817156+0000","last_peered":"2024-04-23T23:39:35.817156+0000","last_clean":"2024-04-23T23:39:35.817156+0000","last_became_active":"2024-04-23T23:38:44.809902+0000","last_became_peered":"2024-04-23T23:38:44.809902+0000","last_unstale":"2024-04-23T23:39:35.817156+0000","last_undegraded":"2024-04-23T23:39:35.817156+0000","last_fullsized":"2024-04-23T23:39:35.817156+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:39:12.411586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091463299999999998,"stat_sum":{"num_bytes":65798416,"num_objects":82,"num_object_clones":13,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":42,"num_read":2104,"num_read_kb":25249,"num_write":492,"num_write_kb":22981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":16101144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"114'422","reported_seq":4727,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819746+0000","last_change":"2024-04-23T23:38:44.815156+0000","last_active":"2024-04-23T23:39:36.819746+0000","last_peered":"2024-04-23T23:39:36.819746+0000","last_clean":"2024-04-23T23:39:36.819746+0000","last_became_active":"2024-04-23T23:38:44.814027+0000","last_became_peered":"2024-04-23T23:38:44.814027+0000","last_unstale":"2024-04-23T23:39:36.819746+0000","last_undegraded":"2024-04-23T23:39:36.819746+0000","last_fullsized":"2024-04-23T23:39:36.819746+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:06:53.055245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035554319999999999,"stat_sum":{"num_bytes":81980218,"num_objects":87,"num_object_clones":9,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":49,"num_read":5022,"num_read_kb":46652,"num_write":551,"num_write_kb":36012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":34599238,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"125'639","reported_seq":23632,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:37.391689+0000","last_change":"2024-04-23T23:39:33.821705+0000","last_active":"2024-04-23T23:39:37.391689+0000","last_peered":"2024-04-23T23:39:37.391689+0000","last_clean":"2024-04-23T23:39:37.391689+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:39:37.391689+0000","last_undegraded":"2024-04-23T23:39:37.391689+0000","last_fullsized":"2024-04-23T23:39:37.391689+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:58:59.875658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012770870000000001,"stat_sum":{"num_bytes":75336192,"num_objects":85,"num_object_clones":15,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":39,"num_read":24897,"num_read_kb":43655,"num_write":812,"num_write_kb":36108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"114'350","reported_seq":6378,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.827011+0000","last_change":"2024-04-23T23:39:34.821877+0000","last_active":"2024-04-23T23:39:34.827011+0000","last_peered":"2024-04-23T23:39:34.827011+0000","last_clean":"2024-04-23T23:39:34.827011+0000","last_became_active":"2024-04-23T23:39:34.818900+0000","last_became_peered":"2024-04-23T23:39:34.818900+0000","last_unstale":"2024-04-23T23:39:34.827011+0000","last_undegraded":"2024-04-23T23:39:34.827011+0000","last_fullsized":"2024-04-23T23:39:34.827011+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:38.055836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00066396700000000001,"stat_sum":{"num_bytes":56801516,"num_objects":107,"num_object_clones":13,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":68,"num_read":6678,"num_read_kb":21826,"num_write":282,"num_write_kb":15771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":536,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"123'834","reported_seq":12488,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.817520+0000","last_change":"2024-04-23T23:39:33.824528+0000","last_active":"2024-04-23T23:39:34.817520+0000","last_peered":"2024-04-23T23:39:34.817520+0000","last_clean":"2024-04-23T23:39:34.817520+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:39:34.817520+0000","last_undegraded":"2024-04-23T23:39:34.817520+0000","last_fullsized":"2024-04-23T23:39:34.817520+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:32:45.269131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000411357,"stat_sum":{"num_bytes":23203930,"num_objects":88,"num_object_clones":9,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":46,"num_read":14878,"num_read_kb":19659,"num_write":1120,"num_write_kb":9767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":189,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.820618+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:39:34.820618+0000","last_peered":"2024-04-23T23:39:34.820618+0000","last_clean":"2024-04-23T23:39:34.820618+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:39:34.820618+0000","last_undegraded":"2024-04-23T23:39:34.820618+0000","last_fullsized":"2024-04-23T23:39:34.820618+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"114'352","reported_seq":5648,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817350+0000","last_change":"2024-04-23T23:39:03.817855+0000","last_active":"2024-04-23T23:39:35.817350+0000","last_peered":"2024-04-23T23:39:35.817350+0000","last_clean":"2024-04-23T23:39:35.817350+0000","last_became_active":"2024-04-23T23:39:03.817144+0000","last_became_peered":"2024-04-23T23:39:03.817144+0000","last_unstale":"2024-04-23T23:39:35.817350+0000","last_undegraded":"2024-04-23T23:39:35.817350+0000","last_fullsized":"2024-04-23T23:39:35.817350+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:49:02.154059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043457199999999999,"stat_sum":{"num_bytes":75151940,"num_objects":74,"num_object_clones":8,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":40,"num_read":5907,"num_read_kb":30218,"num_write":329,"num_write_kb":2218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":1741635,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":221,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817455+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:39:35.817455+0000","last_peered":"2024-04-23T23:39:35.817455+0000","last_clean":"2024-04-23T23:39:35.817455+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:39:35.817455+0000","last_undegraded":"2024-04-23T23:39:35.817455+0000","last_fullsized":"2024-04-23T23:39:35.817455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"125'712","reported_seq":5777,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:37.353881+0000","last_change":"2024-04-23T23:39:34.823209+0000","last_active":"2024-04-23T23:39:37.353881+0000","last_peered":"2024-04-23T23:39:37.353881+0000","last_clean":"2024-04-23T23:39:37.353881+0000","last_became_active":"2024-04-23T23:39:34.821481+0000","last_became_peered":"2024-04-23T23:39:34.821481+0000","last_unstale":"2024-04-23T23:39:37.353881+0000","last_undegraded":"2024-04-23T23:39:37.353881+0000","last_fullsized":"2024-04-23T23:39:37.353881+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:52:01.636362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000861358,"stat_sum":{"num_bytes":59112838,"num_objects":86,"num_object_clones":8,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":43,"num_read":7429,"num_read_kb":56143,"num_write":1027,"num_write_kb":15143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":353,"num_bytes_recovered":27781085,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.815408+0000","last_change":"2024-04-23T23:39:30.097707+0000","last_active":"2024-04-23T23:39:34.815408+0000","last_peered":"2024-04-23T23:39:34.815408+0000","last_clean":"2024-04-23T23:39:34.815408+0000","last_became_active":"2024-04-23T23:39:30.097408+0000","last_became_peered":"2024-04-23T23:39:30.097408+0000","last_unstale":"2024-04-23T23:39:34.815408+0000","last_undegraded":"2024-04-23T23:39:34.815408+0000","last_fullsized":"2024-04-23T23:39:34.815408+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:12.033021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"123'395","reported_seq":4046,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817405+0000","last_change":"2024-04-23T23:37:33.804737+0000","last_active":"2024-04-23T23:39:35.817405+0000","last_peered":"2024-04-23T23:39:35.817405+0000","last_clean":"2024-04-23T23:39:35.817405+0000","last_became_active":"2024-04-23T23:37:31.799126+0000","last_became_peered":"2024-04-23T23:37:31.799126+0000","last_unstale":"2024-04-23T23:39:35.817405+0000","last_undegraded":"2024-04-23T23:39:35.817405+0000","last_fullsized":"2024-04-23T23:39:35.817405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:21.627157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000552153,"stat_sum":{"num_bytes":63481741,"num_objects":81,"num_object_clones":10,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":37,"num_read":4107,"num_read_kb":33826,"num_write":370,"num_write_kb":18619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":236,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817349+0000","last_change":"2024-04-23T23:39:30.096775+0000","last_active":"2024-04-23T23:39:35.817349+0000","last_peered":"2024-04-23T23:39:35.817349+0000","last_clean":"2024-04-23T23:39:35.817349+0000","last_became_active":"2024-04-23T23:39:30.096449+0000","last_became_peered":"2024-04-23T23:39:30.096449+0000","last_unstale":"2024-04-23T23:39:35.817349+0000","last_undegraded":"2024-04-23T23:39:35.817349+0000","last_fullsized":"2024-04-23T23:39:35.817349+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:25.705085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"119'711","reported_seq":3393,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:37.376456+0000","last_change":"2024-04-23T23:38:19.815075+0000","last_active":"2024-04-23T23:39:37.376456+0000","last_peered":"2024-04-23T23:39:37.376456+0000","last_clean":"2024-04-23T23:39:37.376456+0000","last_became_active":"2024-04-23T23:38:19.813635+0000","last_became_peered":"2024-04-23T23:38:19.813635+0000","last_unstale":"2024-04-23T23:39:37.376456+0000","last_undegraded":"2024-04-23T23:39:37.376456+0000","last_fullsized":"2024-04-23T23:39:37.376456+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":711,"log_dups_size":0,"ondisk_log_size":711,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:07.863608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014827079999999999,"stat_sum":{"num_bytes":43509492,"num_objects":89,"num_object_clones":14,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":51,"num_read":5756,"num_read_kb":29588,"num_write":1066,"num_write_kb":23065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"123'402","reported_seq":6563,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.817627+0000","last_change":"2024-04-23T23:39:05.818157+0000","last_active":"2024-04-23T23:39:34.817627+0000","last_peered":"2024-04-23T23:39:34.817627+0000","last_clean":"2024-04-23T23:39:34.817627+0000","last_became_active":"2024-04-23T23:39:05.817222+0000","last_became_peered":"2024-04-23T23:39:05.817222+0000","last_unstale":"2024-04-23T23:39:34.817627+0000","last_undegraded":"2024-04-23T23:39:34.817627+0000","last_fullsized":"2024-04-23T23:39:34.817627+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:12:27.193574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096400399999999997,"stat_sum":{"num_bytes":24226970,"num_objects":81,"num_object_clones":13,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":41,"num_read":6617,"num_read_kb":22694,"num_write":479,"num_write_kb":13937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11294254,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":198,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819491+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:39:36.819491+0000","last_peered":"2024-04-23T23:39:36.819491+0000","last_clean":"2024-04-23T23:39:36.819491+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:39:36.819491+0000","last_undegraded":"2024-04-23T23:39:36.819491+0000","last_fullsized":"2024-04-23T23:39:36.819491+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"114'445","reported_seq":2956,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817228+0000","last_change":"2024-04-23T23:37:33.804968+0000","last_active":"2024-04-23T23:39:35.817228+0000","last_peered":"2024-04-23T23:39:35.817228+0000","last_clean":"2024-04-23T23:39:35.817228+0000","last_became_active":"2024-04-23T23:37:31.799146+0000","last_became_peered":"2024-04-23T23:37:31.799146+0000","last_unstale":"2024-04-23T23:39:35.817228+0000","last_undegraded":"2024-04-23T23:39:35.817228+0000","last_fullsized":"2024-04-23T23:39:35.817228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:44:09.125058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055612800000000003,"stat_sum":{"num_bytes":91651438,"num_objects":86,"num_object_clones":9,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":44,"num_read":3105,"num_read_kb":43301,"num_write":631,"num_write_kb":67965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":228,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.816451+0000","last_change":"2024-04-23T23:38:42.163377+0000","last_active":"2024-04-23T23:39:34.816451+0000","last_peered":"2024-04-23T23:39:34.816451+0000","last_clean":"2024-04-23T23:39:34.816451+0000","last_became_active":"2024-04-23T23:38:42.163067+0000","last_became_peered":"2024-04-23T23:38:42.163067+0000","last_unstale":"2024-04-23T23:39:34.816451+0000","last_undegraded":"2024-04-23T23:39:34.816451+0000","last_fullsized":"2024-04-23T23:39:34.816451+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:15.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"125'626","reported_seq":5113,"reported_epoch":125,"state":"active+undersized+remapped","last_fresh":"2024-04-23T23:39:37.470064+0000","last_change":"2024-04-23T23:39:37.470287+0000","last_active":"2024-04-23T23:39:37.470064+0000","last_peered":"2024-04-23T23:39:37.470064+0000","last_clean":"2024-04-23T23:39:25.647124+0000","last_became_active":"2024-04-23T23:39:37.258100+0000","last_became_peered":"2024-04-23T23:39:37.258100+0000","last_unstale":"2024-04-23T23:39:37.470064+0000","last_undegraded":"2024-04-23T23:39:37.470064+0000","last_fullsized":"2024-04-23T23:39:36.819460+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047655700000000001,"stat_sum":{"num_bytes":82185034,"num_objects":74,"num_object_clones":7,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":42,"num_read":5556,"num_read_kb":16509,"num_write":877,"num_write_kb":12632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":10864983,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5],"avail_no_missing":["5","4","7"],"object_location_counts":[{"shards":"5","objects":74}],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817311+0000","last_change":"2024-04-23T23:39:30.096215+0000","last_active":"2024-04-23T23:39:35.817311+0000","last_peered":"2024-04-23T23:39:35.817311+0000","last_clean":"2024-04-23T23:39:35.817311+0000","last_became_active":"2024-04-23T23:39:30.095821+0000","last_became_peered":"2024-04-23T23:39:30.095821+0000","last_unstale":"2024-04-23T23:39:35.817311+0000","last_undegraded":"2024-04-23T23:39:35.817311+0000","last_fullsized":"2024-04-23T23:39:35.817311+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:35.675445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"115'653","reported_seq":3210,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819491+0000","last_change":"2024-04-23T23:38:19.814491+0000","last_active":"2024-04-23T23:39:36.819491+0000","last_peered":"2024-04-23T23:39:36.819491+0000","last_clean":"2024-04-23T23:39:36.819491+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:39:36.819491+0000","last_undegraded":"2024-04-23T23:39:36.819491+0000","last_fullsized":"2024-04-23T23:39:36.819491+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":653,"log_dups_size":0,"ondisk_log_size":653,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:31.805943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000789393,"stat_sum":{"num_bytes":44481137,"num_objects":71,"num_object_clones":6,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":36,"num_read":4814,"num_read_kb":9328,"num_write":821,"num_write_kb":5216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819511+0000","last_change":"2024-04-23T23:39:19.038209+0000","last_active":"2024-04-23T23:39:36.819511+0000","last_peered":"2024-04-23T23:39:36.819511+0000","last_clean":"2024-04-23T23:39:36.819511+0000","last_became_active":"2024-04-23T23:39:19.037898+0000","last_became_peered":"2024-04-23T23:39:19.037898+0000","last_unstale":"2024-04-23T23:39:36.819511+0000","last_undegraded":"2024-04-23T23:39:36.819511+0000","last_fullsized":"2024-04-23T23:39:36.819511+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:00.541565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":338,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.814838+0000","last_change":"2024-04-23T23:39:33.118029+0000","last_active":"2024-04-23T23:39:34.814838+0000","last_peered":"2024-04-23T23:39:34.814838+0000","last_clean":"2024-04-23T23:39:34.814838+0000","last_became_active":"2024-04-23T23:39:33.117656+0000","last_became_peered":"2024-04-23T23:39:33.117656+0000","last_unstale":"2024-04-23T23:39:34.814838+0000","last_undegraded":"2024-04-23T23:39:34.814838+0000","last_fullsized":"2024-04-23T23:39:34.814838+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:04.497616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"119'420","reported_seq":20133,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.817189+0000","last_change":"2024-04-23T23:39:33.818539+0000","last_active":"2024-04-23T23:39:35.817189+0000","last_peered":"2024-04-23T23:39:35.817189+0000","last_clean":"2024-04-23T23:39:35.817189+0000","last_became_active":"2024-04-23T23:39:33.817044+0000","last_became_peered":"2024-04-23T23:39:33.817044+0000","last_unstale":"2024-04-23T23:39:35.817189+0000","last_undegraded":"2024-04-23T23:39:35.817189+0000","last_fullsized":"2024-04-23T23:39:35.817189+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:34:40.684451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701399999999997,"stat_sum":{"num_bytes":64265940,"num_objects":92,"num_object_clones":12,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":52,"num_read":19496,"num_read_kb":40373,"num_write":487,"num_write_kb":22304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"114'387","reported_seq":4905,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.818322+0000","last_change":"2024-04-23T23:39:03.814910+0000","last_active":"2024-04-23T23:39:34.818322+0000","last_peered":"2024-04-23T23:39:34.818322+0000","last_clean":"2024-04-23T23:39:34.818322+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:39:34.818322+0000","last_undegraded":"2024-04-23T23:39:34.818322+0000","last_fullsized":"2024-04-23T23:39:34.818322+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:02:07.775062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078111900000000004,"stat_sum":{"num_bytes":69458422,"num_objects":91,"num_object_clones":14,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":49,"num_read":4695,"num_read_kb":27652,"num_write":339,"num_write_kb":28833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"119'795","reported_seq":12356,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:35.058572+0000","last_change":"2024-04-23T23:39:05.817000+0000","last_active":"2024-04-23T23:39:35.058572+0000","last_peered":"2024-04-23T23:39:35.058572+0000","last_clean":"2024-04-23T23:39:35.058572+0000","last_became_active":"2024-04-23T23:39:05.815581+0000","last_became_peered":"2024-04-23T23:39:05.815581+0000","last_unstale":"2024-04-23T23:39:35.058572+0000","last_undegraded":"2024-04-23T23:39:35.058572+0000","last_fullsized":"2024-04-23T23:39:35.058572+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":795,"log_dups_size":0,"ondisk_log_size":795,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:25:58.196550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00036496,"stat_sum":{"num_bytes":39128903,"num_objects":86,"num_object_clones":10,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":36,"num_read":14576,"num_read_kb":29659,"num_write":982,"num_write_kb":18286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"123'429","reported_seq":13709,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.817667+0000","last_change":"2024-04-23T23:39:04.822168+0000","last_active":"2024-04-23T23:39:34.817667+0000","last_peered":"2024-04-23T23:39:34.817667+0000","last_clean":"2024-04-23T23:39:34.817667+0000","last_became_active":"2024-04-23T23:39:04.819875+0000","last_became_peered":"2024-04-23T23:39:04.819875+0000","last_unstale":"2024-04-23T23:39:34.817667+0000","last_undegraded":"2024-04-23T23:39:34.817667+0000","last_fullsized":"2024-04-23T23:39:34.817667+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:12.479277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070273799999999995,"stat_sum":{"num_bytes":94830057,"num_objects":107,"num_object_clones":19,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":107,"num_whiteouts":49,"num_read":13383,"num_read_kb":46739,"num_write":404,"num_write_kb":18797,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":11368218,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"115'363","reported_seq":16893,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:36.819533+0000","last_change":"2024-04-23T23:38:19.814484+0000","last_active":"2024-04-23T23:39:36.819533+0000","last_peered":"2024-04-23T23:39:36.819533+0000","last_clean":"2024-04-23T23:39:36.819533+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:39:36.819533+0000","last_undegraded":"2024-04-23T23:39:36.819533+0000","last_fullsized":"2024-04-23T23:39:36.819533+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:37:52.493931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001080988,"stat_sum":{"num_bytes":101005752,"num_objects":106,"num_object_clones":17,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":52,"num_read":16651,"num_read_kb":58263,"num_write":344,"num_write_kb":15335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"125'435","reported_seq":14328,"reported_epoch":125,"state":"active+clean","last_fresh":"2024-04-23T23:39:37.359656+0000","last_change":"2024-04-23T23:39:33.823532+0000","last_active":"2024-04-23T23:39:37.359656+0000","last_peered":"2024-04-23T23:39:37.359656+0000","last_clean":"2024-04-23T23:39:37.359656+0000","last_became_active":"2024-04-23T23:39:33.820772+0000","last_became_peered":"2024-04-23T23:39:33.820772+0000","last_unstale":"2024-04-23T23:39:37.359656+0000","last_undegraded":"2024-04-23T23:39:37.359656+0000","last_fullsized":"2024-04-23T23:39:37.359656+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:25:53.565366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090758899999999999,"stat_sum":{"num_bytes":38185370,"num_objects":108,"num_object_clones":18,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":108,"num_whiteouts":56,"num_read":14753,"num_read_kb":35905,"num_write":380,"num_write_kb":6713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"114'705","reported_seq":4819,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.821586+0000","last_change":"2024-04-23T23:39:34.820485+0000","last_active":"2024-04-23T23:39:34.821586+0000","last_peered":"2024-04-23T23:39:34.821586+0000","last_clean":"2024-04-23T23:39:34.821586+0000","last_became_active":"2024-04-23T23:39:34.818894+0000","last_became_peered":"2024-04-23T23:39:34.818894+0000","last_unstale":"2024-04-23T23:39:34.821586+0000","last_undegraded":"2024-04-23T23:39:34.821586+0000","last_fullsized":"2024-04-23T23:39:34.821586+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":705,"log_dups_size":0,"ondisk_log_size":705,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:10:42.607750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011727580000000001,"stat_sum":{"num_bytes":75062576,"num_objects":85,"num_object_clones":12,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":44,"num_read":6941,"num_read_kb":28780,"num_write":838,"num_write_kb":10360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":11606439,"num_keys_recovered":93,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"112'592","reported_seq":11316,"reported_epoch":123,"state":"peering","last_fresh":"2024-04-23T23:39:34.204159+0000","last_change":"2024-04-23T23:39:35.238894+0000","last_active":"2024-04-23T23:39:35.238894+0000","last_peered":"2024-04-23T23:39:34.204159+0000","last_clean":"2024-04-23T23:39:23.605558+0000","last_became_active":"2024-04-23T23:39:31.383053+0000","last_became_peered":"2024-04-23T23:39:31.383053+0000","last_unstale":"2024-04-23T23:39:34.204159+0000","last_undegraded":"2024-04-23T23:39:34.204159+0000","last_fullsized":"2024-04-23T23:39:34.204159+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":592,"log_dups_size":0,"ondisk_log_size":592,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001215793,"stat_sum":{"num_bytes":91838990,"num_objects":92,"num_object_clones":17,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":48,"num_read":11944,"num_read_kb":50890,"num_write":661,"num_write_kb":20992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"115'426","reported_seq":24274,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.820258+0000","last_change":"2024-04-23T23:38:44.814041+0000","last_active":"2024-04-23T23:39:34.820258+0000","last_peered":"2024-04-23T23:39:34.820258+0000","last_clean":"2024-04-23T23:39:34.820258+0000","last_became_active":"2024-04-23T23:38:44.813024+0000","last_became_peered":"2024-04-23T23:38:44.813024+0000","last_unstale":"2024-04-23T23:39:34.820258+0000","last_undegraded":"2024-04-23T23:39:34.820258+0000","last_fullsized":"2024-04-23T23:39:34.820258+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:55:34.584718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044726999999999999,"stat_sum":{"num_bytes":74111818,"num_objects":97,"num_object_clones":15,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":48,"num_read":24342,"num_read_kb":29506,"num_write":497,"num_write_kb":35047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":6225512,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"114'398","reported_seq":7270,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.818200+0000","last_change":"2024-04-23T23:39:33.122679+0000","last_active":"2024-04-23T23:39:34.818200+0000","last_peered":"2024-04-23T23:39:34.818200+0000","last_clean":"2024-04-23T23:39:34.818200+0000","last_became_active":"2024-04-23T23:39:33.118919+0000","last_became_peered":"2024-04-23T23:39:33.118919+0000","last_unstale":"2024-04-23T23:39:34.818200+0000","last_undegraded":"2024-04-23T23:39:34.818200+0000","last_fullsized":"2024-04-23T23:39:34.818200+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:45:41.797401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011318700000000001,"stat_sum":{"num_bytes":69149357,"num_objects":90,"num_object_clones":15,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":44,"num_read":6569,"num_read_kb":61884,"num_write":360,"num_write_kb":18930,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"119'629","reported_seq":6406,"reported_epoch":123,"state":"creating+peering","last_fresh":"2024-04-23T23:39:34.003773+0000","last_change":"2024-04-23T23:39:35.238849+0000","last_active":"2024-04-23T23:39:35.238849+0000","last_peered":"2024-04-23T23:39:34.003773+0000","last_clean":"2024-04-23T23:39:28.083897+0000","last_became_active":"2024-04-23T23:39:31.380300+0000","last_became_peered":"2024-04-23T23:39:31.380300+0000","last_unstale":"2024-04-23T23:39:34.003773+0000","last_undegraded":"2024-04-23T23:39:34.003773+0000","last_fullsized":"2024-04-23T23:39:31.094141+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00064394099999999998,"stat_sum":{"num_bytes":29460128,"num_objects":81,"num_object_clones":6,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":43,"num_read":8168,"num_read_kb":36464,"num_write":877,"num_write_kb":21151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":28978899,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"119'338","reported_seq":4313,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-23T23:39:34.814965+0000","last_change":"2024-04-23T23:39:33.120776+0000","last_active":"2024-04-23T23:39:34.814965+0000","last_peered":"2024-04-23T23:39:34.814965+0000","last_clean":"2024-04-23T23:39:34.814965+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:39:34.814965+0000","last_undegraded":"2024-04-23T23:39:34.814965+0000","last_fullsized":"2024-04-23T23:39:34.814965+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":338,"log_dups_size":0,"ondisk_log_size":338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:14:40.145505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045588699999999998,"stat_sum":{"num_bytes":45134829,"num_objects":66,"num_object_clones":5,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":36,"num_read":4427,"num_read_kb":19766,"num_write":313,"num_write_kb":6008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2006909430,"num_objects":2862,"num_object_clones":384,"num_object_copies":5724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":1493,"num_read":324569,"num_read_kb":1082298,"num_write":19901,"num_write_kb":637290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7394,"num_bytes_recovered":436156142,"num_keys_recovered":1098,"num_objects_omap":54,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":607490048,"data_stored":776937100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":16822,"ondisk_log_size":16822,"up":64,"acting":62,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157400,"kb_used_data":104008,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94214440,"statfs":{"total":96636764160,"available":96475586560,"internally_reserved":0,"allocated":106504192,"data_stored":134685418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":161096,"kb_used_data":107708,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94210744,"statfs":{"total":96636764160,"available":96471801856,"internally_reserved":0,"allocated":110292992,"data_stored":137913015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,27],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106056,"kb_used_data":52668,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94265784,"statfs":{"total":96636764160,"available":96528162816,"internally_reserved":0,"allocated":53932032,"data_stored":65064317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855382,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":149736,"kb_used_data":99416,"kb_used_omap":4,"kb_used_meta":50299,"kb_avail":94222104,"statfs":{"total":96636764160,"available":96483434496,"internally_reserved":0,"allocated":101801984,"data_stored":128303013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":51506798},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":170592,"kb_used_data":121364,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94201248,"statfs":{"total":96636764160,"available":96462077952,"internally_reserved":0,"allocated":124276736,"data_stored":151618417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,0,0,0,0,0,5,204],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104976,"kb_used_data":77948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94266864,"statfs":{"total":96636764160,"available":96529268736,"internally_reserved":0,"allocated":79818752,"data_stored":107415296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574881,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":14347775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":105021440,"data_stored":133978792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":78348288,"data_stored":106714599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":122806272,"data_stored":150917720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":102408192,"data_stored":129689615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":51867648,"data_stored":63773252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":108269568,"data_stored":136653721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:39:40.589 INFO:tasks.thrashosds.thrasher:Setting 3.c to [7, 1, 5, 3] 2024-04-23T23:39:40.589 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.c', '7', '1', '5', '3'] 2024-04-23T23:39:40.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.c 7 1 5 3 2024-04-23T23:39:40.591 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:40.603+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:40.613 INFO:teuthology.orchestra.run.smithi077.stdout:5829 trunc from 0xc5c89d6 to 0x3a4a53c 2024-04-23T23:39:40.618 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:40.618 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:40.632 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:40.692 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:40.704+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:40.753 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:40.753 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:40.761 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:40.802 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:40.814+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:40.895 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:40.906+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:40.904 INFO:teuthology.orchestra.run.smithi077.stdout:5830 punch from 0x2fadae8 to 0x2fb9520, (0xba38 bytes) 2024-04-23T23:39:40.907 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:40.907 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:40.913 INFO:teuthology.orchestra.run.smithi077.stdout:5831 write 0x6c513c2 thru 0x6c5b406 (0xa045 bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5832 punch from 0x6661831 to 0x666c3c9, (0xab98 bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5834 punch from 0x3ee8fb3 to 0x3ef01f1, (0x723e bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5835 punch from 0x5693c05 to 0x5695f0b, (0x2306 bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5836 read 0x5e002ab thru 0x5e0a66a (0xa3c0 bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5840 punch from 0x30c2f1e to 0x30cf33c, (0xc41e bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5841 punch from 0x4f0b499 to 0x4f1a810, (0xf377 bytes) 2024-04-23T23:39:40.916 INFO:teuthology.orchestra.run.smithi077.stdout:5843 writesame 0x311860b thru 0x311b760 data_size 0xf(0x3156 bytes) 2024-04-23T23:39:40.917 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:40.925 INFO:teuthology.orchestra.run.smithi077.stdout:5844 write 0x88eb74d thru 0x88f36df (0x7f93 bytes) 2024-04-23T23:39:40.927 INFO:teuthology.orchestra.run.smithi077.stdout:5846 read 0x4e02e52 thru 0x4e042d5 (0x1484 bytes) 2024-04-23T23:39:40.927 INFO:teuthology.orchestra.run.smithi077.stdout:5847 writesame 0x875c392 thru 0x8763a7d data_size 0x81(0x76ec bytes) 2024-04-23T23:39:40.938 INFO:teuthology.orchestra.run.smithi077.stdout:5848 trunc from 0x88f36e0 to 0xf88118 2024-04-23T23:39:40.973 INFO:teuthology.orchestra.run.smithi077.stdout:5853 writesame 0xe96d3f2 thru 0xe9727ea data_size 0x25(0x53f9 bytes) 2024-04-23T23:39:40.974 INFO:teuthology.orchestra.run.smithi077.stdout:5854 write 0x871018f thru 0x871f0de (0xef50 bytes) 2024-04-23T23:39:40.976 INFO:teuthology.orchestra.run.smithi077.stdout:5856 read 0x25d2e4b thru 0x25e1da6 (0xef5c bytes) 2024-04-23T23:39:40.977 INFO:teuthology.orchestra.run.smithi077.stdout:5857 write 0x91062fb thru 0x91136e8 (0xd3ee bytes) 2024-04-23T23:39:40.979 INFO:teuthology.orchestra.run.smithi077.stdout:5858 punch from 0x9305457 to 0x930e110, (0x8cb9 bytes) 2024-04-23T23:39:40.979 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:40.979 INFO:teuthology.orchestra.run.smithi077.stdout:5860 write 0x8792f59 thru 0x879e539 (0xb5e1 bytes) 2024-04-23T23:39:40.980 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:40.991 INFO:teuthology.orchestra.run.smithi077.stdout:5862 trunc from 0xe9727eb to 0x56c2193 2024-04-23T23:39:41.001 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:41.013+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:41.007 INFO:teuthology.orchestra.run.smithi077.stdout:5863 write 0x6ac1a46 thru 0x6ac1fb6 (0x571 bytes) 2024-04-23T23:39:41.018 INFO:teuthology.orchestra.run.smithi077.stdout:5864 write 0x9401f59 thru 0x940bb6d (0x9c15 bytes) 2024-04-23T23:39:41.020 INFO:teuthology.orchestra.run.smithi077.stdout:5866 punch from 0x9026edb to 0x9034946, (0xda6b bytes) 2024-04-23T23:39:41.020 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.020 INFO:teuthology.orchestra.run.smithi077.stdout:5868 read 0x25adebb thru 0x25b8024 (0xa16a bytes) 2024-04-23T23:39:41.020 INFO:teuthology.orchestra.run.smithi077.stdout:5869 writesame 0x934acdf thru 0x9358d19 data_size 0x1(0xe03b bytes) 2024-04-23T23:39:41.066 INFO:teuthology.orchestra.run.smithi077.stdout:5870 write 0xcc27ad8 thru 0xcc347ed (0xcd16 bytes) 2024-04-23T23:39:41.072 INFO:teuthology.orchestra.run.smithi077.stdout:5871 write 0xcd1a16c thru 0xcd26c2f (0xcac4 bytes) 2024-04-23T23:39:41.074 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.074 INFO:teuthology.orchestra.run.smithi077.stdout:5874 read 0x176b419 thru 0x1772944 (0x752c bytes) 2024-04-23T23:39:41.075 INFO:teuthology.orchestra.run.smithi077.stdout:5875 write 0x3e089e thru 0x3e78ef (0x7052 bytes) 2024-04-23T23:39:41.076 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.076 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.077 INFO:teuthology.orchestra.run.smithi077.stdout:5876 punch from 0x7bc06b to 0x7c47ee, (0x8783 bytes) 2024-04-23T23:39:41.077 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.086 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:41.089 INFO:teuthology.orchestra.run.smithi077.stdout:5878 trunc from 0xcd26c30 to 0x24925d3 2024-04-23T23:39:41.095 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:41.107+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:41.106 INFO:teuthology.orchestra.run.smithi077.stdout:5879 write 0x39c50ef thru 0x39ca81f (0x5731 bytes) 2024-04-23T23:39:41.108 INFO:teuthology.orchestra.run.smithi077.stdout:5880 punch from 0x2341e74 to 0x2349d6e, (0x7efa bytes) 2024-04-23T23:39:41.108 INFO:teuthology.orchestra.run.smithi077.stdout:5881 punch from 0x722327 to 0x724568, (0x2241 bytes) 2024-04-23T23:39:41.113 INFO:teuthology.orchestra.run.smithi077.stdout:5883 write 0x3eb20bd thru 0x3eba908 (0x884c bytes) 2024-04-23T23:39:41.128 INFO:teuthology.orchestra.run.smithi077.stdout:5884 writesame 0x9cfea46 thru 0x9d08e1e data_size 0x1(0xa3d9 bytes) 2024-04-23T23:39:41.130 INFO:teuthology.orchestra.run.smithi077.stdout:5885 punch from 0x8b53acb to 0x8b5ee22, (0xb357 bytes) 2024-04-23T23:39:41.130 INFO:teuthology.orchestra.run.smithi077.stdout:5887 punch from 0x7701702 to 0x7704840, (0x313e bytes) 2024-04-23T23:39:41.130 INFO:teuthology.orchestra.run.smithi077.stdout:5891 read 0x38e7cf8 thru 0x38f1f1b (0xa224 bytes) 2024-04-23T23:39:41.130 INFO:teuthology.orchestra.run.smithi077.stdout:5893 write 0x7bd262b thru 0x7bd2ada (0x4b0 bytes) 2024-04-23T23:39:41.132 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.134 INFO:teuthology.orchestra.run.smithi077.stderr:set 3.c pg_upmap_items mapping to [7->1,5->3] 2024-04-23T23:39:41.136 INFO:teuthology.orchestra.run.smithi077.stdout:5899 trunc from 0x9d08e1f to 0x6f437d7 2024-04-23T23:39:41.150 INFO:teuthology.orchestra.run.smithi077.stdout:5902 read 0x501b691 thru 0x501c70a (0x107a bytes) 2024-04-23T23:39:41.150 INFO:teuthology.orchestra.run.smithi077.stdout:5903 read 0x56749d0 thru 0x56758ce (0xeff bytes) 2024-04-23T23:39:41.150 INFO:teuthology.orchestra.run.smithi077.stdout:5904 writesame 0x60f2198 thru 0x60f47cf data_size 0x4(0x2638 bytes) 2024-04-23T23:39:41.152 INFO:teuthology.orchestra.run.smithi077.stdout:5905 writesame 0x5b97cd4 thru 0x5b9ea4b data_size 0x71(0x6d78 bytes) 2024-04-23T23:39:41.156 INFO:teuthology.orchestra.run.smithi077.stdout:5906 trunc from 0x6f437d7 to 0x9867046 2024-04-23T23:39:41.170 INFO:teuthology.orchestra.run.smithi077.stdout:5907 trunc from 0x9867046 to 0x29d2cb1 2024-04-23T23:39:41.196 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:41.208+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:41.197 INFO:teuthology.orchestra.run.smithi077.stdout:5909 writesame 0xcd8ce9f thru 0xcd900fe data_size 0x4(0x3260 bytes) 2024-04-23T23:39:41.199 INFO:teuthology.orchestra.run.smithi077.stdout:5910 write 0x6530500 thru 0x6531548 (0x1049 bytes) 2024-04-23T23:39:41.200 INFO:teuthology.orchestra.run.smithi077.stdout:5913 punch from 0xc52cc83 to 0xc533885, (0x6c02 bytes) 2024-04-23T23:39:41.205 INFO:teuthology.orchestra.run.smithi077.stdout:5914 trunc from 0xcd900ff to 0x9410911 2024-04-23T23:39:41.210 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:39:41.214 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.214 INFO:teuthology.orchestra.run.smithi077.stdout:5917 read 0x4f80bcd thru 0x4f8a24b (0x967f bytes) 2024-04-23T23:39:41.215 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.215 INFO:teuthology.orchestra.run.smithi077.stdout:5919 read 0x2626cdb thru 0x2631c73 (0xaf99 bytes) 2024-04-23T23:39:41.215 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.215 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:41.215 INFO:teuthology.orchestra.run.smithi077.stdout:5923 read 0x19bec79 thru 0x19c4f31 (0x62b9 bytes) 2024-04-23T23:39:41.216 INFO:teuthology.orchestra.run.smithi077.stdout:5924 clone 54 order 22 su 2097152 sc 10 2024-04-23T23:39:41.240 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.240 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.249 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:41.297 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:41.309+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:41.351 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.352 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.360 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:41.401 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:41.413+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:41.499 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:41.512+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:41.502 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.502 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.511 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:41.600 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:41.612+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:41.613 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.613 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.622 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:41.701 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:41.713+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:41.724 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.725 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.734 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:41.802 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:41.814+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:41.836 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.836 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.845 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:41.902 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:41.914+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:41.948 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:41.948 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:41.957 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:41.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:42.041 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:42.053+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:42.099 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:42.099 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:42.103 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:42.115+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:42.108 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:42.113 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:42.113 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:42.130 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:42.131 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:42.137 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:39:42.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:42.151 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:42.151 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:42.169 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:42.170 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:42.189 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:42.190 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:42.201 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone53 from 0x9410911 (overlap 0xf88118) to 0x7c408c 2024-04-23T23:39:42.204 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:42.216+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:42.210 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:42.210 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:42.230 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:42.230 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:42.233 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:42.233 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.453674075000002, 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4437126619999994, 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:39:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4436952870000006, 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:39:42.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4436778429999997, 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:39:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4435420600000004, 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:39:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4435231809999998, 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4435058059999992, 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4433341599999991, 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:39:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:39:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:39:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4433172970000001, 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:39:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4433001979999993, 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:39:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:39:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4426597940000008, 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:39:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:39:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:39:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4425918539999998, 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:39:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4424078320000007, 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4420520230000005, 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:39:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4419835699999997, 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:39:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4419085329999994, 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:39:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:39:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4418231519999996, 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:39:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:39:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4415589739999994, 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:39:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:39:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:39:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4414890150000002, 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.358 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:39:42.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.363 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 8.4414211520000002, 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.364 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:42.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:39:42.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:39:42.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:42.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:42.369 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:42.371 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:42.383+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:42.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:42.471 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:42.483+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:42.483 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:42.483 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:42.483 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:42.483 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:42.485 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #52, image image_client.0-clone52 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent53 2024-04-23T23:39:42.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:42.496 INFO:teuthology.orchestra.run.smithi077.stdout:5925 read 0x862c698 thru 0x8635de8 (0x9751 bytes) 2024-04-23T23:39:42.497 INFO:teuthology.orchestra.run.smithi077.stdout:5927 read 0x6490a3 thru 0x653bb4 (0xab12 bytes) 2024-04-23T23:39:42.508 INFO:teuthology.orchestra.run.smithi077.stdout:5928 writesame 0xa90135e thru 0xa90eb7f data_size 0x16(0xd822 bytes) 2024-04-23T23:39:42.508 INFO:teuthology.orchestra.run.smithi077.stdout:5930 write 0x326c792 thru 0x32780ef (0xb95e bytes) 2024-04-23T23:39:42.513 INFO:teuthology.orchestra.run.smithi077.stdout:5932 clone 55 order 21 su 16384 sc 6 2024-04-23T23:39:42.573 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:42.585+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:42.596 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:42.597 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:42.597 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:42.597 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:42.597 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:42.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:42.689 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:42.702+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:42.748 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:42.748 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:42.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.650853729, 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.749 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.751 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.650840084, 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.753 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:42.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:42.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.650827034, 2024-04-23T23:39:42.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:42.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.761 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.650816015, 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.762 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:42.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.65080694, 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.766 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:42.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.650794996, 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.771 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:42.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.650785885, 2024-04-23T23:39:42.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:42.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.779 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64914051300001, 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:42.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:42.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.649128264, 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.784 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:42.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.788 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64494967100001, 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:42.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:42.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.644937889, 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.793 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64492782000001, 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.800 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.644916161, 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.804 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64490684099999, 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:42.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:42.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64489632900001, 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:42.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:42.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64488688900001, 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:42.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:42.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:42.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.644691796, 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:42.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.819 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.64467076299999, 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.644656873, 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:42.823 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 110.041500368, 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:42.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:42.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:42.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:42.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:42.831 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:42.832 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:42.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:42.834 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:42.845+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:42.934 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:42.946+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:42.977 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:42.977 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:42.977 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:42.977 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:42.985 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:43.035 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:43.047+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:43.087 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:43.088 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:43.088 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:43.088 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:43.088 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:43.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:43.136 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:43.148+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:43.219 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone54 from 0xa90eb80 (overlap 0x9410911) to 0x0 2024-04-23T23:39:43.237 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:43.249+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:43.257 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 84.436620781000002, 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:43.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.260 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:43.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 42.374761008999997, 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:43.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.267 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:39:43.268 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.269 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:39:43.270 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 38.401931490000003, 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.271 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.272 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.273 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.275 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8257346700000001, 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.276 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:39:43.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:39:43.278 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.279 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.825712598, 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.281 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:39:43.282 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.283 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.284 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:39:43.285 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8256868419999996, 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.286 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:39:43.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:39:43.289 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8256673379999997, 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.291 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.292 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8250642700000004, 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.297 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:39:43.299 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:39:43.300 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8250408480000004, 2024-04-23T23:39:43.301 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:39:43.303 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.304 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.305 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.306 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8250114980000003, 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:43.307 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:39:43.308 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.309 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:39:43.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8249834820000004, 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.312 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:43.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:39:43.314 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.315 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.316 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.82495662, 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.317 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.318 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:39:43.319 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:39:43.320 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:39:43.321 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8249341220000002, 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.322 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:43.323 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.324 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.325 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8249136630000002, 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.327 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.329 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.332 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8248840580000003, 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:39:43.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8248652070000002, 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.338 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.340 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:39:43.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8248543359999996, 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.343 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:43.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:39:43.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.824830789, 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.348 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:39:43.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:39:43.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8247883790000001, 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.353 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.354 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.8247707200000001, 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.358 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:43.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.360 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:43.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.363 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:43.364 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:43.365 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:43.376+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:43.366 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #53, image image_client.0-clone53 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent54 2024-04-23T23:39:43.385 INFO:teuthology.orchestra.run.smithi077.stdout:5933 trunc from 0xa90eb80 to 0x78978a9 2024-04-23T23:39:43.435 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:43.435 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:43.445 INFO:teuthology.orchestra.run.smithi077.stdout:5936 write 0xb6ecd5d thru 0xb6f43de (0x7682 bytes) 2024-04-23T23:39:43.460 INFO:teuthology.orchestra.run.smithi077.stdout:5937 trunc from 0xb6f43df to 0x27b5194 2024-04-23T23:39:43.465 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:43.477+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:43.490 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:43.490 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:43.490 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:43.490 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:43.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:43.502 INFO:teuthology.orchestra.run.smithi077.stdout:5938 punch from 0x4a9384 to 0x4b52a5, (0xbf21 bytes) 2024-04-23T23:39:43.502 INFO:teuthology.orchestra.run.smithi077.stdout:5940 clone 56 order 25 su 1048576 sc 13 2024-04-23T23:39:43.567 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:43.579+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:43.603 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:43.603 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:43.603 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:43.603 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:43.603 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:43.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:43.667 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:43.679+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:43.717 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:43.717 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:43.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:43.717 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 115.32011257800001, 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:43.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:43.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:43.722 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 106.320416724, 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:43.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.726 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 65.172556068000006, 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:43.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:43.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 65.153987837000003, 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.731 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:43.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:43.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.477489267999999, 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:43.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 15.47286362, 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:39:43.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:39:43.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 5.5036389589999999, 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.745 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:43.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.750 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5308220690000001, 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.751 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5307941849999995, 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.755 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:39:43.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:39:43.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5307750159999998, 2024-04-23T23:39:43.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:43.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.763 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5307568030000001, 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:39:43.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:39:43.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5307280810000004, 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.768 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5307084150000003, 2024-04-23T23:39:43.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:39:43.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:39:43.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5306898760000003, 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.778 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.780 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5306598549999997, 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.781 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:39:43.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:39:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5306397870000001, 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.785 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:43.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:39:43.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5306215879999998, 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:43.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:39:43.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:39:43.793 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5306039, 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.794 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5305859980000003, 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:39:43.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 4.5305679650000004, 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:43.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.806 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:43.807 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:43.807 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:43.809 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:43.809 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:43.820+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:43.908 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:43.920+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:43.911 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:43.911 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:43.911 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:43.911 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:43.920 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:44.010 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:44.022+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:44.063 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:44.063 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:44.064 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:44.064 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:44.064 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:44.072 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:44.116 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:44.128+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:44.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 99.202296783999998, 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:44.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:44.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:44.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:44.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.298542367000003, 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:44.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:44.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.192 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 34.182292117999999, 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.193 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:44.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.012989966999999, 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:39:44.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:39:44.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005466117999999, 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:39:44.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005413565, 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:44.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:39:44.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:44.213 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005386764000001, 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005362886, 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.219 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:39:44.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:39:44.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:39:44.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:44.223 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005341044, 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:39:44.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:39:44.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.00513149, 2024-04-23T23:39:44.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:39:44.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:39:44.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.234 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005082251999999, 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:44.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:39:44.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.240 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005037248000001, 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.241 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.005002230000001, 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:39:44.247 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:44.252 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004660847, 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:39:44.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:39:44.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:39:44.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:44.258 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004626083, 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004603328, 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.263 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:44.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:39:44.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.266 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004330697, 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:39:44.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:44.272 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004298067000001, 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:44.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004092853, 2024-04-23T23:39:44.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:39:44.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:39:44.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 11.004009856, 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:44.282 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:44.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:44.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:39:44.286 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.287 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.287 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.287 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:44.287 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:44.287 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:44.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:44.288 INFO:teuthology.orchestra.run.smithi077.stdout:truncating image image_client.0-clone55 from 0x27b5194 (overlap 0x27b5194) to 0x3f8828 2024-04-23T23:39:44.289 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:44.300+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:44.289 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:44.389 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:44.401+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:44.428 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:44.428 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:44.447 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:44.447 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:44.452 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:44.452 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:44.452 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:44.452 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:44.457 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #54, image image_client.0-clone54 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent55 2024-04-23T23:39:44.459 INFO:teuthology.orchestra.run.smithi077.stdout:5941 punch from 0x220a482 to 0x220d6eb, (0x3269 bytes) 2024-04-23T23:39:44.462 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:44.463 INFO:teuthology.orchestra.run.smithi077.stdout:5945 read 0x1fd1a3f thru 0x1fd3add (0x209f bytes) 2024-04-23T23:39:44.465 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:44.466 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:44.466 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:44.474 INFO:teuthology.orchestra.run.smithi077.stdout:5946 writesame 0x6e73d06 thru 0x6e745c8 data_size 0x1(0x8c3 bytes) 2024-04-23T23:39:44.486 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:44.486 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:44.490 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:44.502+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:44.499 INFO:teuthology.orchestra.run.smithi077.stdout:5947 writesame 0xcfeb60a thru 0xcff4819 data_size 0x98(0x9210 bytes) 2024-04-23T23:39:44.508 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:44.508 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:44.524 INFO:teuthology.orchestra.run.smithi077.stdout:5948 trunc from 0xcff481a to 0x42532c4 2024-04-23T23:39:44.528 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:44.528 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:44.568 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:44.571 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:44.572 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:44.603 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:44.604 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:44.613 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:44.626+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:44.615 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:44.635 INFO:teuthology.orchestra.run.smithi077.stdout:5949 trunc from 0x42532c4 to 0xaeaa981 2024-04-23T23:39:44.642 INFO:teuthology.orchestra.run.smithi077.stdout:5950 trunc from 0xaeaa981 to 0xaed8d44 2024-04-23T23:39:44.648 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.648 INFO:teuthology.orchestra.run.smithi077.stdout:5952 writesame 0x58b270f thru 0x58be488 data_size 0x2(0xbd7a bytes) 2024-04-23T23:39:44.661 INFO:teuthology.orchestra.run.smithi077.stdout:5953 writesame 0x67a84a8 thru 0x67aa698 data_size 0x1(0x21f1 bytes) 2024-04-23T23:39:44.671 INFO:teuthology.orchestra.run.smithi077.stdout:5954 trunc from 0xaed8d44 to 0x6e4eb8f 2024-04-23T23:39:44.680 INFO:teuthology.orchestra.run.smithi077.stdout:5955 write 0x23bcdd thru 0x246437 (0xa75b bytes) 2024-04-23T23:39:44.682 INFO:teuthology.orchestra.run.smithi077.stdout:5956 flatten 2024-04-23T23:39:44.691 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:44.704+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:44.694 INFO:teuthology.orchestra.run.smithi077.stdout:5957 trunc from 0x6e4eb8f to 0x205d5a2 2024-04-23T23:39:44.703 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.703 INFO:teuthology.orchestra.run.smithi077.stdout:5959 punch from 0x2dfe1a to 0x2e4aee, (0x4cd4 bytes) 2024-04-23T23:39:44.718 INFO:teuthology.orchestra.run.smithi077.stdout:5960 write 0x94f99f7 thru 0x94fa53b (0xb45 bytes) 2024-04-23T23:39:44.719 INFO:teuthology.orchestra.run.smithi077.stdout:5961 punch from 0x57052b6 to 0x570b229, (0x5f73 bytes) 2024-04-23T23:39:44.720 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.720 INFO:teuthology.orchestra.run.smithi077.stdout:5969 writesame 0x58a538d thru 0x58aaa61 data_size 0x1(0x56d5 bytes) 2024-04-23T23:39:44.725 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:44.725 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:44.732 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.735 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:44.743 INFO:teuthology.orchestra.run.smithi077.stdout:5971 writesame 0xd08ee5c thru 0xd0923f4 data_size 0x1(0x3599 bytes) 2024-04-23T23:39:44.745 INFO:teuthology.orchestra.run.smithi077.stdout:5972 write 0xab28866 thru 0xab34555 (0xbcf0 bytes) 2024-04-23T23:39:44.747 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.747 INFO:teuthology.orchestra.run.smithi077.stdout:5974 writesame 0x41dcae5 thru 0x41e3db9 data_size 0x3(0x72d5 bytes) 2024-04-23T23:39:44.753 INFO:teuthology.orchestra.run.smithi077.stdout:5975 writesame 0xcc3bea4 thru 0xcc4af53 data_size 0x8(0xf0b0 bytes) 2024-04-23T23:39:44.758 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.758 INFO:teuthology.orchestra.run.smithi077.stdout:5977 writesame 0x4432555 thru 0x443ee29 data_size 0x1(0xc8d5 bytes) 2024-04-23T23:39:44.783 INFO:teuthology.orchestra.run.smithi077.stdout:5978 write 0x9adc0e7 thru 0x9aea17f (0xe099 bytes) 2024-04-23T23:39:44.785 INFO:teuthology.orchestra.run.smithi077.stdout:5980 write 0x2f6e5fe thru 0x2f7553f (0x6f42 bytes) 2024-04-23T23:39:44.787 INFO:teuthology.orchestra.run.smithi077.stdout:5983 writesame 0xf1d9ee thru 0xf26db7 data_size 0x1(0x93ca bytes) 2024-04-23T23:39:44.792 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:44.804+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:44.807 INFO:teuthology.orchestra.run.smithi077.stdout:5986 write 0x54a154b thru 0x54ae761 (0xd217 bytes) 2024-04-23T23:39:44.809 INFO:teuthology.orchestra.run.smithi077.stdout:5987 read 0x6f36f5a thru 0x6f3c79c (0x5843 bytes) 2024-04-23T23:39:44.809 INFO:teuthology.orchestra.run.smithi077.stdout:compare and write disabled 2024-04-23T23:39:44.810 INFO:teuthology.orchestra.run.smithi077.stdout:5993 write 0x9987b71 thru 0x9987b9b (0x2b bytes) 2024-04-23T23:39:44.816 INFO:teuthology.orchestra.run.smithi077.stdout:5994 trunc from 0xd0923f5 to 0x8ae89bd 2024-04-23T23:39:44.825 INFO:teuthology.orchestra.run.smithi077.stdout:5996 read 0x5b408fc thru 0x5b4f26f (0xe974 bytes) 2024-04-23T23:39:44.825 INFO:teuthology.orchestra.run.smithi077.stdout:5997 read 0x1a026d2 thru 0x1a094ba (0x6de9 bytes) 2024-04-23T23:39:44.838 INFO:teuthology.orchestra.run.smithi077.stdout:5998 write 0xe27f31c thru 0xe2894a4 (0xa189 bytes) 2024-04-23T23:39:44.839 INFO:teuthology.orchestra.run.smithi077.stdout:6000 writesame 0xb56c0a7 thru 0xb56deb7 data_size 0x1(0x1e11 bytes) 2024-04-23T23:39:44.844 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:44.844 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:44.854 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:44.885 INFO:teuthology.orchestra.run.smithi077.stdout:checking clone #55, image image_client.0-clone55 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent56 2024-04-23T23:39:44.893 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:44.905+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:44.962 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:44.962 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:44.971 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:45.014 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:45.026+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:45.077 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.077 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.085 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:45.094 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:45.106+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:45.153 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:39:45.210 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:45.223+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:45.241 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.241 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.251 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:45.296 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:45.308+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:45.353 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.353 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.362 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:45.405 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:45.417+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:45.464 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.464 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.472 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:45.515 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:45.528+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:45.576 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.576 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:45.597 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:45.609+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:45.698 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:45.710+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:45.726 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.726 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:45.799 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:45.811+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.837 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.846 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:45.931 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:45.943+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:45.989 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:45.989 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:45.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:46.000 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:46.012+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:46.101 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:46.113+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:46.139 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:46.139 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:46.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:46.149 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7] out_osds: [3, 0] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:46.150 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:46.150 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-23T23:39:46.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:39:46.248 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:46.214+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:46.257 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:46.257 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:46.267 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:46.311 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:46.323+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:46.372 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:46.373 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:46.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:46.418 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:46.416+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 134, 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:39:46.166595+0000", 2024-04-23T23:39:46.453 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:38:46.812648+0000", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:39:29.079576+0000", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5806080, 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "nodeep-scrub", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "noscrub", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 5, 2024-04-23T23:39:46.454 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 3, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "jewel", 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:39:46.455 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:39:46.456 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:46.457 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:46.458 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:46.459 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:46.460 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 8, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 8, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.25, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:39:46.461 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:39:46.462 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:46.463 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:46.464 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:46.465 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 3, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 3, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.75, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.25, 2024-04-23T23:39:46.466 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2.25, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "pool_client.0", 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:30.028908+0000", 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 8193, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:39:46.467 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 32, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 32, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 32, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 32, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 32, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:39:46.468 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "134", 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 58, 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 134, 2024-04-23T23:39:46.469 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:39:46.470 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:39:46.471 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 2.75, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 2.75, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.75, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.059999942779541, 2024-04-23T23:39:46.472 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2.059999942779541, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.86239051818847656, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.86000001430511475, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.86000001430511475 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.473 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 80, 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:39:46.474 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.475 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.476 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:39:46.478 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 126, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.479 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:39:46.480 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.481 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.482 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.483 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 119, 2024-04-23T23:39:46.485 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.487 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.488 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:39:46.489 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 0, 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:46.490 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 55, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 84, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:39:46.491 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.492 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.493 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4292713565 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/4292713565", 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/4292713565", 2024-04-23T23:39:46.494 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/4292713565", 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/4292713565", 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "exists" 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0.8255157470703125, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.495 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 122, 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.497 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:39:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:39:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 24, 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 35, 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 126, 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 26, 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2756265516", 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2756265516", 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2756265516", 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2756265516", 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:46.505 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.1546478271484375, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 117, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.506 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.507 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.508 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.509 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.744476318359375, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 123, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:39:46.511 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:39:46.512 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:39:46.513 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:39:46.515 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:39:46.516 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.517 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:39:46.518 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 84 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.519 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 26 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.520 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:46.521 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [], 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [ 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 57, 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 2 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [ 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:39:46.523 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 57, 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 1 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [], 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:39:46.524 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:39:46.525 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:39:46.525 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:39:46.525 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:46.525 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:46.527 INFO:tasks.thrashosds.thrasher:j is {'epoch': 134, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:39:46.166595+0000', 'last_up_change': '2024-04-23T23:38:46.812648+0000', 'last_in_change': '2024-04-23T23:39:29.079576+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3, 'score_stable': 3, 'optimal_score': 0.75, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-04-23T23:37:30.028908+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '134', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 58, 'snap_epoch': 134, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.75, 'score_stable': 2.75, 'optimal_score': 0.75, 'raw_score_acting': 2.059999942779541, 'raw_score_stable': 2.059999942779541, 'primary_affinity_weighted': 0.8623905181884766, 'average_primary_affinity': 0.8600000143051147, 'average_primary_affinity_weighted': 0.8600000143051147}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 80, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 126, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 119, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 0, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 55, 'down_at': 84, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 4292713565}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 4292713565}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 4292713565}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 4292713565}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 4292713565}]}, 'public_addr': '172.21.15.77:6809/4292713565', 'cluster_addr': '172.21.15.77:6811/4292713565', 'heartbeat_back_addr': '172.21.15.77:6815/4292713565', 'heartbeat_front_addr': '172.21.15.77:6813/4292713565', 'state': ['exists']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 0.8255157470703125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 122, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 24, 'up_from': 35, 'up_thru': 126, 'down_at': 26, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2756265516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2756265516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2756265516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2756265516}]}, 'public_addr': '172.21.15.170:6801/2756265516', 'cluster_addr': '172.21.15.170:6803/2756265516', 'heartbeat_back_addr': '172.21.15.170:6807/2756265516', 'heartbeat_front_addr': '172.21.15.170:6805/2756265516', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.1546478271484375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 117, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.744476318359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 123, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 84}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 26}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 57, 'length': 2}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 57, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:39:46.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:39:46.527 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:46.527 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:46.528 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:46.538+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:46.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:46.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:46.627 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:46.638+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:46.683 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:46.683 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:46.692 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:46.711 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:46.711 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:46.727 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:46.739+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:46.735 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:46.735 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:46.753 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:46.769 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:46.769 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:46.787 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:46.787 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:46.804 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:46.804 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:46.808 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:46.808 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:46.808 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:46.808 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:46.817 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:46.821 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:46.821 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:46.824 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:46.825 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:46.861 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:46.873+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:46.885 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:39:46.886 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:39:46.897 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-23T23:39:46.227239+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2156732172,"num_objects":3004,"num_object_clones":425,"num_object_copies":6008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3004,"num_whiteouts":1537,"num_read":338709,"num_read_kb":1222553,"num_write":21050,"num_write_kb":688922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7565,"num_bytes_recovered":453027683,"num_keys_recovered":1110,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17786,"ondisk_log_size":17786,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":916856,"kb_used_data":622764,"kb_used_omap":12,"kb_used_meta":290803,"kb_avail":565314184,"statfs":{"total":579820584960,"available":578881724416,"internally_reserved":0,"allocated":637710336,"data_stored":819562928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12467,"internal_metadata":297783117},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,3,0,0,0,0,0,56],"upper_bound":2048},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":44291605,"num_objects":78,"num_object_clones":19,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":34,"num_read":9944,"num_read_kb":90569,"num_write":665,"num_write_kb":31491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000649"},"pg_stats":[{"pgid":"3.1f","version":"127'702","reported_seq":5552,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157407+0000","last_change":"2024-04-23T23:38:44.815145+0000","last_active":"2024-04-23T23:39:42.157407+0000","last_peered":"2024-04-23T23:39:42.157407+0000","last_clean":"2024-04-23T23:39:42.157407+0000","last_became_active":"2024-04-23T23:38:44.813152+0000","last_became_peered":"2024-04-23T23:38:44.813152+0000","last_unstale":"2024-04-23T23:39:42.157407+0000","last_undegraded":"2024-04-23T23:39:42.157407+0000","last_fullsized":"2024-04-23T23:39:42.157407+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":702,"log_dups_size":0,"ondisk_log_size":702,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:34:17.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0036166670000000001,"stat_sum":{"num_bytes":39032613,"num_objects":87,"num_object_clones":9,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":48,"num_read":7378,"num_read_kb":18903,"num_write":898,"num_write_kb":5051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":94,"num_bytes_recovered":3224152,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"133'418","reported_seq":4350,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.171631+0000","last_change":"2024-04-23T23:39:45.171840+0000","last_active":"2024-04-23T23:39:45.171631+0000","last_peered":"2024-04-23T23:39:45.171631+0000","last_clean":"2024-04-23T23:39:45.171631+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:39:45.171631+0000","last_undegraded":"2024-04-23T23:39:45.171631+0000","last_fullsized":"2024-04-23T23:39:45.171631+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:23:15.137326+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0033024809999999999,"stat_sum":{"num_bytes":59978779,"num_objects":111,"num_object_clones":14,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":62,"num_read":4926,"num_read_kb":28784,"num_write":364,"num_write_kb":9489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.1d","version":"128'527","reported_seq":23063,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.187435+0000","last_change":"2024-04-23T23:39:04.817002+0000","last_active":"2024-04-23T23:39:42.187435+0000","last_peered":"2024-04-23T23:39:42.187435+0000","last_clean":"2024-04-23T23:39:42.187435+0000","last_became_active":"2024-04-23T23:39:04.816060+0000","last_became_peered":"2024-04-23T23:39:04.816060+0000","last_unstale":"2024-04-23T23:39:42.187435+0000","last_undegraded":"2024-04-23T23:39:42.187435+0000","last_fullsized":"2024-04-23T23:39:42.187435+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:54.560136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013335580000000001,"stat_sum":{"num_bytes":51922760,"num_objects":109,"num_object_clones":18,"num_object_copies":218,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":51,"num_read":24084,"num_read_kb":38985,"num_write":562,"num_write_kb":35259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"130'560","reported_seq":14963,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.522696+0000","last_change":"2024-04-23T23:39:03.818256+0000","last_active":"2024-04-23T23:39:42.522696+0000","last_peered":"2024-04-23T23:39:42.522696+0000","last_clean":"2024-04-23T23:39:42.522696+0000","last_became_active":"2024-04-23T23:39:03.817321+0000","last_became_peered":"2024-04-23T23:39:03.817321+0000","last_unstale":"2024-04-23T23:39:42.522696+0000","last_undegraded":"2024-04-23T23:39:42.522696+0000","last_fullsized":"2024-04-23T23:39:42.522696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:10:18.686964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62409979,"num_objects":95,"num_object_clones":15,"num_object_copies":190,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":95,"num_whiteouts":50,"num_read":16596,"num_read_kb":41301,"num_write":545,"num_write_kb":16191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"133'736","reported_seq":4709,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.175524+0000","last_change":"2024-04-23T23:39:45.175837+0000","last_active":"2024-04-23T23:39:45.175524+0000","last_peered":"2024-04-23T23:39:45.175524+0000","last_clean":"2024-04-23T23:39:45.175524+0000","last_became_active":"2024-04-23T23:39:34.821251+0000","last_became_peered":"2024-04-23T23:39:34.821251+0000","last_unstale":"2024-04-23T23:39:45.175524+0000","last_undegraded":"2024-04-23T23:39:45.175524+0000","last_fullsized":"2024-04-23T23:39:45.175524+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:38:55.405238+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.006789481,"stat_sum":{"num_bytes":41611637,"num_objects":93,"num_object_clones":14,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":51,"num_read":5714,"num_read_kb":35865,"num_write":1048,"num_write_kb":30796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":390,"num_bytes_recovered":27315039,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.1a","version":"131'599","reported_seq":16174,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.205225+0000","last_change":"2024-04-23T23:39:45.169378+0000","last_active":"2024-04-23T23:39:45.205225+0000","last_peered":"2024-04-23T23:39:45.205225+0000","last_clean":"2024-04-23T23:39:45.205225+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:39:45.205225+0000","last_undegraded":"2024-04-23T23:39:45.205225+0000","last_fullsized":"2024-04-23T23:39:45.205225+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:28:01.881997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083925999999999998,"stat_sum":{"num_bytes":54520331,"num_objects":82,"num_object_clones":10,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":38,"num_read":18202,"num_read_kb":30430,"num_write":735,"num_write_kb":19940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.19","version":"128'577","reported_seq":8524,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.149193+0000","last_change":"2024-04-23T23:39:39.138589+0000","last_active":"2024-04-23T23:39:41.149193+0000","last_peered":"2024-04-23T23:39:41.149193+0000","last_clean":"2024-04-23T23:39:41.149193+0000","last_became_active":"2024-04-23T23:39:39.136832+0000","last_became_peered":"2024-04-23T23:39:39.136832+0000","last_unstale":"2024-04-23T23:39:41.149193+0000","last_undegraded":"2024-04-23T23:39:41.149193+0000","last_fullsized":"2024-04-23T23:39:41.149193+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":577,"log_dups_size":0,"ondisk_log_size":577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:55:24.484288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044664900000000003,"stat_sum":{"num_bytes":156368807,"num_objects":125,"num_object_clones":21,"num_object_copies":250,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":125,"num_whiteouts":66,"num_read":7938,"num_read_kb":48381,"num_write":578,"num_write_kb":29016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":439,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"129'423","reported_seq":2793,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.220017+0000","last_change":"2024-04-23T23:38:44.810906+0000","last_active":"2024-04-23T23:39:41.220017+0000","last_peered":"2024-04-23T23:39:41.220017+0000","last_clean":"2024-04-23T23:39:41.220017+0000","last_became_active":"2024-04-23T23:38:44.809902+0000","last_became_peered":"2024-04-23T23:38:44.809902+0000","last_unstale":"2024-04-23T23:39:41.220017+0000","last_undegraded":"2024-04-23T23:39:41.220017+0000","last_fullsized":"2024-04-23T23:39:41.220017+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:30:31.394679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091463299999999998,"stat_sum":{"num_bytes":77986866,"num_objects":88,"num_object_clones":15,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":42,"num_read":2537,"num_read_kb":38490,"num_write":532,"num_write_kb":26962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":137,"num_bytes_recovered":16101144,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.17","version":"130'517","reported_seq":4866,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.527352+0000","last_change":"2024-04-23T23:38:44.815156+0000","last_active":"2024-04-23T23:39:42.527352+0000","last_peered":"2024-04-23T23:39:42.527352+0000","last_clean":"2024-04-23T23:39:42.527352+0000","last_became_active":"2024-04-23T23:38:44.814027+0000","last_became_peered":"2024-04-23T23:38:44.814027+0000","last_unstale":"2024-04-23T23:39:42.527352+0000","last_undegraded":"2024-04-23T23:39:42.527352+0000","last_fullsized":"2024-04-23T23:39:42.527352+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:26:22.234571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035554319999999999,"stat_sum":{"num_bytes":81980255,"num_objects":89,"num_object_clones":9,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":49,"num_read":5553,"num_read_kb":47082,"num_write":708,"num_write_kb":36166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":34599238,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.16","version":"126'645","reported_seq":23686,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157252+0000","last_change":"2024-04-23T23:39:33.821705+0000","last_active":"2024-04-23T23:39:42.157252+0000","last_peered":"2024-04-23T23:39:42.157252+0000","last_clean":"2024-04-23T23:39:42.157252+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:39:42.157252+0000","last_undegraded":"2024-04-23T23:39:42.157252+0000","last_fullsized":"2024-04-23T23:39:42.157252+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":645,"log_dups_size":0,"ondisk_log_size":645,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:37:36.078256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012770870000000001,"stat_sum":{"num_bytes":75336192,"num_objects":85,"num_object_clones":15,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":39,"num_read":24960,"num_read_kb":49593,"num_write":822,"num_write_kb":36117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"133'429","reported_seq":7364,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.233609+0000","last_change":"2024-04-23T23:39:45.175481+0000","last_active":"2024-04-23T23:39:45.233609+0000","last_peered":"2024-04-23T23:39:45.233609+0000","last_clean":"2024-04-23T23:39:45.233609+0000","last_became_active":"2024-04-23T23:39:34.818900+0000","last_became_peered":"2024-04-23T23:39:34.818900+0000","last_unstale":"2024-04-23T23:39:45.233609+0000","last_undegraded":"2024-04-23T23:39:45.233609+0000","last_fullsized":"2024-04-23T23:39:45.233609+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:12:41.168719+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.002462919,"stat_sum":{"num_bytes":59898128,"num_objects":116,"num_object_clones":16,"num_object_copies":232,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":116,"num_whiteouts":70,"num_read":7782,"num_read_kb":27651,"num_write":377,"num_write_kb":20388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":536,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.14","version":"133'843","reported_seq":12570,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.172755+0000","last_change":"2024-04-23T23:39:45.173072+0000","last_active":"2024-04-23T23:39:45.172755+0000","last_peered":"2024-04-23T23:39:45.172755+0000","last_clean":"2024-04-23T23:39:45.172755+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:39:45.172755+0000","last_undegraded":"2024-04-23T23:39:45.172755+0000","last_fullsized":"2024-04-23T23:39:45.172755+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":843,"log_dups_size":0,"ondisk_log_size":843,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:43.256033+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0041904079999999996,"stat_sum":{"num_bytes":23203930,"num_objects":90,"num_object_clones":9,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":48,"num_read":15022,"num_read_kb":19775,"num_write":1124,"num_write_kb":9767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.171995+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:39:45.171995+0000","last_peered":"2024-04-23T23:39:45.171995+0000","last_clean":"2024-04-23T23:39:45.171995+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:39:45.171995+0000","last_undegraded":"2024-04-23T23:39:45.171995+0000","last_fullsized":"2024-04-23T23:39:45.171995+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"114'352","reported_seq":5680,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.149105+0000","last_change":"2024-04-23T23:39:03.817855+0000","last_active":"2024-04-23T23:39:41.149105+0000","last_peered":"2024-04-23T23:39:41.149105+0000","last_clean":"2024-04-23T23:39:41.149105+0000","last_became_active":"2024-04-23T23:39:03.817144+0000","last_became_peered":"2024-04-23T23:39:03.817144+0000","last_unstale":"2024-04-23T23:39:41.149105+0000","last_undegraded":"2024-04-23T23:39:41.149105+0000","last_fullsized":"2024-04-23T23:39:41.149105+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:06:30.646145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00043457199999999999,"stat_sum":{"num_bytes":75151940,"num_objects":74,"num_object_clones":8,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":40,"num_read":5977,"num_read_kb":30278,"num_write":329,"num_write_kb":2218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":178,"num_bytes_recovered":1741635,"num_keys_recovered":22,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":231,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.149201+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:39:41.149201+0000","last_peered":"2024-04-23T23:39:41.149201+0000","last_clean":"2024-04-23T23:39:41.149201+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:39:41.149201+0000","last_undegraded":"2024-04-23T23:39:41.149201+0000","last_fullsized":"2024-04-23T23:39:41.149201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"128'720","reported_seq":6238,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157337+0000","last_change":"2024-04-23T23:39:34.823209+0000","last_active":"2024-04-23T23:39:42.157337+0000","last_peered":"2024-04-23T23:39:42.157337+0000","last_clean":"2024-04-23T23:39:42.157337+0000","last_became_active":"2024-04-23T23:39:34.821481+0000","last_became_peered":"2024-04-23T23:39:34.821481+0000","last_unstale":"2024-04-23T23:39:42.157337+0000","last_undegraded":"2024-04-23T23:39:42.157337+0000","last_fullsized":"2024-04-23T23:39:42.157337+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":720,"log_dups_size":0,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:48:33.827478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000861358,"stat_sum":{"num_bytes":61390214,"num_objects":90,"num_object_clones":10,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":90,"num_whiteouts":44,"num_read":7874,"num_read_kb":60071,"num_write":1033,"num_write_kb":15158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":353,"num_bytes_recovered":27781085,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.172997+0000","last_change":"2024-04-23T23:39:30.097707+0000","last_active":"2024-04-23T23:39:45.172997+0000","last_peered":"2024-04-23T23:39:45.172997+0000","last_clean":"2024-04-23T23:39:45.172997+0000","last_became_active":"2024-04-23T23:39:30.097408+0000","last_became_peered":"2024-04-23T23:39:30.097408+0000","last_unstale":"2024-04-23T23:39:45.172997+0000","last_undegraded":"2024-04-23T23:39:45.172997+0000","last_fullsized":"2024-04-23T23:39:45.172997+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:54:12.033021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"129'445","reported_seq":4394,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.206961+0000","last_change":"2024-04-23T23:37:33.804737+0000","last_active":"2024-04-23T23:39:41.206961+0000","last_peered":"2024-04-23T23:39:41.206961+0000","last_clean":"2024-04-23T23:39:41.206961+0000","last_became_active":"2024-04-23T23:37:31.799126+0000","last_became_peered":"2024-04-23T23:37:31.799126+0000","last_unstale":"2024-04-23T23:39:41.206961+0000","last_undegraded":"2024-04-23T23:39:41.206961+0000","last_fullsized":"2024-04-23T23:39:41.206961+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:14:09.726950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000552153,"stat_sum":{"num_bytes":63588014,"num_objects":83,"num_object_clones":10,"num_object_copies":166,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":37,"num_read":4796,"num_read_kb":41102,"num_write":434,"num_write_kb":18688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":246,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.149716+0000","last_change":"2024-04-23T23:39:30.096775+0000","last_active":"2024-04-23T23:39:41.149716+0000","last_peered":"2024-04-23T23:39:41.149716+0000","last_clean":"2024-04-23T23:39:41.149716+0000","last_became_active":"2024-04-23T23:39:30.096449+0000","last_became_peered":"2024-04-23T23:39:30.096449+0000","last_unstale":"2024-04-23T23:39:41.149716+0000","last_undegraded":"2024-04-23T23:39:41.149716+0000","last_fullsized":"2024-04-23T23:39:41.149716+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:58:25.705085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"130'716","reported_seq":3432,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.518513+0000","last_change":"2024-04-23T23:38:19.815075+0000","last_active":"2024-04-23T23:39:42.518513+0000","last_peered":"2024-04-23T23:39:42.518513+0000","last_clean":"2024-04-23T23:39:42.518513+0000","last_became_active":"2024-04-23T23:38:19.813635+0000","last_became_peered":"2024-04-23T23:38:19.813635+0000","last_unstale":"2024-04-23T23:39:42.518513+0000","last_undegraded":"2024-04-23T23:39:42.518513+0000","last_fullsized":"2024-04-23T23:39:42.518513+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:11:54.565296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014827079999999999,"stat_sum":{"num_bytes":43509576,"num_objects":91,"num_object_clones":14,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":51,"num_read":5792,"num_read_kb":29599,"num_write":1072,"num_write_kb":23070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"133'437","reported_seq":7308,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.220522+0000","last_change":"2024-04-23T23:39:45.170043+0000","last_active":"2024-04-23T23:39:45.220522+0000","last_peered":"2024-04-23T23:39:45.220522+0000","last_clean":"2024-04-23T23:39:45.220522+0000","last_became_active":"2024-04-23T23:39:05.817222+0000","last_became_peered":"2024-04-23T23:39:05.817222+0000","last_unstale":"2024-04-23T23:39:45.220522+0000","last_undegraded":"2024-04-23T23:39:45.220522+0000","last_fullsized":"2024-04-23T23:39:45.220522+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:19:13.830794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001266344,"stat_sum":{"num_bytes":26734043,"num_objects":88,"num_object_clones":15,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":43,"num_read":7350,"num_read_kb":30867,"num_write":521,"num_write_kb":18406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":240,"num_bytes_recovered":11294254,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":208,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157040+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:39:42.157040+0000","last_peered":"2024-04-23T23:39:42.157040+0000","last_clean":"2024-04-23T23:39:42.157040+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:39:42.157040+0000","last_undegraded":"2024-04-23T23:39:42.157040+0000","last_fullsized":"2024-04-23T23:39:42.157040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"127'447","reported_seq":2970,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.149193+0000","last_change":"2024-04-23T23:37:33.804968+0000","last_active":"2024-04-23T23:39:41.149193+0000","last_peered":"2024-04-23T23:39:41.149193+0000","last_clean":"2024-04-23T23:39:41.149193+0000","last_became_active":"2024-04-23T23:37:31.799146+0000","last_became_peered":"2024-04-23T23:37:31.799146+0000","last_unstale":"2024-04-23T23:39:41.149193+0000","last_undegraded":"2024-04-23T23:39:41.149193+0000","last_fullsized":"2024-04-23T23:39:41.149193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:00.185591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055612800000000003,"stat_sum":{"num_bytes":91651438,"num_objects":86,"num_object_clones":9,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":44,"num_read":3105,"num_read_kb":43301,"num_write":633,"num_write_kb":67967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.168273+0000","last_change":"2024-04-23T23:38:42.163377+0000","last_active":"2024-04-23T23:39:45.168273+0000","last_peered":"2024-04-23T23:39:45.168273+0000","last_clean":"2024-04-23T23:39:45.168273+0000","last_became_active":"2024-04-23T23:38:42.163067+0000","last_became_peered":"2024-04-23T23:38:42.163067+0000","last_unstale":"2024-04-23T23:39:45.168273+0000","last_undegraded":"2024-04-23T23:39:45.168273+0000","last_fullsized":"2024-04-23T23:39:45.168273+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:15.517160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"130'639","reported_seq":5290,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.522417+0000","last_change":"2024-04-23T23:39:39.137898+0000","last_active":"2024-04-23T23:39:42.522417+0000","last_peered":"2024-04-23T23:39:42.522417+0000","last_clean":"2024-04-23T23:39:42.522417+0000","last_became_active":"2024-04-23T23:39:39.137072+0000","last_became_peered":"2024-04-23T23:39:39.137072+0000","last_unstale":"2024-04-23T23:39:42.522417+0000","last_undegraded":"2024-04-23T23:39:42.522417+0000","last_fullsized":"2024-04-23T23:39:42.522417+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":639,"log_dups_size":0,"ondisk_log_size":639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:10:51.418584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047655700000000001,"stat_sum":{"num_bytes":85068618,"num_objects":76,"num_object_clones":8,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":42,"num_read":5716,"num_read_kb":20866,"num_write":911,"num_write_kb":14225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":335,"num_bytes_recovered":10864983,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":191,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.149311+0000","last_change":"2024-04-23T23:39:30.096215+0000","last_active":"2024-04-23T23:39:41.149311+0000","last_peered":"2024-04-23T23:39:41.149311+0000","last_clean":"2024-04-23T23:39:41.149311+0000","last_became_active":"2024-04-23T23:39:30.095821+0000","last_became_peered":"2024-04-23T23:39:30.095821+0000","last_unstale":"2024-04-23T23:39:41.149311+0000","last_undegraded":"2024-04-23T23:39:41.149311+0000","last_fullsized":"2024-04-23T23:39:41.149311+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:45:35.675445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"128'660","reported_seq":3599,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157117+0000","last_change":"2024-04-23T23:38:19.814491+0000","last_active":"2024-04-23T23:39:42.157117+0000","last_peered":"2024-04-23T23:39:42.157117+0000","last_clean":"2024-04-23T23:39:42.157117+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:39:42.157117+0000","last_undegraded":"2024-04-23T23:39:42.157117+0000","last_fullsized":"2024-04-23T23:39:42.157117+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":660,"log_dups_size":0,"ondisk_log_size":660,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:41:12.543597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000789393,"stat_sum":{"num_bytes":46921265,"num_objects":75,"num_object_clones":8,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":38,"num_read":5185,"num_read_kb":12783,"num_write":826,"num_write_kb":5230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157064+0000","last_change":"2024-04-23T23:39:19.038209+0000","last_active":"2024-04-23T23:39:42.157064+0000","last_peered":"2024-04-23T23:39:42.157064+0000","last_clean":"2024-04-23T23:39:42.157064+0000","last_became_active":"2024-04-23T23:39:19.037898+0000","last_became_peered":"2024-04-23T23:39:19.037898+0000","last_unstale":"2024-04-23T23:39:42.157064+0000","last_undegraded":"2024-04-23T23:39:42.157064+0000","last_fullsized":"2024-04-23T23:39:42.157064+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:32:00.541565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":358,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.172817+0000","last_change":"2024-04-23T23:39:33.118029+0000","last_active":"2024-04-23T23:39:45.172817+0000","last_peered":"2024-04-23T23:39:45.172817+0000","last_clean":"2024-04-23T23:39:45.172817+0000","last_became_active":"2024-04-23T23:39:33.117656+0000","last_became_peered":"2024-04-23T23:39:33.117656+0000","last_unstale":"2024-04-23T23:39:45.172817+0000","last_undegraded":"2024-04-23T23:39:45.172817+0000","last_fullsized":"2024-04-23T23:39:45.172817+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:04.497616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"129'439","reported_seq":20380,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-04-23T23:39:41.221271+0000","last_change":"2024-04-23T23:39:33.818539+0000","last_active":"2024-04-23T23:39:41.221271+0000","last_peered":"2024-04-23T23:39:41.221271+0000","last_clean":"2024-04-23T23:39:41.221271+0000","last_became_active":"2024-04-23T23:39:33.817044+0000","last_became_peered":"2024-04-23T23:39:33.817044+0000","last_unstale":"2024-04-23T23:39:41.221271+0000","last_undegraded":"2024-04-23T23:39:41.221271+0000","last_fullsized":"2024-04-23T23:39:41.221271+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:19:34.413085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079701399999999997,"stat_sum":{"num_bytes":74768084,"num_objects":96,"num_object_clones":13,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":96,"num_whiteouts":52,"num_read":19729,"num_read_kb":41903,"num_write":523,"num_write_kb":24485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"132'439","reported_seq":5265,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.170029+0000","last_change":"2024-04-23T23:39:45.170543+0000","last_active":"2024-04-23T23:39:45.170029+0000","last_peered":"2024-04-23T23:39:45.170029+0000","last_clean":"2024-04-23T23:39:45.170029+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:39:45.170029+0000","last_undegraded":"2024-04-23T23:39:45.170029+0000","last_fullsized":"2024-04-23T23:39:45.170029+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:29.806300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018251840000000001,"stat_sum":{"num_bytes":73658175,"num_objects":98,"num_object_clones":16,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":53,"num_read":5229,"num_read_kb":29295,"num_write":377,"num_write_kb":29604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.a","version":"133'829","reported_seq":13165,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.169516+0000","last_change":"2024-04-23T23:39:45.169516+0000","last_active":"2024-04-23T23:39:45.169516+0000","last_peered":"2024-04-23T23:39:45.169516+0000","last_clean":"2024-04-23T23:39:45.169516+0000","last_became_active":"2024-04-23T23:39:05.815581+0000","last_became_peered":"2024-04-23T23:39:05.815581+0000","last_unstale":"2024-04-23T23:39:45.169516+0000","last_undegraded":"2024-04-23T23:39:45.169516+0000","last_fullsized":"2024-04-23T23:39:45.169516+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:41:47.401500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099846700000000006,"stat_sum":{"num_bytes":56430407,"num_objects":93,"num_object_clones":12,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":37,"num_read":15396,"num_read_kb":42916,"num_write":1013,"num_write_kb":20570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.b","version":"132'488","reported_seq":14207,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.170594+0000","last_change":"2024-04-23T23:39:45.171732+0000","last_active":"2024-04-23T23:39:45.170594+0000","last_peered":"2024-04-23T23:39:45.170594+0000","last_clean":"2024-04-23T23:39:45.170594+0000","last_became_active":"2024-04-23T23:39:04.819875+0000","last_became_peered":"2024-04-23T23:39:04.819875+0000","last_unstale":"2024-04-23T23:39:45.170594+0000","last_undegraded":"2024-04-23T23:39:45.170594+0000","last_fullsized":"2024-04-23T23:39:45.170594+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:02.900480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028130500000000001,"stat_sum":{"num_bytes":97763049,"num_objects":114,"num_object_clones":22,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":114,"num_whiteouts":52,"num_read":13942,"num_read_kb":53622,"num_write":473,"num_write_kb":22116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":11368218,"num_keys_recovered":44,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.c","version":"127'365","reported_seq":16910,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157231+0000","last_change":"2024-04-23T23:38:19.814484+0000","last_active":"2024-04-23T23:39:42.157231+0000","last_peered":"2024-04-23T23:39:42.157231+0000","last_clean":"2024-04-23T23:39:42.157231+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:39:42.157231+0000","last_undegraded":"2024-04-23T23:39:42.157231+0000","last_fullsized":"2024-04-23T23:39:42.157231+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:52:49.987641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001080988,"stat_sum":{"num_bytes":101005752,"num_objects":106,"num_object_clones":17,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":106,"num_whiteouts":52,"num_read":16654,"num_read_kb":58264,"num_write":346,"num_write_kb":15339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"127'444","reported_seq":14557,"reported_epoch":130,"state":"active+clean","last_fresh":"2024-04-23T23:39:42.157392+0000","last_change":"2024-04-23T23:39:33.823532+0000","last_active":"2024-04-23T23:39:42.157392+0000","last_peered":"2024-04-23T23:39:42.157392+0000","last_clean":"2024-04-23T23:39:42.157392+0000","last_became_active":"2024-04-23T23:39:33.820772+0000","last_became_peered":"2024-04-23T23:39:33.820772+0000","last_unstale":"2024-04-23T23:39:42.157392+0000","last_undegraded":"2024-04-23T23:39:42.157392+0000","last_fullsized":"2024-04-23T23:39:42.157392+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:10:07.759366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090758899999999999,"stat_sum":{"num_bytes":42903962,"num_objects":110,"num_object_clones":19,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":56,"num_read":14964,"num_read_kb":41057,"num_write":395,"num_write_kb":9057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"133'714","reported_seq":4863,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.176070+0000","last_change":"2024-04-23T23:39:45.176230+0000","last_active":"2024-04-23T23:39:45.176070+0000","last_peered":"2024-04-23T23:39:45.176070+0000","last_clean":"2024-04-23T23:39:45.176070+0000","last_became_active":"2024-04-23T23:39:34.818894+0000","last_became_peered":"2024-04-23T23:39:34.818894+0000","last_unstale":"2024-04-23T23:39:45.176070+0000","last_undegraded":"2024-04-23T23:39:45.176070+0000","last_fullsized":"2024-04-23T23:39:45.176070+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:40:49.045800+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.002837333,"stat_sum":{"num_bytes":75062576,"num_objects":87,"num_object_clones":12,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":46,"num_read":6951,"num_read_kb":28780,"num_write":842,"num_write_kb":10360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":325,"num_bytes_recovered":11606439,"num_keys_recovered":93,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.f","version":"132'607","reported_seq":11373,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.173116+0000","last_change":"2024-04-23T23:39:45.173296+0000","last_active":"2024-04-23T23:39:45.173116+0000","last_peered":"2024-04-23T23:39:45.173116+0000","last_clean":"2024-04-23T23:39:45.173116+0000","last_became_active":"2024-04-23T23:39:35.820757+0000","last_became_peered":"2024-04-23T23:39:35.820757+0000","last_unstale":"2024-04-23T23:39:45.173116+0000","last_undegraded":"2024-04-23T23:39:45.173116+0000","last_fullsized":"2024-04-23T23:39:45.173116+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":607,"log_dups_size":0,"ondisk_log_size":607,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:57:29.238196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00034093300000000002,"stat_sum":{"num_bytes":91839005,"num_objects":99,"num_object_clones":17,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":99,"num_whiteouts":54,"num_read":11961,"num_read_kb":50893,"num_write":670,"num_write_kb":21007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.10","version":"132'488","reported_seq":26154,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.172150+0000","last_change":"2024-04-23T23:39:45.172715+0000","last_active":"2024-04-23T23:39:45.172150+0000","last_peered":"2024-04-23T23:39:45.172150+0000","last_clean":"2024-04-23T23:39:45.172150+0000","last_became_active":"2024-04-23T23:38:44.813024+0000","last_became_peered":"2024-04-23T23:38:44.813024+0000","last_unstale":"2024-04-23T23:39:45.172150+0000","last_undegraded":"2024-04-23T23:39:45.172150+0000","last_fullsized":"2024-04-23T23:39:45.172150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":488,"log_dups_size":0,"ondisk_log_size":488,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:15:20.016668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072764399999999995,"stat_sum":{"num_bytes":89589755,"num_objects":111,"num_object_clones":20,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":52,"num_read":26176,"num_read_kb":41184,"num_write":569,"num_write_kb":40494,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":87,"num_bytes_recovered":6225512,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.11","version":"132'426","reported_seq":7898,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.169505+0000","last_change":"2024-04-23T23:39:45.170052+0000","last_active":"2024-04-23T23:39:45.169505+0000","last_peered":"2024-04-23T23:39:45.169505+0000","last_clean":"2024-04-23T23:39:45.169505+0000","last_became_active":"2024-04-23T23:39:33.118919+0000","last_became_peered":"2024-04-23T23:39:33.118919+0000","last_unstale":"2024-04-23T23:39:45.169505+0000","last_undegraded":"2024-04-23T23:39:45.169505+0000","last_fullsized":"2024-04-23T23:39:45.169505+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:05:36.455421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014782230000000001,"stat_sum":{"num_bytes":89950650,"num_objects":97,"num_object_clones":16,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":47,"num_read":7158,"num_read_kb":67514,"num_write":375,"num_write_kb":19044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.12","version":"133'684","reported_seq":6936,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.178340+0000","last_change":"2024-04-23T23:39:45.178340+0000","last_active":"2024-04-23T23:39:45.178340+0000","last_peered":"2024-04-23T23:39:45.178340+0000","last_clean":"2024-04-23T23:39:45.178340+0000","last_became_active":"2024-04-23T23:39:35.818870+0000","last_became_peered":"2024-04-23T23:39:35.818870+0000","last_unstale":"2024-04-23T23:39:45.178340+0000","last_undegraded":"2024-04-23T23:39:45.178340+0000","last_fullsized":"2024-04-23T23:39:45.178340+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:36:50.695544+0000","scrub_duration":0,"objects_trimmed":3,"snaptrim_duration":0.0046142229999999998,"stat_sum":{"num_bytes":30328480,"num_objects":86,"num_object_clones":7,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":45,"num_read":9205,"num_read_kb":42804,"num_write":923,"num_write_kb":24003,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":318,"num_bytes_recovered":28978899,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3a","length":"1"}]},{"pgid":"3.13","version":"133'354","reported_seq":4666,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-04-23T23:39:45.178544+0000","last_change":"2024-04-23T23:39:45.178544+0000","last_active":"2024-04-23T23:39:45.178544+0000","last_peered":"2024-04-23T23:39:45.178544+0000","last_clean":"2024-04-23T23:39:45.178544+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:39:45.178544+0000","last_undegraded":"2024-04-23T23:39:45.178544+0000","last_fullsized":"2024-04-23T23:39:45.178544+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:18:26.035653+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0045526919999999997,"stat_sum":{"num_bytes":54576524,"num_objects":72,"num_object_clones":7,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":38,"num_read":4741,"num_read_kb":30114,"num_write":333,"num_write_kb":10323,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"3a","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2156141804,"num_objects":3002,"num_object_clones":425,"num_object_copies":6004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3002,"num_whiteouts":1537,"num_read":338593,"num_read_kb":1222453,"num_write":20891,"num_write_kb":686506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7561,"num_bytes_recovered":451846947,"num_keys_recovered":1110,"num_objects_omap":58,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":656699392,"data_stored":858029803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":17669,"ondisk_log_size":17669,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":163764,"kb_used_data":110328,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94208076,"statfs":{"total":96636764160,"available":96469069824,"internally_reserved":0,"allocated":112975872,"data_stored":143490689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,56],"upper_bound":2048},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":186204,"kb_used_data":132820,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94185636,"statfs":{"total":96636764160,"available":96446091264,"internally_reserved":0,"allocated":136007680,"data_stored":177486002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,7,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":139292,"kb_used_data":81744,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94232548,"statfs":{"total":96636764160,"available":96494129152,"internally_reserved":0,"allocated":83705856,"data_stored":102964552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855383,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157240,"kb_used_data":106836,"kb_used_omap":4,"kb_used_meta":50299,"kb_avail":94214600,"statfs":{"total":96636764160,"available":96475750400,"internally_reserved":0,"allocated":109400064,"data_stored":138695866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":51506798},"hb_peers":[0,1,2,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165496,"kb_used_data":113196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94206344,"statfs":{"total":96636764160,"available":96467296256,"internally_reserved":0,"allocated":115912704,"data_stored":150936926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574882,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":104860,"kb_used_data":77840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94266980,"statfs":{"total":96636764160,"available":96529387520,"internally_reserved":0,"allocated":79708160,"data_stored":105988893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574883,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":14347775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":112005120,"data_stored":143319751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":79458304,"data_stored":106577396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":112267264,"data_stored":147429501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":107864064,"data_stored":140187690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":78761984,"data_stored":97490503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":127574016,"data_stored":167815561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:39:46.899 INFO:tasks.thrashosds.thrasher:Setting 3.e to [2, 6] 2024-04-23T23:39:46.899 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.e', '2', '6'] 2024-04-23T23:39:46.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.e 2 6 2024-04-23T23:39:46.920 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:46.920 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:46.920 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:46.920 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:46.920 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:46.929 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:46.929 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:46.940+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:47.029 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:47.041+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 102.096630093, 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.074 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.075 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.076 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.077 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:47.078 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:47.079 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:47.080 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 47.192875676, 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.081 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:47.082 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:47.083 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.084 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.076625427000003, 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.907323276, 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.089 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.090 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:39:47.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899799427, 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.094 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.095 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:39:47.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:39:47.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899746874, 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.100 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:39:47.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:39:47.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:39:47.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899720072999999, 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.104 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:39:47.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:39:47.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.108 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899696195000001, 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899674353, 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.113 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.117 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899464799, 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:47.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:39:47.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:39:47.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.121 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899415561, 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:47.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:47.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:39:47.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:39:47.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899370556999999, 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:39:47.126 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:39:47.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.899335538999999, 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:47.135 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898994156000001, 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:39:47.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:39:47.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.139 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898959392, 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.140 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898936637, 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:39:47.144 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898664006000001, 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:47.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898631376000001, 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:47.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:39:47.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898426162, 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:39:47.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:47.162 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 13.898343165, 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.167 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:47.168 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:47.169 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:47.180+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:47.169 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:39:47.269 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:47.281+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:47.319 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:47.319 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:47.319 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:47.319 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:47.328 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:47.369 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:47.382+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:47.430 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:47.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:47.430 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:47.430 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:47.430 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:47.439 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:47.482 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:47.494+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:47.543 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175384823999998, 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:39:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175366088000001, 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:39:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:39:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175347708, 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:39:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:39:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175328511, 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175092224, 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:39:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175066063999999, 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175046394999999, 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:39:47.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.175027974999999, 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:39:47.577 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:47.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:39:47.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:39:47.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:39:47.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.174881280000001, 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.582 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:39:47.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.173725851, 2024-04-23T23:39:47.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.590 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.173410139000001, 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:47.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:39:47.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:39:47.594 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.173388108000001, 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.595 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:39:47.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.173367542000001, 2024-04-23T23:39:47.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:39:47.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:39:47.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.173346718000001, 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.604 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 28.170898353999998, 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.608 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:47.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:47.612 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.674884579, 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:39:47.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:39:47.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.674868351000001, 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:39:47.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.67485211, 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.622 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:39:47.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:39:47.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.674836867, 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:39:47.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.674820782000001, 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.631 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:47.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:47.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:47.635 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:47.637 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:47.637 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:47.649+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:47.737 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:47.749+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:47.779 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:47.780 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:47.780 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:47.780 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:47.788 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:47.872 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:47.884+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:47.931 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:47.931 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:47.931 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:47.931 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:47.931 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:47.940 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:47.940 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:47.951+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:48.041 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:48.052+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282606616000001, 2024-04-23T23:39:48.084 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.085 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.086 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:39:48.087 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.088 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.089 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282576116, 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.090 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:39:48.091 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:39:48.092 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:39:48.093 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.094 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282537239, 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:39:48.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:39:48.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282506589, 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:39:48.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:48.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.104 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282482227999999, 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.105 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.106 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:39:48.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:39:48.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.109 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282460651999999, 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:39:48.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.114 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282440806, 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:48.119 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282410764, 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:48.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:39:48.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:39:48.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:48.124 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282382911999999, 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:39:48.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:39:48.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:39:48.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282359721000001, 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:39:48.129 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282253513000001, 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:39:48.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:39:48.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282219495, 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:39:48.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:39:48.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282192876, 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.144 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282172157, 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:39:48.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:39:48.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:39:48.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:48.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282149188, 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:48.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:48.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:39:48.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:39:48.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.28213017, 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.158 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282111990000001, 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:39:48.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.282091362999999, 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:39:48.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:48.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.173 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.281719241999999, 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:39:48.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:39:48.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.281663923, 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:39:48.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:39:48.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.183 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:48.184 INFO:teuthology.orchestra.run.smithi077.stderr:set 3.e pg_upmap mapping to [2,6] 2024-04-23T23:39:48.185 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:39:48.186 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:48.186 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:48.196+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:48.286 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:48.298+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:48.332 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:48.332 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:48.332 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:48.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:48.425 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:48.437+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:48.483 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:48.483 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:48.483 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:48.483 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:48.484 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:48.488 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:48.499+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:48.492 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:48.589 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:48.601+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 39.830778240999997, 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:39:48.638 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:48.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820816828, 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.643 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:48.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:39:48.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:39:48.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820799452999999, 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:39:48.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:39:48.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820782009, 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.653 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820646226000001, 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:39:48.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:39:48.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:39:48.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820627347, 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.663 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:39:48.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:39:48.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820609972, 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:39:48.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820438326, 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820421463000001, 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:39:48.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:48.683 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.820404364, 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:39:48.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:39:48.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.81976396, 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.689 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.81969602, 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:48.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.819511997999999, 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.819156188999999, 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.704 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.708 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.819087736, 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:48.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:39:48.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:39:48.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.819012699, 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.713 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:39:48.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:48.719 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.818927318, 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:48.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:39:48.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.81866314, 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.725 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:39:48.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:48.730 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.818593181000001, 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:48.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:39:48.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:39:48.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 14.818525318000001, 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:48.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:48.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:39:48.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:48.740 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:48.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:48.743 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:48.754+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:48.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:48.843 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:48.855+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:48.858 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:48.858 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:48.858 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:48.858 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:48.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:48.944 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:48.956+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:48.955 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:48.955 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:48.973 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:48.973 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:48.990 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:48.990 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:48.991 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:49.008 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:49.008 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:49.014 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.014 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:49.026 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:49.026 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:49.044 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:49.045 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:49.045 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:49.057+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:49.062 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:49.062 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:49.065 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:49.065 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:49.126 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.126 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:49.146 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:49.157+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:49.240 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.240 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.246 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:49.259+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:49.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:49.347 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:49.359+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:49.351 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.351 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:49.447 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:49.460+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:49.502 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.503 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:49.549 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:49.560+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:49.650 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:49.662+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:49.654 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.654 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:49.750 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:49.763+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:49.807 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.807 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:49.851 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:49.863+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:49.952 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:49.965+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:49.966 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:49.967 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:49.977 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:50.053 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:50.065+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:50.093 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.093 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.102 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:50.154 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:50.166+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:50.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:39:50.246 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.246 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.254 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:50.266+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:50.255 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:50.354 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:50.366+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:50.357 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.357 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.366 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:50.455 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:50.467+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:50.508 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.508 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.517 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:50.556 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:50.568+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:50.657 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:50.668+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:50.660 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.660 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:50.757 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:50.770+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:50.810 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:39:50.817 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.817 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.827 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:50.864 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:50.877+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:50.935 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:50.936 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:50.944 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:50.988 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:51.000+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:51.047 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:51.048 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:51.056 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:51.060 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:51.072+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:51.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:51.161 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:51.172+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:51.186 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:51.186 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:51.198 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:51.198 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:51.203 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:51.203 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:51.207 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:51.219 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:51.219 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:51.219 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:51.237 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:51.254 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:51.255 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:51.262 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:51.274+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:51.271 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:51.271 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:51.288 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:51.289 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:51.292 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:51.292 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:51.350 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:51.350 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:51.351 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:51.351 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:51.359 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:51.362 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:51.374+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:51.462 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:51.462 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:51.463 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:51.463 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:51.463 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:51.463 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:51.474+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:51.471 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:51.564 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:51.575+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:51.616 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:51.616 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:51.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:51.616 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:51.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 42.808796628000003, 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.617 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.621 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798835215, 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:39:51.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:39:51.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:39:51.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:39:51.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798817840000002, 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.627 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:39:51.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798800396000001, 2024-04-23T23:39:51.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:39:51.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:39:51.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:51.637 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798664613, 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:51.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.642 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798645734000001, 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.643 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:39:51.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:39:51.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798628358999999, 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:39:51.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:39:51.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798456713, 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798439850000001, 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.658 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:51.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:39:51.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:39:51.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.798422751, 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:51.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:39:51.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.797782346999998, 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:39:51.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:39:51.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.797714407000001, 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:39:51.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.797530385000002, 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:39:51.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.797174576, 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.683 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:39:51.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:51.688 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.797106122999999, 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:51.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:39:51.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.693 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.797031086, 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:51.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.796945704999999, 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:39:51.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.796681527000001, 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.704 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:39:51.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:39:51.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:39:51.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.796611567999999, 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:51.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:51.713 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 17.796543705000001, 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:51.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:39:51.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:51.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:51.718 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:51.720 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:51.732+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:51.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:51.821 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:51.832+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:51.827 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:51.827 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:51.827 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:51.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:51.922 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:51.934+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:51.938 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:51.938 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:51.938 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:51.938 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:51.938 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:51.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:52.023 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:52.035+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:52.051 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:52.051 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:52.051 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:52.051 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:52.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.95369392800001, 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:39:52.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.056 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.95368028300001, 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.057 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:39:52.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:39:52.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.953667233, 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:39:52.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.95365621400001, 2024-04-23T23:39:52.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:39:52.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:39:52.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:39:52.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.953647139, 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.071 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:39:52.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:52.075 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.953635195, 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:52.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.079 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.95362608400001, 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.080 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:39:52.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:52.084 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.95198071199999, 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:52.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:39:52.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.95196846300001, 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.089 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.093 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94778987000001, 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94777808800001, 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.098 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:52.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:39:52.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94776801899999, 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:39:52.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94775636, 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:39:52.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:39:52.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.109 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94774704, 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:39:52.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:39:52.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.113 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94773652800001, 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:39:52.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:39:52.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:39:52.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94772708799999, 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.121 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.94753199499999, 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.947510962, 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.126 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 130.947497072, 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.130 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:39:52.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 119.344340567, 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.134 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:39:52.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:39:52.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:52.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.139 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.139 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.139 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:52.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:52.141 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:52.152+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:52.241 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:52.253+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:52.245 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:52.245 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:52.245 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:52.245 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:52.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:52.342 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:52.354+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:52.397 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:52.397 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:52.397 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:52.397 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:52.397 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:52.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:52.443 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:52.455+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 93.689819850999996, 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:52.511 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:39:52.512 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.513 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.514 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:52.515 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:39:52.516 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 51.627960078999998, 2024-04-23T23:39:52.517 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.518 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.519 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.520 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.521 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.522 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 47.655130560000003, 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.523 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:39:52.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.525 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:39:52.526 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.527 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.07893374, 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:39:52.528 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:39:52.529 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:39:52.530 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:39:52.531 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078911668, 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.532 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:39:52.533 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:39:52.534 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:39:52.535 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:39:52.536 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078885912000001, 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.537 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.538 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.539 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.540 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.541 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078866408, 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:39:52.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:39:52.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:39:52.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.545 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.546 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078263339999999, 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.547 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:39:52.548 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:39:52.549 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.550 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078239918, 2024-04-23T23:39:52.551 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.552 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.553 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.554 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:39:52.555 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.556 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078210567999999, 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:39:52.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:39:52.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.560 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078182551999999, 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.561 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.562 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.563 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.564 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.565 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078155689999999, 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.567 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.568 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.569 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.570 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078133191999999, 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.571 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:39:52.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.573 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.574 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.575 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078112732999999, 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:39:52.576 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:39:52.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:39:52.578 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:39:52.579 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078083127999999, 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:39:52.580 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.581 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.582 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.583 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078064276999999, 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.585 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.586 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.587 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.588 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.589 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078053406, 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.590 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:52.591 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.592 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.593 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.594 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.078029859000001, 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.595 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.596 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.597 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.599 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.077987449, 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:39:52.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:39:52.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:39:52.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:39:52.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.077969789999999, 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:52.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:39:52.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:52.609 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:52.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:52.611 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:52.623+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:52.711 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:52.724+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:52.755 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:52.755 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:52.755 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:52.755 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:52.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:52.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:39:52.849 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:52.861+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:52.914 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:52.927+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:52.918 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:52.918 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:52.919 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:52.919 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:52.919 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:52.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:53.015 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:53.027+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:53.077 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 124.679549968, 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.079 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:53.081 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 115.67985411399999, 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:53.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:53.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.086 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 74.531993458000002, 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.087 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:53.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:53.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:53.091 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 74.513425226999999, 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:53.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:53.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:53.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.836926657999999, 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:39:53.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:39:53.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:39:53.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 24.832301009999998, 2024-04-23T23:39:53.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:39:53.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:39:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:53.105 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 14.863076349, 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:53.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.111 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890259458999999, 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:53.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.114 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.115 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890231575, 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:39:53.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:53.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890212406, 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.120 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:53.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890194192999999, 2024-04-23T23:39:53.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890165471, 2024-04-23T23:39:53.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:39:53.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:39:53.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.132 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890145805, 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890127266, 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.137 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:39:53.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:39:53.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890097245, 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:39:53.141 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:39:53.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:39:53.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890077177, 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.146 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:39:53.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890058978000001, 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.150 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:53.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.154 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890041289999999, 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:39:53.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890023387999999, 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:39:53.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 13.890005355, 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:39:53.163 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:53.167 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:53.169 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:53.169 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:53.181+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:53.188 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7] out_osds: [3, 0] dead_osds: [3] live_osds: [0, 1, 2, 4, 6, 7, 5] 2024-04-23T23:39:53.188 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:39:53.188 INFO:tasks.thrashosds.thrasher:Reviving osd 3 2024-04-23T23:39:53.188 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T23:39:53.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T23:39:53.211 INFO:tasks.ceph.osd.3:Started 2024-04-23T23:39:53.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:39:53.269 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:53.281+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:53.275 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:53.276 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:53.276 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:53.276 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:53.284 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:53.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:39:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:39:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:39:53.308 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:config diff 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:config diff get 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:config get 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:config help [] 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:config set ... 2024-04-23T23:39:53.309 INFO:teuthology.orchestra.run.smithi077.stderr:admin_socket: invalid command 2024-04-23T23:39:53.311 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:39:53.311 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-3, ['dump_ops_in_flight'] 2024-04-23T23:39:53.370 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:53.382+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:53.386 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:53.387 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:53.387 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:53.387 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:53.387 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:53.396 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:53.410 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:53.410 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:53.427 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:53.427 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:53.443 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:53.444 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:53.444 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:53.461 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:53.479 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:53.479 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:53.480 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:53.492+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:53.496 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:53.496 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:53.513 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:53.513 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:53.516 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:53.517 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:53.541 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:53.541 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:53.550 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:53.591 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:53.603+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:53.673 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:53.685+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:53.693 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:53.693 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:53.702 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:53.786 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:53.798+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:53.795 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:39:53.807+0000 7f30f161f640 -1 Falling back to public interface 2024-04-23T23:39:53.805 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:39:53.853 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:53.854 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:53.863 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:53.904 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:53.916+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:53.976 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:53.988+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:54.010 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.010 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.019 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:54.103 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:54.115+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:54.163 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.163 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.171 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:54.213 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:54.225+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:54.279 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:54.291+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:54.314 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.315 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:54.380 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:54.392+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:54.426 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.426 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.435 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:54.481 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:54.493+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:54.579 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.579 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.581 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:54.594+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:54.588 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:54.683 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:54.695+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:54.690 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.691 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.699 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:54.783 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:54.796+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:54.801 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.801 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:54.884 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:54.896+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:54.929 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:54.929 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:54.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:54.986 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:54.998+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:55.043 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:55.043 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:55.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:55.087 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:55.099+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:55.188 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:55.200+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:55.194 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:55.194 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:55.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:55.289 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:55.302+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:55.305 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:55.305 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:55.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:55.398 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:55.411+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:55.457 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:55.457 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:55.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:55.491 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:55.503+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:55.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:39:55.593 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:55.605+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:55.610 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:55.610 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:55.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:55.668 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:55.668 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:55.687 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:55.687 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:55.692 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:55.705+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:55.704 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:55.704 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:55.722 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:55.740 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:55.758 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:55.758 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:55.767 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:55.767 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:55.767 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:55.767 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:55.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:55.777 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:55.777 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:55.779 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:55.780 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:55.793 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:55.806+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:55.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:39:55.905 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:55.918+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:55.931 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:55.931 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:55.931 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:39:55.931 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:39:55.931 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:55.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:55.995 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:56.007+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:56.087 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:56.087 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:39:56.087 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:39:56.087 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:39:56.087 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.087 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 127.689782556, 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.088 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.089 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:39:56.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:39:56.091 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 118.690086702, 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.092 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:39:56.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.094 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.095 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:39:56.096 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 77.542226045999996, 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:39:56.097 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:39:56.098 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.099 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.100 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 77.523657815000007, 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.102 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.103 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:39:56.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.847159246, 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:39:56.105 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.106 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.107 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:56.109 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.842533597999999, 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:39:56.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:39:56.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:39:56.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 17.873308937000001, 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:39:56.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:39:56.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:39:56.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:39:56.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900492047, 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.123 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900464162999999, 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.124 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:39:56.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:39:56.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900444994000001, 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:39:56.128 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:39:56.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:39:56.132 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900426781, 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.133 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:39:56.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:39:56.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900398059, 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.141 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900378393, 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.142 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:39:56.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:39:56.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:39:56.145 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900359854000001, 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.146 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900329833000001, 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900309764999999, 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:39:56.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:39:56.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:56.159 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900291566, 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:56.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:39:56.163 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900273878, 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.164 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:39:56.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:39:56.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900255976, 2024-04-23T23:39:56.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:39:56.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:39:56.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 16.900237943, 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:39:56.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:39:56.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:39:56.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:39:56.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.177 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:39:56.177 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:39:56.177 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:56.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:56.179 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:56.190+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:56.279 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:56.291+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:56.283 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:56.283 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:56.283 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:56.283 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:56.291 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:56.380 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:56.392+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:56.433 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:56.433 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:56.433 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:56.441 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:56.481 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:56.493+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:56.544 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:56.544 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 111.56722410499999, 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:39:56.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:39:56.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:39:56.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 56.663469687999999, 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.551 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.555 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 46.547219439000003, 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.556 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:39:56.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.560 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.377917287999999, 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.561 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:39:56.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:39:56.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:39:56.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370393439000001, 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.565 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:39:56.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.569 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370340886000001, 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:39:56.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370314085, 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.574 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.578 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370290207, 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:39:56.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:39:56.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370268365000001, 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:39:56.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370058811, 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:39:56.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:39:56.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.370009573000001, 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:39:56.592 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:39:56.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:39:56.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:39:56.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369964569, 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.597 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:39:56.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:39:56.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369929550999998, 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369588168, 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.606 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:39:56.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369553404000001, 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.611 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:39:56.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:56.615 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369530649000001, 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:39:56.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369258018, 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.624 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369225388, 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.369020173999999, 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.629 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:39:56.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:39:56.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:39:56.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.633 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.368937176999999, 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:56.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:39:56.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:39:56.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:39:56.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.638 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:56.638 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:56.638 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:56.639 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:56.640 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:56.652+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:56.740 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:56.752+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:56.784 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:56.784 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:56.784 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:56.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:56.831 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:39:56.840 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:56.853+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:56.942 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:56.954+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:56.953 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:56.953 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:56.953 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:56.953 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:56.953 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:56.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:57.043 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:57.056+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740563641999998, 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.108 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:39:57.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:39:57.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.112 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740544905999997, 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:57.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:39:57.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.116 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740526525999996, 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:39:57.120 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740507329000003, 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:39:57.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:39:57.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:39:57.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:39:57.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740271042000003, 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.125 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740244881999999, 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.129 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:39:57.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:39:57.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:39:57.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740225213000002, 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.133 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:57.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:39:57.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740206792999999, 2024-04-23T23:39:57.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:39:57.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.141 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.740060098000001, 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.738904669, 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.146 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:39:57.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:39:57.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:39:57.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.738588956999997, 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.150 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:39:57.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:39:57.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.738566925999997, 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:39:57.154 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:39:57.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.738546360000001, 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:39:57.158 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.738525535999997, 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.736077172000002, 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.167 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:39:57.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:39:57.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.240063397, 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:39:57.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.240047169, 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:39:57.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.179 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.240030928000003, 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.183 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.240015685000003, 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:39:57.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:39:57.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.239999599999997, 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.188 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:39:57.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:39:57.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.192 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:57.194 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:39:57.194 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:57.206+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:57.281 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:39:57.293+0000 7f30f161f640 -1 osd.3 82 log_to_monitors true 2024-04-23T23:39:57.294 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:57.306+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:57.337 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:57.337 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:57.337 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:57.337 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:57.346 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:39:57.396 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:57.408+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:57.488 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:57.488 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:57.488 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:57.489 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:57.489 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:57.497 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:39:57.498 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:57.510+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:57.597 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:57.610+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:57.641 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:57.641 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:39:57.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839998144999999, 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.642 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:57.647 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839967645000002, 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:39:57.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.652 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839928768, 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:39:57.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:39:57.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.657 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839898118000001, 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.658 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.662 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839873756999999, 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:39:57.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:57.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:39:57.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:39:57.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839852181000001, 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:39:57.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:39:57.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839832335000001, 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:39:57.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:39:57.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:39:57.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839802292999998, 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:39:57.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:39:57.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:39:57.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839774440999999, 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.683 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:39:57.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839751249999999, 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.688 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:57.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839645042000001, 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.693 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:39:57.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:57.698 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839611024, 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:39:57.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:39:57.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839584405, 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:39:57.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:39:57.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839563685999998, 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:39:57.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:39:57.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839540716999998, 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.716 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:39:57.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:39:57.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839521698999999, 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:39:57.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:39:57.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:39:57.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839503519000001, 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:39:57.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.730 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839482891999999, 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.731 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:39:57.735 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839110771000001, 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.736 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.740 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 23.839055452, 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:39:57.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:39:57.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:39:57.743 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:39:57.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.745 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.746 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:39:57.746 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:39:57.746 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:57.747 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:39:57.748 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:57.759+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:57.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:39:57.848 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:57.860+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:57.857 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:57.857 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:57.857 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:39:57.857 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:57.866 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:39:57.874 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:39:57.886+0000 7f30e4e73640 -1 osd.3 146 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T23:39:57.915 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:39:57.915 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:39:57.934 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:39:57.934 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:39:57.948 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:57.961+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:57.953 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:39:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:39:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:Error ENXIO: problem getting command descriptions from osd.3 2024-04-23T23:39:57.971 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:39:57.972 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:39:57.985 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:39:57.985 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:39:57.985 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:39:57.985 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:39:57.985 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:39:57.989 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:39:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:39:57.995 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:39:58.007 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:39:58.007 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:39:58.024 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:39:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:39:58.028 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-23T23:39:58.028 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-23T23:39:58.079 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:58.092+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:58.138 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.138 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:39:58.188 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:58.201+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:58.250 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:58.263+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:58.251 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.251 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:39:58.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:39:58.355 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:58.368+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:58.363 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.364 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:39:58.415 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:39:58.416 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:39:58.416 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:39:58.416 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:39:58.453 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:58.465+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:58.514 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.514 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:39:58.567 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:39:58.579+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:39:58.626 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.626 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:39:58.676 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:58.688+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:58.756 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:39:58.769+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:39:58.777 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.777 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:39:58.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:39:58.895 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:58.907+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:58.901 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:58.901 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:58.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:39:58.959 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:58.972+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:59.058 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.058 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.060 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:39:59.072+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:39:59.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:39:59.160 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:59.173+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:59.170 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.170 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:39:59.261 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:39:59.274+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:39:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.281 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.290 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:39:59.362 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:59.375+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:59.393 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.393 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.402 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:39:59.463 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:39:59.476+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:39:59.504 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.504 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.512 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:39:59.564 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:39:59.577+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:39:59.615 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.615 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.624 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:39:59.665 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:39:59.678+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:39:59.766 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:39:59.778+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:39:59.766 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.767 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.775 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:39:59.847 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:39:59.866 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:39:59.879+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:39:59.884 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:39:59.884 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:39:59.894 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:39:59.966 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:39:59.979+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:00.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:00.038 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:00.038 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:00.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:00.090 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:00.103+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:00.151 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:00.151 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:00.152 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:00.152 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:00.160 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:00.169 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:00.170 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:00.170 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:00.182+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:00.185 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:00.185 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:00.202 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:00.202 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_enable_op_tracker = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' 2024-04-23T23:40:00.219 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:00.219 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:00.236 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:00.236 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:00.252 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:00.253 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:00.270 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:00.270 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:00.270 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:00.283+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:00.305 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:00.305 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:00.305 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:00.305 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:00.305 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:00.314 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:00.398 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:00.411+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:00.457 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:00.457 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:00.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:00.457 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.656098412999999, 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:00.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:00.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:00.461 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:00.462 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.656067913000001, 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:00.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.656029036, 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.469 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:00.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:00.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:00.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655998386, 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.478 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655974024999999, 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:00.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:00.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:00.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655952449000001, 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:00.483 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655932603, 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.488 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:00.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655902561000001, 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:00.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:00.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655874708999999, 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.502 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655851517999999, 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.503 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:00.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:00.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.65574531, 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.508 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:00.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:00.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:00.512 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655711291999999, 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:00.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:00.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:00.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655684673, 2024-04-23T23:40:00.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:00.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.521 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655663954000001, 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:00.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:00.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655640985000002, 2024-04-23T23:40:00.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:00.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:00.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.530 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655621966999998, 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.531 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:00.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655603787, 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.535 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:00.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:00.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:00.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.539 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655583159999999, 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:00.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:00.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:00.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:00.544 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.655211039000001, 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:00.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:00.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 26.65515572, 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.549 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.550 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:00.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.553 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:00.555 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:00.555 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:00.567+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:00.656 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:00.668+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:00.698 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:00.698 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:00.698 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:00.698 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:00.706 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:00.757 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:00.769+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:00.809 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:00.809 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:00.809 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:00.809 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:00.809 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:00.818 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:00.857 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:00.869+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:00.937 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:00.937 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:00.937 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:00.937 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:00.937 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 52.129927279999997, 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.938 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.939 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.940 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:00.941 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:00.942 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.943 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119965867000001, 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.944 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:00.945 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.946 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.947 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:00.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.949 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119948491999999, 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.950 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:00.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.953 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.954 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:00.955 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119931048000002, 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.956 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.957 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.958 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:00.959 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.960 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:00.961 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119795265, 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.962 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.963 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.964 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.965 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:00.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119776386000002, 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:00.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.973 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119759010999999, 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:00.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:00.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119587365000001, 2024-04-23T23:40:00.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:00.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119570501999998, 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.985 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:00.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.990 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.119553403000001, 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.991 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:00.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:00.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.996 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118912998999999, 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:00.997 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:00.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:00.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:01.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118845059000002, 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.003 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:01.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.008 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118661036999999, 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:01.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:01.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:01.014 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118305228000001, 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:01.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:01.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:01.020 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118236775, 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.021 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:01.025 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118161738000001, 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.030 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.118076357, 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.031 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:01.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:01.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.117812179000001, 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.11774222, 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:01.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:01.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 27.117674356999999, 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:01.046 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:01.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:01.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:01.051 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:01.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:01.053 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:01.065+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:01.153 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:01.166+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:01.157 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:01.157 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:01.157 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:01.157 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:01.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:01.255 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:01.267+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:01.267 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:01.267 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:01.267 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:01.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:01.355 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:01.368+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:01.378 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:01.378 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:01.378 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:01.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:01.470 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:01.483+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:01.530 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:01.530 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:01.530 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:01.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:01.557 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:01.569+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:01.658 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:01.671+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:01.683 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:01.683 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:01.683 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:01.683 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:01.683 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:01.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:01.759 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:01.772+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:01.794 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:01.794 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:01.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:01.794 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:01.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.794 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69661526300001, 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:01.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:40:01.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.798 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69660161799999, 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:01.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.802 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69658856800001, 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.803 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.806 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69657754900001, 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.807 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.696568474, 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.811 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.812 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69655653000001, 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.815 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:40:01.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:40:01.818 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69654741900001, 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:40:01.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:40:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:40:01.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:40:01.822 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.694902047, 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:40:01.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:40:01.824 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:40:01.825 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:40:01.826 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69488979799999, 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:40:01.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.829 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.830 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69071120500001, 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.831 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.832 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:40:01.833 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69069942300001, 2024-04-23T23:40:01.834 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.835 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:40:01.836 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.837 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.690689354, 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.838 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:01.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:40:01.840 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.841 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69067769500001, 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:01.842 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.844 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.690668375, 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.845 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.846 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.847 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69065786300001, 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.850 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:40:01.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.852 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.690648423, 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:01.853 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.854 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.855 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69045333, 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:40:01.856 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:01.857 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:01.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.859 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.690432297, 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.860 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.861 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.862 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:01.863 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 140.69041840700001, 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.865 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:40:01.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 129.08726190199999, 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:01.867 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:01.868 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:40:01.869 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:01.870 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:01.871 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:01.872 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:01.872 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:40:01.873 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:01.886+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:01.874 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:01.974 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:01.987+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:02.066 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:02.067 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:02.067 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:02.067 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:02.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:02.112 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:02.124+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:02.169 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:02.170 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:02.170 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:02.170 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:02.170 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:02.177 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:02.190+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:02.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:02.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-04-23T23:40:02.232+0000 7f0a65028640 0 --2- 172.21.15.77:0/3078111535 >> v2:172.21.15.77:3300/0 conn(0x7f0a600b29d0 0x7f0a60072be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-04-23T23:40:02.277 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:02.289+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:02.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:02.329 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:02.329 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:02.329 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:02.329 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:02.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 103.507559981, 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.330 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.331 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:40:02.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:40:02.335 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.336 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:40:02.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.339 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 61.445700209000002, 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:40:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.341 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.342 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.343 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:40:02.344 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:40:02.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.347 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 57.472870690000001, 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:40:02.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.351 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:40:02.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.896673870000001, 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.354 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.355 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.356 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.358 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.359 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.896651798000001, 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.360 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.361 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.363 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.364 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.896626042000001, 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.366 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:02.367 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:40:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:40:02.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.896606538, 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.372 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:40:02.374 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.375 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.376 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.377 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.89600347, 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:40:02.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.379 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:40:02.380 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:40:02.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.383 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895980047999998, 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.384 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:40:02.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:02.389 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895950698, 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:02.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:40:02.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895922681999998, 2024-04-23T23:40:02.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:02.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:02.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.89589582, 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.401 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895873322, 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.407 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:40:02.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.414 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895852863000002, 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:40:02.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895823258, 2024-04-23T23:40:02.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:40:02.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:40:02.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895804407, 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:40:02.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:40:02.431 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895793535999999, 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.432 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:02.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895769989000001, 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:40:02.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:40:02.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895727578999999, 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.443 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:40:02.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:40:02.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.895709920000002, 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:40:02.449 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:02.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:02.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:40:02.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:02.455 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:02.457 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:02.458 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:02.458 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:02.458 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:02.459 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:02.459 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:02.459 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:02.460 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:02.460 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:02.469+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:02.473 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:02.473 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:02.491 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:02.491 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:02.509 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:02.509 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:02.526 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:02.527 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:02.557 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:02.570+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:02.577 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:02.577 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:02.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:02.658 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:02.671+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:02.727 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:02.728 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:02.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:02.759 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:02.772+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:02.839 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:02.839 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:02.847 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:02.859 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:02.872+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:02.877 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:40:02.961 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:02.973+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:02.978 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:02.979 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:02.988 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:03.062 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:03.074+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:03.131 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.132 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.140 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:03.163 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:03.175+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:03.242 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.242 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.251 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:03.295 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:03.308+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:03.354 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.355 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.363 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:03.404 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:03.417+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:03.425 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7] out_osds: [3, 0] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:03.425 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:03.425 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-23T23:40:03.425 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.000000 2024-04-23T23:40:03.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0 2024-04-23T23:40:03.471 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:03.483+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:03.505 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.506 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.514 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:03.566 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:03.579+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:03.617 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.617 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.626 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:03.666 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:03.679+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:03.767 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:03.780+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:03.769 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.769 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.779 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:03.804 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.1 primary-affinity to 0 (802) 2024-04-23T23:40:03.868 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:03.881+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:03.887 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.887 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:03.896 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:03.970 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:03.982+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:03.997 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:03.997 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:04.006 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:04.071 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:04.084+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:04.107 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:04.107 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:04.115 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:04.172 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:04.184+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:04.218 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:04.218 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:04.227 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:04.273 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:04.285+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:04.370 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:04.370 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:04.373 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:04.386+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:04.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:04.474 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:04.487+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:04.482 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:04.482 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:04.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:04.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:04.576 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:04.588+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:04.636 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:04.637 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:04.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:04.675 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:04.688+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:04.697 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:04.697 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:04.715 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:04.715 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:04.732 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:04.733 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:04.749 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:04.749 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:04.752 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:04.753 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:04.753 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:04.762 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:04.767 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:04.767 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:04.776 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:04.789+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:04.784 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:04.785 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:04.802 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:04.802 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:04.827 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:04.828 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:04.875 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:04.875 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:04.875 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:04.875 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:04.876 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:04.889+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:04.885 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:04.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:40:04.977 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:04.990+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:05.032 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.032 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:05.032 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:05.032 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:05.032 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:05.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:05.079 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:05.092+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:05.180 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:05.192+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:05.187 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08985299899999, 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:05.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.191 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08983935399999, 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:05.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:05.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:05.195 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08982630400001, 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:40:05.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08981528499999, 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:40:05.199 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:05.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:40:05.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:40:05.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08980621000001, 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08979426600001, 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:40:05.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:40:05.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08978515499999, 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:40:05.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:40:05.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:40:05.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.088139783, 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.215 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:40:05.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:05.219 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08812753399999, 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4541 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08394894099999, 2024-04-23T23:40:05.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053236835000000003, 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4541 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115197+0000", 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.11e-07 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115199+0000", 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8980000000000001e-06 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115203+0000", 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4419999999999998e-06 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115206+0000", 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.382e-06 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168425+0000", 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053218750000000002 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168434+0000", 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1519999999999998e-06 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08393715899999, 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.227 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:05.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.230 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08392709, 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08391543100001, 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.234 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:40:05.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.083906111, 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08389559899999, 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:40:05.241 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:40:05.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.244 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.083886159, 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.245 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:05.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:40:05.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.248 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.083691066, 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.251 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.083670033, 2024-04-23T23:40:05.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:40:05.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:40:05.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 144.08365614300001, 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.256 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.259 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 132.480499638, 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.260 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.261 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.262 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:40:05.263 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.264 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:05.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:05.281 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:05.294+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:05.382 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:05.395+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:05.408 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.408 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:05.409 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:05.409 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:05.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:05.483 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:05.496+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:05.519 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.519 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:05.519 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:05.519 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:05.519 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:05.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:05.584 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:05.597+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:05.632 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.632 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:05.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:05.632 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 106.811793837, 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:05.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 64.749934065000005, 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:40:05.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 60.777104545999997, 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.644 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:40:05.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:40:05.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:40:05.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200907726000001, 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:05.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:40:05.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200885654, 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.654 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200859898000001, 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.659 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:40:05.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:05.664 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200840394, 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200237326, 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.669 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200213904000002, 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200184554, 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:40:05.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.683 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200156538000002, 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:05.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:40:05.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:40:05.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200129676, 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:40:05.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:40:05.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:40:05.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200107178, 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.698 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200086719000002, 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:40:05.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200057114, 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:40:05.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:40:05.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200038263, 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.709 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200027391999999, 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:40:05.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:40:05.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:40:05.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.718 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.200003845000001, 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:40:05.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:40:05.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.199961434999999, 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:40:05.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.199943776000001, 2024-04-23T23:40:05.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:05.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:40:05.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:05.733 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:05.734 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:05.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:05.736 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:05.747+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:05.835 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:05.848+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:05.878 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.878 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:05.879 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:05.879 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:05.882 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:40:05.891 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:05.936 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:05.949+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:05.997 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:05.997 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:05.997 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:05.997 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:05.997 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:06.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:06.037 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:06.050+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:06.109 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:06.109 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 137.71206960999999, 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.110 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.111 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.112 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.113 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 128.71237375600001, 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.114 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.115 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.116 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.117 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.118 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 87.564513099999999, 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.119 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.120 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.121 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.122 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 87.545944868999996, 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.123 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.124 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.125 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:40:06.126 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.8694463, 2024-04-23T23:40:06.127 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:40:06.129 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:40:06.130 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 37.864820651999999, 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.132 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.133 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.134 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:40:06.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.136 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.895595991, 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.137 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.138 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.139 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.141 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:06.142 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922779101, 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:40:06.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.146 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922751216999998, 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:06.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:40:06.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922732048, 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:40:06.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:06.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.154 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922713835, 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.155 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:40:06.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922685113, 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:40:06.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:40:06.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922665447, 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:40:06.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922646908000001, 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.170 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922616887, 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.171 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922596818999999, 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:40:06.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:40:06.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922578619999999, 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:40:06.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:40:06.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922560932, 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:40:06.183 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.92254303, 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:40:06.187 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:06.191 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 26.922524997, 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:06.195 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:06.197 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:06.197 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:06.209+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:06.297 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:06.310+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:06.301 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:06.301 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:06.301 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:06.301 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:06.310 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:06.398 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:06.410+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:06.452 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:06.452 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:06.452 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:06.452 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:06.452 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:06.461 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:06.502 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:06.515+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:06.600 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:06.613+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:06.605 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:06.605 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:06.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:06.605 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:06.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.605 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 121.628127486, 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:40:06.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:40:06.611 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 66.724373068999995, 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.615 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 56.608122819999998, 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:40:06.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:40:06.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.438820669000002, 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.621 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:40:06.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:40:06.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.625 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.43129682, 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:40:06.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:40:06.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.431244266999997, 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.630 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.431217466, 2024-04-23T23:40:06.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.431193587999999, 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:40:06.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:40:06.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.431171745999997, 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.643 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:06.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:40:06.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:40:06.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.647 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430962192000003, 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:06.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:40:06.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:40:06.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:40:06.651 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430912954, 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:40:06.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:06.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.43086795, 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:40:06.656 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430832932000001, 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430491549000003, 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.665 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:40:06.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430456784999997, 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430434030000001, 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:06.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:40:06.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430161398999999, 2024-04-23T23:40:06.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:40:06.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.681 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.430128769, 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.685 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.429923555000002, 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:06.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 33.429840558000002, 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:06.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:40:06.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.693 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:06.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:06.694 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:06.695 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:06.736 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:06.749+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:06.801 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:06.814+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:06.838 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:06.838 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:06.838 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:06.838 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:06.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:06.847 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:06.931 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:06.944+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:06.970 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:06.970 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:06.988 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:06.989 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:07.003 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:07.016+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:07.006 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:07.006 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:07.012 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:07.012 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:07.012 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:07.012 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:07.012 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:07.021 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:07.023 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:07.023 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:07.041 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:07.041 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:07.058 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:07.076 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:07.076 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:07.093 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:07.093 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:07.105 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:07.118+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:07.165 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:07.165 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:07.173 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:07.205 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:07.217+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:07.306 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:07.319+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:07.315 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:07.315 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:07.324 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:07.407 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:07.419+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:07.466 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:07.467 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:07.475 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:07.507 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:07.520+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:07.578 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:07.578 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:07.586 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:07.630 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:07.643+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:07.688 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:07.689 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:07.697 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:07.709 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:07.722+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:07.811 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:07.824+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:07.840 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:07.840 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:07.849 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:07.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:40:07.943 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:07.955+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:08.012 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.012 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.012 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:08.025+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:08.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:08.113 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:08.125+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:08.124 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.124 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.133 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:08.218 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:08.230+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:08.277 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.277 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:08.327 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:08.339+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:08.416 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:08.428+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:08.428 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.428 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:08.516 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:08.528+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:08.538 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.538 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:08.617 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:08.630+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:08.689 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.689 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:08.718 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:08.730+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:08.800 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.800 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.808 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:40:08.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:08.818 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:08.831+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:08.821 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7] out_osds: [3, 0] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:08.821 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:08.821 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-04-23T23:40:08.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-04-23T23:40:08.919 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:08.932+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:08.929 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:08.929 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:08.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:09.021 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:09.034+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:09.082 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:09.082 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:09.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:09.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:09.121 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:09.134+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:09.175 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:40:09.187+0000 7f7374a68640 -1 mon.a@0(leader).osd e157 definitely_dead 0 2024-04-23T23:40:09.221 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:09.234+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:09.237 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:09.237 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:09.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:09.252 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:09.252 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:09.270 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:09.271 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:09.288 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:09.288 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:09.305 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:09.305 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:09.322 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:09.335+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:09.323 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:09.323 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:09.340 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:09.341 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:09.356 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:09.358 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:09.358 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:09.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:09.375 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:09.376 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:09.428 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:09.441+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:09.477 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:09.478 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:09.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:09.523 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:09.536+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:09.625 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:09.637+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 141.233781026, 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:40:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:40:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 132.23408517199999, 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:40:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:40:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:40:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 91.086224516000001, 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:40:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:40:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 91.067656284999998, 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.391157716000002, 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:40:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.386532068000001, 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:40:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:40:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:40:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 31.417307406999999, 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:40:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:40:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:40:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444490516999998, 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444462633000001, 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:40:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444443463999999, 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444425250999998, 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444396528999999, 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444376862999999, 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444358324, 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:40:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:40:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444328302999999, 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:40:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:40:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444308235000001, 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:40:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:40:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444290036000002, 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:40:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:40:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:40:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444272347999998, 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444254445999999, 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:40:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:40:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:40:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 30.444236412999999, 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:09.717 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:09.718 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:09.725 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:09.737+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:09.826 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:09.838+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:09.833 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:09.833 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:09.833 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:09.833 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:09.842 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:09.909 INFO:teuthology.orchestra.run.smithi077.stderr:marked in osd.0. 2024-04-23T23:40:09.926 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-04-23T23:40:09.927 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:09.939+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:09.992 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:09.992 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:09.992 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:09.992 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:09.992 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:10.000 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:10.041 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:10.054+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:10.128 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:10.141+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:10.144 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 125.16729227099999, 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.145 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:40:10.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:40:10.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 70.263537854000006, 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.151 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:40:10.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 60.147287605000002, 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:10.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.977985453999999, 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:10.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:40:10.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.165 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970461604999997, 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:40:10.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970409052000001, 2024-04-23T23:40:10.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:40:10.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970382250999997, 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:40:10.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970358373000003, 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:40:10.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970336531000001, 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:40:10.184 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970126977, 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:40:10.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:10.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:40:10.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:10.193 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970077738999997, 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:40:10.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.970032734999997, 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:40:10.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969997716999998, 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.207 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969656334, 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969621570000001, 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.212 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:10.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969598814999998, 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.217 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:10.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:40:10.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969326184000003, 2024-04-23T23:40:10.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:40:10.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:40:10.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:40:10.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969293553999997, 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:40:10.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:40:10.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969088339999999, 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.231 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:40:10.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:40:10.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:40:10.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 36.969005342999999, 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.236 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:40:10.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:40:10.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.240 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:10.242 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:10.242 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:10.254+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:10.343 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:10.355+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:10.384 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:10.385 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:10.385 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:10.385 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:10.393 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:10.443 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:10.456+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:10.495 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:10.495 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:10.495 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:10.495 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:10.495 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:10.503 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:10.545 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:10.558+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:10.646 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:10.659+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:10.647 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:10.647 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.280076053999998, 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.648 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:10.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:10.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.280057317999997, 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:10.652 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:10.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.656 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.280038937999997, 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:10.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:10.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.280019740999997, 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.664 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.279783453999997, 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.665 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.668 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.279757293999999, 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:10.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:10.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.279737625000003, 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:10.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:10.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.279719204999999, 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.677 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:10.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.279572510000001, 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.682 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:10.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.278417081000001, 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.686 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:10.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:10.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.278101368999998, 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.278079337999998, 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:10.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:10.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:10.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.278058772000001, 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:10.699 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.700 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:10.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.278037947999998, 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.275589584000002, 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:10.708 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:10.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.779575809000001, 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.717 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.779559581000001, 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:10.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.779543340000004, 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.726 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.779528096999996, 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:10.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:10.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.779512011999998, 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:10.732 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:10.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.734 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:10.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.736 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.737 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:10.737 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:10.737 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:10.738 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:10.747 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:10.759+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:10.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:40:10.848 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:10.861+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:10.881 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:10.882 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:10.882 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:10.882 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:10.890 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:10.949 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:10.961+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:11.033 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:11.033 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:11.033 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:11.033 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:11.033 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:11.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:11.050 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:11.062+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:11.146 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:11.146 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:11.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:11.146 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344639858999997, 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:11.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:11.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:11.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:11.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344609359000003, 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:11.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:11.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344570482000002, 2024-04-23T23:40:11.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:11.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:11.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344539832000002, 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:11.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344515471000001, 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:11.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:11.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344493894999999, 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:11.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:11.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:11.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344474048999999, 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:11.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:11.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344444007, 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344416154999998, 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:11.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344392964000001, 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:11.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:11.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.199 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344286756000002, 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:11.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.204 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344252738000002, 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:11.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:11.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344226118999998, 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.209 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:11.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.3442054, 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.214 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:11.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344182431, 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.219 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:11.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:11.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:11.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344163412999997, 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:11.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:11.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.228 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344145232999999, 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:11.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:11.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.344124606000001, 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:11.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:11.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.343752485000003, 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:11.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 37.343697165999998, 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:11.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:11.248 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:11.250 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:11.250 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:11.263+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:11.351 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:11.364+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:11.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:11.394 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:11.394 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:11.394 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:11.394 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:11.402 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:11.486 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:11.499+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:11.506 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:11.506 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:11.523 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:11.524 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:11.540 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:11.545 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:11.545 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:11.545 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:11.545 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:11.545 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:11.552 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:11.564+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:11.553 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:11.557 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:11.557 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:11.574 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:11.575 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:11.592 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:11.592 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:11.609 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:11.609 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:11.625 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:11.626 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:11.678 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:11.690+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:11.696 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:11.696 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:11.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:11.754 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:11.767+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:11.807 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:11.807 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:11.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:11.856 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:11.868+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:11.921 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:40:11.956 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:11.969+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:11.983 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:11.983 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:11.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:12.058 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:12.070+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:12.106 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.106 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.116 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:12.158 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:12.171+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:12.259 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:12.271+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:12.262 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.262 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:12.360 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:12.373+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:12.415 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.415 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.424 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:12.467 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:12.480+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:12.529 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.529 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:12.562 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:12.574+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:12.662 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:12.675+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:12.691 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.691 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:12.763 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:12.776+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:12.811 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.811 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:12.864 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:12.876+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:12.930 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:12.930 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:12.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:12.965 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:12.978+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:13.052 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.052 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:13.105 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:13.118+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:13.166 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:13.178+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:13.167 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.167 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:13.266 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:13.278+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:13.323 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.323 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.332 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:13.376 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:13.389+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:13.434 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.434 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.442 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:13.468 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:13.480+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:13.568 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:13.581+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:13.586 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.586 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.595 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:13.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:13.680 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:13.693+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:13.697 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.697 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.706 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:13.765 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:13.766 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:13.770 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:13.783+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:13.784 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:13.785 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:13.803 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:13.803 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:13.811 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:13.811 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:13.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:13.825 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:13.825 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:13.848 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:13.848 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:13.869 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:13.869 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:13.887 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:13.887 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:13.904 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:13.904 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:13.907 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:13.920+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:13.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:40:13.966 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:13.966 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:13.966 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:13.966 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:13.966 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:13.971 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:13.984+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:13.975 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:14.072 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:14.085+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.122 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754641947000003, 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:14.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:14.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:14.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754623211000002, 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.130 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754604831000002, 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.131 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754585634000001, 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.135 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:14.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:14.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:14.139 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754349347000002, 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:14.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:14.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:14.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754323186999997, 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:14.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:14.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754303518, 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.148 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:14.152 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754285097999997, 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:14.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:14.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.754138402999999, 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:14.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:14.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:14.160 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.752982973999998, 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:14.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:14.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.752667262000003, 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:14.165 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:14.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.752645231000002, 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.170 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:14.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:14.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.752624664999999, 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.174 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:14.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:14.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:14.178 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.752603841000003, 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:14.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:14.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:14.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.750155477, 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.186 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.254141701999998, 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.187 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:14.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.254125473999999, 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.191 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:14.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.254109233000001, 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.195 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:14.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:14.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.254093990000001, 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.199 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:14.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.254077905000003, 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:14.203 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.207 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:14.209 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:14.209 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:14.221+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:14.309 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:14.322+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:14.313 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:14.313 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:14.313 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:14.313 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:14.322 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:14.411 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:14.423+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:14.430 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:14.430 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:14.431 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:14.439 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:14.523 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:14.536+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:14.593 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:14.593 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:14.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:14.593 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:14.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791524889999998, 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.594 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791494389999997, 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.599 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.603 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791455513000002, 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.604 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:14.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:14.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.608 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791424863000003, 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:14.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:14.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791400502000002, 2024-04-23T23:40:14.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:14.614 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.614 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.614 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.614 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.614 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.614 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.615 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:14.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.615 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:14.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:14.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:14.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791378926, 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.623 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.629 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791359079999999, 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.630 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:14.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:14.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:14.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791329038000001, 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791301185999998, 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.640 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:14.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:14.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:14.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.644 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791277995000002, 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:14.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:14.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791171787000003, 2024-04-23T23:40:14.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:14.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791137769000002, 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:14.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791111149999999, 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:14.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:14.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791090431000001, 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.663 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:14.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791067462000001, 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:14.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:14.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:14.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791048443999998, 2024-04-23T23:40:14.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791030264, 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.677 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.681 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.791009637000002, 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.790637515999997, 2024-04-23T23:40:14.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:14.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:14.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 40.790582196999999, 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:14.691 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:14.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:14.695 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:14.697 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:14.697 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:14.709+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:14.797 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:14.810+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:14.809 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:40:14.848 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:14.848 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:14.848 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:14.848 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:14.859 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:14.898 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:14.910+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:14.927 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:14.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:14.927 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-23T23:40:14.927 INFO:tasks.thrashosds.thrasher:Setting osd 5 primary_affinity to 0.334306 2024-04-23T23:40:14.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 0.3343058613769557 2024-04-23T23:40:15.000 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:15.012+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:15.002 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:15.002 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:15.002 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:15.002 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:15.002 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:15.010 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:15.100 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:15.113+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 66.311856521999999, 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.119 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:15.121 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:15.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.123 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301895109, 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.124 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:15.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:15.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.128 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301877734000001, 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:15.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:15.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.30186029, 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.133 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:15.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301724507000003, 2024-04-23T23:40:15.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:15.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301705628000001, 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.143 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:15.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:15.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:15.147 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301688253000002, 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.148 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:15.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:15.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:15.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301516607000003, 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.153 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301499743999997, 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:15.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:15.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:15.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.301482645, 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:15.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.300842240999998, 2024-04-23T23:40:15.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:15.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:15.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.300774300999997, 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.172 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:15.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.300590278999998, 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:15.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:15.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:15.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.300234469999999, 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:15.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:15.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.300166017000002, 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:15.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:15.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.30009098, 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.196 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.300005599000002, 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:15.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:15.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.299741421, 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.202 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.299671461999999, 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:15.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 41.299603599000001, 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:15.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:15.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.216 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:15.217 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:15.217 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:15.218 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:15.218 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:15.231+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:15.318 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:15.331+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:15.325 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:15.326 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:15.326 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:15.326 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:15.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:15.420 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:15.432+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:15.483 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:15.483 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:15.483 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:15.483 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:15.483 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:15.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:15.520 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:15.533+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:15.621 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:15.634+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:15.638 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:15.638 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:15.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:15.639 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:15.639 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:15.648 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:15.722 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:15.735+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:15.761 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:15.761 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:15.761 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:15.761 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:15.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:15.814 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.5 primary-affinity to 0.334306 (8219092) 2024-04-23T23:40:15.822 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:15.835+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:15.884 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:15.884 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:15.884 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:15.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:15.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:15.937 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:15.949+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:16.000 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90298017200001, 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.001 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.002 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:40:16.003 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.004 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90296652699999, 2024-04-23T23:40:16.005 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:40:16.007 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:40:16.008 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.009 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90295347700001, 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:40:16.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.011 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.012 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90294245800001, 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:40:16.014 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.015 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.016 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:40:16.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.902933383, 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.019 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:40:16.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.021 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.022 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90292143900001, 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:40:16.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.024 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.025 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.026 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90291232800001, 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.027 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.028 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:40:16.030 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.901266956, 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:40:16.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:40:16.032 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:40:16.033 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.034 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.90125470699999, 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.035 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.036 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.037 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.89706433200001, 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:40:16.039 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.040 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:40:16.041 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.042 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.043 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.897054263, 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.044 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.045 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:40:16.046 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.047 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.89704260400001, 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.048 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:40:16.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:40:16.050 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.897033284, 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.052 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.055 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.89702277200001, 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:40:16.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:40:16.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.897013332, 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:40:16.059 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:16.060 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:40:16.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:40:16.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.896818239, 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.063 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.066 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.896797206, 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.068 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:16.070 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 154.89678331600001, 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.071 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.072 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.073 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:40:16.074 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 143.293626811, 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:40:16.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.077 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.078 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:292622 3.6 3.b74753e6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e158)", 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 6.0576308750000001, 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97241263499999997, 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:16.079 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 292622 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954644+0000", 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.962e-06 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954651+0000", 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6270000000000002e-06 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954668+0000", 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6884999999999998e-05 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.081 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954675+0000", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.306e-06 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954736+0000", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1389999999999993e-05 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954747+0000", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0111e-05 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:16.082 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927043+0000", 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97229668599999997 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927055+0000", 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1668000000000001e-05 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:16.083 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:16.085 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:16.085 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:16.085 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:16.086 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:16.086 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:16.086 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:16.097+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:16.091 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:16.092 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:16.109 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:16.109 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:16.127 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:16.127 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:16.145 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:16.145 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:16.163 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:16.163 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:16.181 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:16.181 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:16.185 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:16.198+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:16.196 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.196 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:16.286 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:16.299+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:16.348 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.348 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:16.400 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:16.413+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:16.459 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.459 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:16.509 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:16.521+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:16.590 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:16.602+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:16.610 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.610 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:16.690 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:16.704+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:16.722 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.722 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:16.792 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:16.804+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:16.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:40:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.851 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:16.892 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:16.905+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:16.969 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:16.969 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:16.979 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:16.993 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:17.005+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:17.081 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.081 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.090 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:17.133 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:17.146+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:17.191 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.191 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.195 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:17.207+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:17.200 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:17.296 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:17.309+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:17.343 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.343 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.351 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:17.399 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:17.412+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:17.498 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.498 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.498 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:17.511+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:17.507 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:17.598 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:17.610+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:17.650 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.650 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.659 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:17.705 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:17.716+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:17.761 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.762 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.770 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:17.812 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:17.824+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:17.817 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:40:17.899 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:17.911+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:17.927 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:17.927 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:17.937 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:18.022 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:18.034+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:18.081 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:18.081 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:18.090 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:18.131 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:18.143+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:18.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:18.202 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:18.214+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:18.235 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:18.235 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:18.244 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:18.302 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:18.315+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:18.314 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:18.315 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:18.332 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:18.332 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:18.349 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:18.349 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:18.365 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:18.365 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:18.381 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:18.382 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:18.389 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:18.389 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:18.398 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:18.399 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:18.399 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:18.403 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:18.415+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:18.415 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:18.416 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:18.433 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:18.433 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:18.504 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.697047204, 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.505 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:18.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.687085791000001, 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.687068416000002, 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:18.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:18.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.687050972000002, 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:18.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.524 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686915188999997, 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:18.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:18.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686896310000002, 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.530 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:18.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.534 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686878935000003, 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:18.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:18.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:18.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:18.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.539 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686707288999997, 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:18.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.544 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686690425999998, 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:18.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:18.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:18.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686673327000001, 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.550 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:18.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:18.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:18.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.557 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.686032922999999, 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:18.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:18.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.685964982999998, 2024-04-23T23:40:18.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.685780960999999, 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.567 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.569 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:18.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.685425152000001, 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.572 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:18.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.685356699000003, 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:18.577 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.580 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.685281662000001, 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.582 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.585 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.586 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.685196281000003, 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.587 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:18.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:18.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.591 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.684932103000001, 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:18.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:18.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:18.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.684862144, 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:18.596 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:18.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:18.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 44.684794281000002, 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:18.601 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:18.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:18.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:18.606 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:18.606 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:18.606 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:18.516+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:18.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:18.648 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:18.660+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:18.709 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:18.721+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:18.711 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:18.711 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:18.711 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:18.712 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:18.721 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:18.810 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:18.822+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:18.828 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:18.829 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:18.829 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:18.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:18.924 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:18.937+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:18.996 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:18.996 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:18.996 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:18.996 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:18.996 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.005 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:19.012 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:19.024+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:19.113 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:19.125+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:19.149 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:19.150 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:19.150 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:19.150 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:19.214 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:19.226+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:19.263 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:19.264 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:19.264 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:19.264 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:19.264 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:19.316 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:19.329+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:19.378 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:19.378 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:19.378 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:19.378 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:19.378 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.378 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.280576053, 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.379 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:40:19.381 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.381 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.381 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.381 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.381 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:19.381 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.382 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.383 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.28056240800001, 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.385 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.386 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:40:19.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:40:19.388 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.280549358, 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.389 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.280538339, 2024-04-23T23:40:19.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:40:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:19.397 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.28052926399999, 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:40:19.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.28051732, 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.401 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:40:19.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:40:19.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.280508209, 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.405 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:19.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:19.409 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27886283699999, 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.413 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27885058800001, 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.415 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.274660213, 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.418 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:19.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:40:19.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.421 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27465014399999, 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:40:19.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:40:19.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.274638485, 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:19.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:40:19.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:40:19.428 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27462916499999, 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:40:19.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:40:19.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.274618653, 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.433 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:40:19.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:40:19.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27460921299999, 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.437 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27441411999999, 2024-04-23T23:40:19.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:19.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:19.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.443 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.27439308699999, 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:40:19.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 158.274379197, 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.447 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 146.67122269199999, 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:292622 3.6 3.b74753e6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e158)", 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 9.4352267560000005, 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97241263499999997, 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 292622 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954644+0000", 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.962e-06 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954651+0000", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6270000000000002e-06 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954668+0000", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6884999999999998e-05 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954675+0000", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.306e-06 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954736+0000", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1389999999999993e-05 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954747+0000", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0111e-05 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927043+0000", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97229668599999997 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927055+0000", 2024-04-23T23:40:19.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1668000000000001e-05 2024-04-23T23:40:19.460 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.460 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.460 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.460 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.460 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.460 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:19.462 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:19.473+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:19.562 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:19.575+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:19.605 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:19.605 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:19.606 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:19.606 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:19.663 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:19.675+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:19.718 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:19.718 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:19.719 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:19.719 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:19.719 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.727 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:19.764 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:19.776+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:19.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:40:19.865 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:19.877+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:19.874 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:19.874 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:19.874 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:19.874 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:19.874 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 121.052749773, 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.875 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.876 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.877 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.878 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:40:19.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.880 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 78.990890000999997, 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.881 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:19.882 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:40:19.883 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:40:19.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.885 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:19.886 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 75.018060481999996, 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.887 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:40:19.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:40:19.889 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:40:19.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441863662000003, 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.891 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.892 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.893 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.894 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.895 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441841590000003, 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.896 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.897 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.898 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.899 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:40:19.900 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441815834000003, 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:40:19.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:40:19.902 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.904 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:19.905 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441796330000003, 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.907 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.908 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.909 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441193261999999, 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.910 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.911 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.912 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.913 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.914 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441169840000001, 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.915 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:19.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:40:19.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:40:19.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.919 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441140490000002, 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.920 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.921 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.922 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:40:19.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.924 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441112474000001, 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.925 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.926 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.927 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.928 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:19.929 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441085612000002, 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.930 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.931 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:40:19.932 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.933 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.934 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441063114000002, 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.935 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.936 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:40:19.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:40:19.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441042654999997, 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.939 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.940 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:40:19.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:40:19.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:40:19.943 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.441013050000002, 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.944 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.945 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.946 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.947 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.948 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.440994199000002, 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.949 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:19.950 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:40:19.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:40:19.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.953 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.440983328000002, 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.954 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:40:19.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.956 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:40:19.957 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:19.958 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.440959780999997, 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.959 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.960 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:40:19.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.963 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.440917370999998, 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.964 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.965 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.966 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.967 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:19.968 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.440899711999997, 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:19.969 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:40:19.970 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:40:19.971 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:40:19.972 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:19.973 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:19.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:19.975 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:19.986+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:20.075 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:20.087+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:20.126 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:20.126 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:20.126 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:20.127 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:20.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:20.176 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:20.188+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:20.277 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:20.277 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:20.277 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:20.277 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:20.278 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:20.278 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:20.290+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:20.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:20.378 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:20.391+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:20.389 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:20.389 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:20.389 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:20.389 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:20.389 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 151.99209314399999, 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:40:20.391 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:40:20.392 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:40:20.393 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 142.99239729000001, 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.394 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.395 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:40:20.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:40:20.397 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 101.84453663399999, 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.398 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.399 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.400 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.401 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:40:20.402 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 101.825968403, 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.404 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.405 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.406 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 52.149469834000001, 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.407 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:40:20.408 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.409 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 52.144844186, 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.411 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.412 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.413 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.414 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 42.175619525000002, 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.415 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.417 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.418 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.419 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.420 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202802634999998, 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.421 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:40:20.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:40:20.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:40:20.424 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202774751, 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.425 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.426 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.427 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.428 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202755582000002, 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.429 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:40:20.431 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:40:20.432 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202737368999998, 2024-04-23T23:40:20.433 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:20.434 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:40:20.435 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.436 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202708647000001, 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:40:20.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.439 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.440 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.441 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.442 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202688981000001, 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.443 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.444 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.445 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.446 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202670441999999, 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.447 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:40:20.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:40:20.449 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.450 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202640420999998, 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.451 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.452 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.453 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.454 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202620353, 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.455 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.456 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.457 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:40:20.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202602153999997, 2024-04-23T23:40:20.459 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.460 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.461 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.462 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.463 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202584465999998, 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:40:20.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:40:20.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.467 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202566564000001, 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.468 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.469 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.470 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.471 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 41.202548530999998, 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.472 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.473 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.474 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.475 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.476 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:20.476 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:20.476 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:20.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:20.477 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:20.479 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:20.491+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:20.580 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:20.592+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:20.590 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:20.591 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:20.591 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:20.599 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:20.635 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:20.652 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:20.652 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:20.668 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:20.669 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:20.681 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:20.693+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:20.685 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:20.685 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:20.702 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:20.702 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:20.702 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:20.703 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:20.711 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:20.719 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:20.736 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:20.736 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:20.753 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:20.753 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:20.805 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:20.817+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:20.813 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:20.813 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:20.822 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:20.836 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:20.836 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:20.836 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-23T23:40:20.836 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.378270 2024-04-23T23:40:20.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.3782699571206658 2024-04-23T23:40:20.882 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:20.895+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:20.926 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:20.926 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:20.934 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:20.977 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:40:20.983 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:20.995+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:21.052 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.053 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.062 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:21.103 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:21.115+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:21.185 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:21.198+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:21.204 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.204 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.213 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:21.286 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:21.299+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:21.315 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.315 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.323 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:21.387 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:21.399+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:21.426 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.426 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.435 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:21.487 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:21.501+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:21.577 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.577 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.586 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:21.588 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:21.600+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:21.689 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:21.702+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:21.690 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.690 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.698 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:21.790 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:21.802+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:21.801 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.801 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.810 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:21.891 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:21.904+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:21.952 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:21.952 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:21.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:21.983 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.6 primary-affinity to 0.37827 (8247902) 2024-04-23T23:40:21.991 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:22.004+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.088 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.092 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:22.104+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:22.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:22.193 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:22.205+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.200 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:22.294 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:22.306+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.350 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:22.395 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:22.407+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:22.462 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:22.500 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:22.510+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.582 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.588 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:22.597 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:22.610+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:22.699 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:22.710+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:22.700 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.700 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:22.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:22.820 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:22.825+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:22.822 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:22.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:22.889 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:22.900 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:22.912+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:22.907 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:22.908 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:22.940 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:22.940 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:22.958 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:22.958 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:22.992 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:22.992 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:22.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:40:23.000 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:23.012+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:23.003 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:23.004 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:23.004 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:23.004 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:23.004 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:23.011 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:23.012 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:23.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:23.033 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:23.033 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:23.053 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:23.100 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:23.112+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 124.329216759, 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:40:23.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.156 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 82.267356986999999, 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:40:23.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:40:23.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:40:23.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 78.294527467999998, 2024-04-23T23:40:23.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:40:23.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.718330647999998, 2024-04-23T23:40:23.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:40:23.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:40:23.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:23.172 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.718308575999998, 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:40:23.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:40:23.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.718282819999999, 2024-04-23T23:40:23.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:23.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:40:23.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:40:23.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.718263315999998, 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:40:23.182 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717660248000001, 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.187 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:40:23.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:40:23.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:40:23.191 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717636826000003, 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.192 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717607475999998, 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.201 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717579460000003, 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.206 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717552597999997, 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:23.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:40:23.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.211 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717530099999998, 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:40:23.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717509640999999, 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.216 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:23.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:40:23.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:40:23.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717480035999998, 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:40:23.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:40:23.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:40:23.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717461184999998, 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:40:23.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717450313999997, 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.231 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:40:23.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:40:23.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717426766999999, 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.236 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:40:23.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:40:23.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:40:23.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717384357, 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.241 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:40:23.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:40:23.245 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.717366697999999, 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.246 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.250 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.251 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.251 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.251 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.251 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:23.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:23.252 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:23.263+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:23.353 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:23.364+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:23.395 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:23.395 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:23.395 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:23.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:23.454 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:23.466+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:23.546 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:23.547 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:23.547 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:23.547 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:23.547 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:23.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:23.556 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:23.567+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:23.656 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:23.668+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 155.26147906200001, 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.659 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:40:23.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:40:23.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:40:23.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 146.261783208, 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.663 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:40:23.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:40:23.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:23.667 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 105.11392255200001, 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:40:23.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:40:23.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:40:23.671 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 105.095354321, 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.418855751999999, 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:40:23.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:40:23.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:40:23.679 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.414230103999998, 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:40:23.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:40:23.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:40:23.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:40:23.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 45.445005442999999, 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.686 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472188553000002, 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.692 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:23.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:40:23.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:40:23.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472160668999997, 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:23.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:40:23.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:40:23.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472141499999999, 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.702 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.703 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:40:23.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.703 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:40:23.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472123287000002, 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:40:23.707 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:23.711 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472094564999999, 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.715 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472074898999999, 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:40:23.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472056360000003, 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.720 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:23.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.724 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472026339000003, 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.728 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.472006270999998, 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:40:23.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.730 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.471988072000002, 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.733 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:23.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.735 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.737 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.471970384000002, 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.741 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.471952481999999, 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.742 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 44.471934449000003, 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:23.746 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:40:23.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.750 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:23.751 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:23.751 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:23.752 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:23.796 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:23.808+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:23.807 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:40:23.858 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:23.870+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:23.875 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:23.875 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:23.875 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:23.875 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:23.885 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:23.959 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:23.971+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:24.033 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:24.033 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:24.033 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:24.033 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:24.033 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:24.042 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:24.060 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:24.072+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:24.144 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:24.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 139.16680189100001, 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:40:24.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:40:24.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:24.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 84.263047474000004, 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.151 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:40:24.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 74.146797225, 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:40:24.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:40:24.160 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.977495073999997, 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.161 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:24.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:40:24.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:40:24.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969971225000002, 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.166 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.170 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969918671999999, 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969891871000002, 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:40:24.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:40:24.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969867993000001, 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:40:24.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:40:24.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969846150999999, 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:40:24.184 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:40:24.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:40:24.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:40:24.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969636596999997, 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.189 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:24.193 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969587359000002, 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:24.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:40:24.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969542355000002, 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.201 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969507337000003, 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.202 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.206 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969165953999997, 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:24.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:40:24.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.210 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969131189999999, 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:40:24.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:24.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:24.215 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.969108435000003, 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:40:24.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.968835804000001, 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.220 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:40:24.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:40:24.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.224 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.968803174000001, 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.225 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:24.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.968597959999997, 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:40:24.229 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 50.968514962999997, 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:40:24.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:40:24.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.238 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.238 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.238 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:24.239 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:24.240 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:24.251+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:24.342 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:24.354+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:24.383 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:24.383 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:24.383 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:24.391 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:24.443 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:24.455+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:24.533 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:24.533 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:24.534 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:24.534 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:24.534 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:24.542 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:24.543 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:24.555+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:24.644 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:24.656+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278723454000001, 2024-04-23T23:40:24.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:24.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:24.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278704718, 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278686338, 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:24.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278667141, 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:24.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278430854000007, 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.663 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:24.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:24.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:24.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278404694000002, 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:24.667 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.668 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:24.671 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278385025000006, 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:24.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.675 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278366605000002, 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:24.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.278219910000004, 2024-04-23T23:40:24.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:24.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.277064480999996, 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:24.683 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:24.687 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.276748768999994, 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:24.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:24.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:24.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.691 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.276726737999994, 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.276706172000004, 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:24.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.276685348000001, 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.700 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.701 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.274236983999998, 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.704 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:24.708 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.778223209000004, 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:24.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.711 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.712 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.778206980999997, 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.713 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:24.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.716 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.778190739999999, 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.717 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:24.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:24.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.778175497000007, 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.721 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:24.725 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 64.778159411999994, 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:24.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:24.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.730 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.730 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:24.731 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:24.745 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:24.758+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:24.847 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:24.859+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:24.884 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:294307 3.13 3:cb2d74f2:::rbd_header.119474814f9:head [watch watch cookie 140356378451584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e173)", 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:40:24.897620+0000", 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00016726299999999999, 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00018586300000000001, 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 294307 2024-04-23T23:40:24.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897620+0000", 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897620+0000", 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:24.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897621+0000", 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6300000000000005e-07 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897623+0000", 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8590000000000001e-06 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897631+0000", 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2830000000000004e-06 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897635+0000", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5959999999999997e-06 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897669+0000", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3334999999999998e-05 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897715+0000", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6013999999999997e-05 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 4", 2024-04-23T23:40:24.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:24.897801+0000", 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6082999999999996e-05 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 1 2024-04-23T23:40:24.889 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:24.895 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:24.948 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:24.960+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:25.038 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:25.039 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:25.039 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:25.039 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:25.039 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:25.047 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:25.048 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:25.060+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:25.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349293111999998, 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.151 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:25.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:25.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:25.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349262611999997, 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.157 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349223735000002, 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.162 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:25.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:25.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349193085000003, 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:25.167 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.168 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.169 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349168724000002, 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.172 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:25.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:25.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.176 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349147148, 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.177 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349127301999999, 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.186 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349097260000001, 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:25.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:25.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:25.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349069407999998, 2024-04-23T23:40:25.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.349046217000001, 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.196 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:25.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:25.199 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:25.200 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348940009000003, 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.201 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.202 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.203 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.204 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.205 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348905991000002, 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.206 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.207 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.208 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.209 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.210 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348879371999999, 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.211 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.212 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.213 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.214 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.215 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348858653000001, 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.216 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.217 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.218 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.219 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348835684000001, 2024-04-23T23:40:25.220 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.221 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.222 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.223 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.224 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348816665999998, 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.225 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:25.226 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:25.227 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:25.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:25.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348798486, 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.230 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.234 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348777859000002, 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.235 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:25.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:25.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:25.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.239 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348405737999997, 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:25.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.243 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 51.348350418999999, 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:25.244 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:25.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:25.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:25.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:25.249 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:25.250 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:25.162+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:25.251 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:25.252 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:25.252 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:25.262+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:25.252 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:25.252 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:25.253 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:25.253 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:25.253 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:25.256 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:25.256 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:25.274 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:25.274 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:25.291 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:25.291 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:25.308 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:25.308 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:25.351 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:25.363+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:25.393 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:25.394 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:25.402 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:25.452 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:25.464+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:25.544 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:25.544 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:25.552 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:25.553 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:25.565+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:25.654 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:25.665+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:25.655 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:25.655 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:25.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:25.755 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:25.767+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:25.768 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:25.769 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:25.777 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:25.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:40:25.868 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:25.881+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:25.890 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:25.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:25.984 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:25.997+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:26.044 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.045 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:26.095 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:26.107+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:26.158 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:26.170+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.196 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.205 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:26.289 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:26.301+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.347 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:26.396 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:26.408+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:26.461 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:26.473+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:26.498 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.498 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:26.590 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:26.603+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:26.649 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.649 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.657 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:26.699 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:26.711+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:26.763 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:26.775+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.799 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:26.826 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:40:26.864 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:26.875+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:26.937 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:26.938 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:26.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:26.965 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:26.977+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:27.007 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:27.007 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:27.008 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-23T23:40:27.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:40:27.052 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:27.052 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:27.061 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:27.065 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:27.078+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:27.166 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:27.179+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:27.169 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:27.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:27.268 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:27.279+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:27.305 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:40:27.305 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:27.305 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 175, 2024-04-23T23:40:27.305 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:40:27.305 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:40:26.832528+0000", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:39:58.814990+0000", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:40:09.918526+0000", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5799936, 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 6, 2024-04-23T23:40:27.306 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 3, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "luminous", 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:40:27.307 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:40:27.308 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:27.309 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:27.310 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.311 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.312 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 6.9000000953674316, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 6.9000000953674316, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.28999999165534973, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.313 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:27.314 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.315 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:27.316 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:27.317 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:27.318 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 3.1600000858306885, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.7400000095367432, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.86000001430511475, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.7200000286102295, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.5, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "error_message": "pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:27.319 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "pool_client.0", 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:30.028908+0000", 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 8193, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 32, 2024-04-23T23:40:27.320 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 32, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 32, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 32, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 32, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "175", 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:27.321 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 58, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 175, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:27.322 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:27.323 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:27.324 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 9.3299999237060547, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.9700000286102295, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 1, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 9.3299999237060547, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.9700000286102295, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:40:27.325 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 165, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.327 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:40:27.328 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.329 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.330 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:27.331 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.333 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.334 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:40:27.335 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:27.336 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.338 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.339 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:27.340 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:40:27.341 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 82, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 147, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 55, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 84, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:40:27.342 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:40:27.343 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:40:27.344 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/2677547801", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/2677547801", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/2677547801", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/2677547801", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.346 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0.8255157470703125, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:27.347 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.348 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.349 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.350 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:40:27.351 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.3343048095703125, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:40:27.352 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 24, 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 35, 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 163, 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 26, 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.353 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.354 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.355 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:27.356 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2756265516", 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2756265516", 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2756265516", 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2756265516", 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:40:27.357 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.378265380859375, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 161, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.358 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.359 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:40:27.360 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.361 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:40:27.362 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.744476318359375, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:27.363 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 161, 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:40:27.364 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.365 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.366 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.367 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.368 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.369 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.370 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 84 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.371 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 26 2024-04-23T23:40:27.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:27.373 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [ 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "pgid": "3.e", 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: 2, 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: 6 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.374 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [ 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 23, 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 9 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [ 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:27.376 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 23, 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 1 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [], 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:40:27.377 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:40:27.378 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:40:27.378 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:27.378 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:27.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:27.381 INFO:tasks.thrashosds.thrasher:j is {'epoch': 175, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:40:26.832528+0000', 'last_up_change': '2024-04-23T23:39:58.814990+0000', 'last_in_change': '2024-04-23T23:40:09.918526+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.1600000858306885, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 2.7200000286102295, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574, 'error_message': 'pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-04-23T23:37:30.028908+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 58, 'snap_epoch': 175, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 9.329999923706055, 'score_stable': 1.9700000286102295, 'optimal_score': 1, 'raw_score_acting': 9.329999923706055, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 82, 'up_from': 147, 'up_thru': 55, 'down_at': 84, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 2677547801}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 2677547801}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 2677547801}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 2677547801}]}, 'public_addr': '172.21.15.77:6809/2677547801', 'cluster_addr': '172.21.15.77:6811/2677547801', 'heartbeat_back_addr': '172.21.15.77:6815/2677547801', 'heartbeat_front_addr': '172.21.15.77:6813/2677547801', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 0.8255157470703125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3343048095703125, 'last_clean_begin': 13, 'last_clean_end': 24, 'up_from': 35, 'up_thru': 163, 'down_at': 26, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2756265516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2756265516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2756265516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2756265516}]}, 'public_addr': '172.21.15.170:6801/2756265516', 'cluster_addr': '172.21.15.170:6803/2756265516', 'heartbeat_back_addr': '172.21.15.170:6807/2756265516', 'heartbeat_front_addr': '172.21.15.170:6805/2756265516', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.378265380859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 161, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.744476318359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 161, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 84}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 26}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.e', 'osds': [2, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 23, 'length': 9}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 23, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:40:27.381 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-23T23:40:27.382 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:27.382 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:27.382 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:27.383 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:27.392+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:27.481 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:27.492+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:27.492 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:27.492 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:27.501 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:27.537 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:27.554 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:27.554 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:27.571 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:27.571 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:27.585 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:27.597+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:27.587 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:27.587 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:27.604 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:27.604 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:27.622 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:27.623 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:27.640 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:27.640 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:27.645 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:27.646 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:27.646 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:27.646 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:27.646 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:27.655 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:27.657 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:27.682 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:27.694+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:27.783 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:27.795+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:27.800 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:27.800 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:27.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:27.800 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:27.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 142.822326831, 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:40:27.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:40:27.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:40:27.809 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.918572413999996, 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:40:27.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:40:27.814 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 77.802322165000007, 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:27.815 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:40:27.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:40:27.820 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.633020014000003, 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.821 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:40:27.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625496165000001, 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.827 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:40:27.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625443611999998, 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.832 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:40:27.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625416811000001, 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.838 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:40:27.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:40:27.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625392933000001, 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.843 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:40:27.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625371090999998, 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:40:27.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:40:27.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625161536999997, 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.854 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.859 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625112299000001, 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.860 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:40:27.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.864 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625067295000001, 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.865 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:27.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:40:27.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.625032277000003, 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:40:27.870 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:27.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:40:27.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624690893999997, 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.876 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:40:27.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.881 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624656129999998, 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:40:27.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:40:27.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624633375000002, 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.887 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:40:27.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.890 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:40:27.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:27.892 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624360744000001, 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:40:27.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:40:27.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.897 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624328114000001, 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.898 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.902 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624122900000003, 2024-04-23T23:40:27.903 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:27.904 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.905 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:40:27.906 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.907 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.908 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.624039903000003, 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:27.909 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:27.910 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.911 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:27.912 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:40:27.913 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:27.914 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:27.914 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:27.915 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:27.927+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:27.916 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:28.016 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:28.028+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:28.060 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:28.060 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:28.060 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:28.060 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:28.068 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:28.117 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:28.129+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:28.170 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:28.170 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:28.170 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:28.171 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:28.171 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:28.179 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:28.223 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:28.235+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:28.284 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.916334356999997, 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:28.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.288 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.916315620999995, 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.289 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.916297240999995, 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.293 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:28.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.916278043999995, 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.297 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.916041757000002, 2024-04-23T23:40:28.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:28.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.916015596999998, 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.309 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.915995928000001, 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.310 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.915977507999997, 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.314 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:28.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.915830812999999, 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:28.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.914675384000006, 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.323 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.914359672000003, 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.914337641000003, 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:28.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.914317075, 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:28.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.914296250999996, 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.340 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:28.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:28.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.911847886999993, 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.415834111999999, 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:28.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.352 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.415817884000006, 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:28.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.415801642999995, 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.357 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.358 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:28.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.415786400000002, 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:28.361 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:28.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:28.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.365 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 68.415770315000003, 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:28.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.370 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:28.371 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:28.372 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:28.384+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:28.472 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:28.484+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:28.516 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:28.516 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:28.516 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:28.516 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:28.524 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:28.573 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:28.585+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:28.667 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:28.668 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:28.668 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:28.668 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:28.668 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:28.674 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:28.686+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:28.676 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:28.775 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:28.787+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:28.781 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979330820999998, 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:28.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:28.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:28.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979300320999997, 2024-04-23T23:40:28.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:28.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:28.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:28.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979261444000002, 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.794 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:28.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979230794000003, 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:28.800 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:28.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:28.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.805 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979206433000002, 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:28.806 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:28.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:28.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.811 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979184857, 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.812 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.814 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979165010999999, 2024-04-23T23:40:28.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:28.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:28.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979134969, 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:28.824 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:28.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979107116999998, 2024-04-23T23:40:28.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.831 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:28.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:28.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.979083926000001, 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.836 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:28.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.840 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:28.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978977718000003, 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:28.842 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:28.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:28.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:28.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:28.848 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978943700000002, 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:28.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:28.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.853 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978917080999999, 2024-04-23T23:40:28.854 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:28.855 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:28.856 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.857 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:28.858 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.859 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978896362, 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:28.860 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:28.861 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.862 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.863 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.864 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:28.865 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.866 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978873393000001, 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.867 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.868 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:28.869 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.870 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.871 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.872 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978854374999997, 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.873 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.874 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:28.875 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.876 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:28.877 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:28.878 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978836195, 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.879 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:28.880 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.881 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.882 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:28.883 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:28.884 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978815568000002, 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.885 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:28.886 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.887 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:28.888 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.889 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978443446999997, 2024-04-23T23:40:28.890 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.891 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:28.892 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.893 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:28.894 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:28.895 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 54.978388127999999, 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:28.896 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.897 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:28.898 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.899 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:28.900 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.901 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.902 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:28.902 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:28.902 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:28.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:40:28.904 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:28.905 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:28.915+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:29.004 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:29.016+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:29.047 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:29.047 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:29.048 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:29.048 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:29.056 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:29.105 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:29.117+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:29.158 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:29.159 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:29.159 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:29.159 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:29.159 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:29.167 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:29.206 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:29.219+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:29.308 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:29.320+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:29.310 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:29.310 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:29.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:29.310 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 80.503262354, 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:29.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:29.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:29.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.493300941000001, 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:29.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.493283566000002, 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.321 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:29.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.493266122000001, 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.326 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.329 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.493130338999997, 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.331 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:29.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:29.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:29.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.493111460000002, 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.336 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.339 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.493094085000003, 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.341 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:29.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:29.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:29.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.345 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.346 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.346 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.346 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.492922438999997, 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:29.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:29.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.351 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.492905575999998, 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.352 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:29.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:29.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:29.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.492888477000001, 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.358 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.359 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:29.360 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.361 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.362 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:29.363 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.492248072999999, 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.364 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.365 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.366 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.367 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:29.368 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.492180132999998, 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.369 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.370 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.371 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:29.372 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.373 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:29.374 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491996110999999, 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:29.375 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.376 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.377 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.378 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.379 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491640302, 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.380 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.381 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.382 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.383 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.384 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491571849000003, 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.385 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.386 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.387 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.388 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.389 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491496812000001, 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.390 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.391 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.392 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.393 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.394 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491411431000003, 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.395 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.396 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.397 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:29.398 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.399 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491147253000001, 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.400 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.401 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.402 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:29.403 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.404 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491077294, 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.405 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.406 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.407 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.408 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.409 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 55.491009431000002, 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.410 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.411 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.412 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.413 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:29.414 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:29.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:29.416 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:29.428+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:29.516 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:29.529+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:29.519 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:29.519 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:29.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:29.618 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:29.630+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:29.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:29.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:29.719 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:29.731+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:29.742 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:29.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:29.742 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:29.742 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:29.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:29.820 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:29.832+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:29.838 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:40:29.866 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:29.866 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:29.867 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:29.867 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:29.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:29.921 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:29.933+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:30.021 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:30.033+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:30.022 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:30.022 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.041 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:30.041 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:30.049 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:30.058 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:30.059 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:30.076 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:30.076 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:30.093 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:30.094 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:30.111 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:30.111 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:30.122 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:30.134+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:30.129 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:30.129 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:30.147 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:30.147 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:30.163 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.164 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:30.260 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:30.273+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.320 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.324 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:30.336+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:30.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:30.425 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:30.437+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:30.470 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.471 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:30.526 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:30.539+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:30.581 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.582 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:30.632 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:30.644+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:30.727 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:30.740+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:30.733 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.733 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:30.828 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:30.840+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:30.892 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:30.892 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:30.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:30.945 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:30.958+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:31.009 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.010 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.019 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:31.061 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:31.073+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:31.122 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.122 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.130 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:31.131 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:31.143+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:31.231 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:31.243+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:31.232 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.232 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.241 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:31.332 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:31.344+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:31.383 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.383 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.392 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:31.433 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:31.445+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:31.494 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.494 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.503 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:31.533 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:31.546+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:31.605 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.605 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.613 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:31.634 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:31.647+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:31.715 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.715 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.724 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:31.735 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:31.748+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:31.827 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.827 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.836 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:31.836 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:31.848+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:31.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:40:31.936 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:31.949+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:31.988 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:31.989 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:31.997 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:32.041 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:32.053+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:32.100 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:32.100 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:32.108 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:32.138 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:32.150+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:32.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:32.238 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:32.250+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:32.252 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:32.252 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:32.261 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:32.276 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:32.276 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:32.293 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:32.294 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:32.310 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:32.310 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:32.327 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:32.327 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:32.344 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:32.344 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:32.345 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:32.357+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:32.362 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:32.363 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:32.380 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:32.380 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:32.381 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:32.382 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:32.382 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-04-23T23:40:32.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-04-23T23:40:32.398 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:32.398 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:32.405 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:32.405 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:32.405 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:32.405 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:32.405 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:32.414 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:32.450 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:32.463+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:32.512 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:32.512 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:32.513 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:32.515 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:32.516 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:32.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-04-23T23:40:32.558 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:32.570+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.751721528999994, 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:32.559 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741760116000002, 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.564 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:32.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741742741000003, 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:32.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:32.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:32.574 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741725297000002, 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:32.575 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.576 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:32.577 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:32.578 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.579 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741589513999998, 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.580 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.581 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.582 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.583 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.584 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741570635000002, 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.585 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.586 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.587 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.588 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.589 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:32.590 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741553260000003, 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.591 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.592 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:32.593 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:32.594 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741381613999998, 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:32.595 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741364750999999, 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.600 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:32.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.741347652000002, 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.605 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:32.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:32.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.609 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.740707248, 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.610 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:32.614 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.740639307999999, 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.615 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:32.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:32.619 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.740455286, 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.620 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.621 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.740099477000001, 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:32.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:32.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:32.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.629 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.740031023999997, 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.630 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.634 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.739955987000002, 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:32.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:32.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:32.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:32.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.739870605999997, 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:32.639 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.640 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.739606428000002, 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.644 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:32.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:32.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:32.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.739536469000001, 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.649 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.653 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 58.739468606000003, 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:32.654 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:32.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:32.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:32.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:32.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:32.659 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:32.660 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:32.672+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:32.661 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:32.686 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:32.780 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:32.781 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:32.781 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:32.781 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:32.781 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:32.781 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:32.781 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:32.782 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:32.783 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:32.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-04-23T23:40:32.784 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:32.795+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:40:32.883 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:32.895+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:32.895 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:32.895 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:32.895 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:32.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:32.972 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:32.973 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:32.976 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:32.976 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:32.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-04-23T23:40:33.018 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:33.030+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:33.053 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:33.053 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:33.054 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:33.054 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:33.054 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:33.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:33.084 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:33.096+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:33.150 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:33.151 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:33.151 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:33.153 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:33.153 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:33.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-04-23T23:40:33.185 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:33.197+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:33.210 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:33.210 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:33.210 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:33.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:33.286 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:33.298+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:33.289 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:33.290 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:33.291 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:33.292 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:33.292 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-04-23T23:40:33.325 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:33.326 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:33.326 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:33.326 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:33.335 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:33.418 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:33.431+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:33.459 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:33.460 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:33.462 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:33.463 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:33.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 'trim stale osdmaps' 2024-04-23T23:40:33.480 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:33.480 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:33.481 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:33.481 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:33.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:33.491 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:33.502+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:33.589 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:33.600+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:33.612 INFO:teuthology.orchestra.run.smithi077.stderr:no valid command found; 10 closest matches: 2024-04-23T23:40:33.612 INFO:teuthology.orchestra.run.smithi077.stderr:0 2024-04-23T23:40:33.612 INFO:teuthology.orchestra.run.smithi077.stderr:1 2024-04-23T23:40:33.612 INFO:teuthology.orchestra.run.smithi077.stderr:2 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:abort 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:assert 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:bench [] [] [] [] 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs debug_inject_read_zeros 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs files list 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:bluefs stats 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:bluestore allocator dump block 2024-04-23T23:40:33.613 INFO:teuthology.orchestra.run.smithi077.stderr:Error EINVAL: invalid command 2024-04-23T23:40:33.615 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-23T23:40:33.616 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-04-23T23:40:33.637 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54027316099999, 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:40:33.638 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.642 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54025951599999, 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.643 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:40:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54024646600001, 2024-04-23T23:40:33.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:40:33.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:40:33.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54023544699999, 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:40:33.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:33.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54022637200001, 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.656 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.660 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54021442800001, 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.54020531699999, 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:40:33.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.538559945, 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.669 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.672 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.53854769599999, 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:40:33.673 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:40:33.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:40:33.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.53435732099999, 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.678 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:33.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:40:33.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.534347252, 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:40:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.53433559300001, 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.689 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.534326273, 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.691 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.693 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.53431576099999, 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:40:33.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:33.698 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.534306321, 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:33.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:40:33.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.702 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.534111228, 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.703 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.704 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.705 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.706 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.534090195, 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:33.707 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.708 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.709 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:33.710 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 172.53407630500001, 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:33.711 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.712 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.713 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:33.714 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 160.9309198, 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:40:33.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:40:33.717 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:40:33.718 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:292622 3.6 3.b74753e6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e158)", 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 23.694923864, 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97241263499999997, 2024-04-23T23:40:33.719 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 292622 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954644+0000", 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.962e-06 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954651+0000", 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6270000000000002e-06 2024-04-23T23:40:33.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954668+0000", 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6884999999999998e-05 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954675+0000", 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.306e-06 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954736+0000", 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1389999999999993e-05 2024-04-23T23:40:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954747+0000", 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0111e-05 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927043+0000", 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97229668599999997 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927055+0000", 2024-04-23T23:40:33.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1668000000000001e-05 2024-04-23T23:40:33.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.724 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:33.724 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:33.724 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:33.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:33.726 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:33.737+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:33.826 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:33.838+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:33.881 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:33.881 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:33.881 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:33.881 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:33.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:33.927 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:33.939+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:34.027 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:34.040+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:34.033 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:34.033 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:34.033 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:34.033 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:34.033 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:34.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:34.128 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:34.141+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 135.32731460900001, 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:40:34.148 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:40:34.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:40:34.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:40:34.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:40:34.153 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 93.265454836999993, 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 89.292625318000006, 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.160 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:40:34.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:40:34.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:40:34.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.716428497999999, 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.165 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.169 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.716406425999999, 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:40:34.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:40:34.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.716380669999999, 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:40:34.174 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:40:34.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:40:34.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:40:34.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.716361165999999, 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.179 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715758098000002, 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.184 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.188 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715734675999997, 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.189 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:40:34.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.193 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715705325999998, 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:40:34.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.198 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715677309999997, 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:34.203 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715650447999998, 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:40:34.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715627949999998, 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:40:34.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:40:34.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:40:34.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715607491, 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.213 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:40:34.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:40:34.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:40:34.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715577885999998, 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.218 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715559034999998, 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.227 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715548163999998, 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:34.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:40:34.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:34.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:40:34.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715524617, 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.232 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715482207000001, 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.237 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:40:34.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:40:34.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:40:34.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 55.715464548, 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:34.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.246 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.247 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.247 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:34.247 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:34.247 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:34.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:34.249 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:34.260+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:34.349 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:34.362+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:34.392 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:34.392 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:34.392 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:34.392 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:34.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:34.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:34.450 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:34.462+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:34.547 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:34.547 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:34.547 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:34.550 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:34.562+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:34.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:34.562 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:34.562 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:34.580 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:34.580 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:34.596 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:34.597 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:34.613 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:34.613 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:34.631 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:34.632 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:34.649 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:34.650 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:34.652 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:34.664+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:34.660 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:34.660 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:34.667 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:34.667 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:34.669 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:34.685 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:34.754 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:34.766+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:34.783 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:34.783 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:34.792 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:34.854 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:34.866+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:34.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:40:34.901 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:34.901 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:34.911 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:34.995 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:35.007+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:35.055 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:35.068+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:35.057 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.057 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.066 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:35.156 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:35.168+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:35.209 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.209 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.218 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:35.259 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:35.271+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:35.358 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:35.370+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:35.363 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.363 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.372 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:35.459 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:35.471+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:35.514 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.514 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.523 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:35.564 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:35.576+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:35.661 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:35.673+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:35.665 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.665 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.674 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:35.762 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:35.774+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:35.777 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.777 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.786 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:35.864 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:35.876+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:35.880 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:40:35.935 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:35.936 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:35.946 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:35.964 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:35.977+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:36.054 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:36.054 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:36.063 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:36.066 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:36.077+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:36.165 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:36.165 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:36.166 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:36.178+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:36.174 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:36.267 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:36.279+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:36.316 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:36.317 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:36.325 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:36.370 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:36.382+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:36.440 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:36.449 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:36.491 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:36.503+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:36.569 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:36.581+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:36.594 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:36.594 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:36.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:36.669 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:36.681+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:36.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:36.748 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:36.748 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:36.757 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:36.770 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:36.782+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:36.818 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:36.835 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:36.836 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:36.853 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:36.853 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:36.863 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:36.863 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:36.863 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:36.870 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:36.870 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:36.870 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:36.882+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:36.872 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:36.895 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:36.895 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:36.913 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:36.913 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:36.931 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:36.931 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:36.971 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:36.984+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:36.987 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:36.987 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:36.987 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:36.987 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:36.987 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:36.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:37.081 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:37.094+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4505 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5472256~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04416360600001, 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053422091999999997, 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4505 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.143 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109293+0000", 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3700000000000001e-07 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109297+0000", 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5200000000000002e-06 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.144 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109300+0000", 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.3969999999999998e-06 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109303+0000", 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6469999999999998e-06 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162468+0000", 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053164860000000001 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.145 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162555+0000", 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6926000000000001e-05 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162715+0000", 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016030499999999999 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.146 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4506 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5701632~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04414996099999, 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053861772000000002, 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4506 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.147 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109307+0000", 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5499999999999999e-07 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.148 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109311+0000", 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109314+0000", 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.14e-06 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109317+0000", 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4329999999999998e-06 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.149 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.162935+0000", 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053618105999999999 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163030+0000", 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4837e-05 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163168+0000", 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013877099999999999 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.150 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4507 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 5931008~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04413691100001, 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054142289000000003, 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4507 2024-04-23T23:40:37.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.152 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.152 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.152 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.152 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:37.152 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109320+0000", 2024-04-23T23:40:37.154 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5400000000000002e-07 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109321+0000", 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7100000000000011e-07 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109325+0000", 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8160000000000004e-06 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.155 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109327+0000", 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4339999999999999e-06 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163216+0000", 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053889179000000002 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163310+0000", 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4063999999999999e-05 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.156 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163462+0000", 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000151571 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4508 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6160384~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04412589200001, 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054319293999999997, 2024-04-23T23:40:37.157 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4508 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109331+0000", 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1400000000000001e-07 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109332+0000", 2024-04-23T23:40:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1900000000000001e-07 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109335+0000", 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8279999999999999e-06 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109337+0000", 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3719999999999999e-06 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.160 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163503+0000", 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054165814999999999 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163557+0000", 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4181000000000002e-05 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163650+0000", 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2965000000000002e-05 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.161 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4509 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6389760~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.044116817, 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054485334000000003, 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.162 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4509 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.163 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109340+0000", 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.16e-07 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109341+0000", 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.2399999999999997e-07 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109344+0000", 2024-04-23T23:40:37.164 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7080000000000002e-06 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109349+0000", 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2279999999999998e-06 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163692+0000", 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054343128999999997 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.165 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163746+0000", 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3739999999999997e-05 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163825+0000", 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9488999999999997e-05 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4510 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6619136~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.166 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04410487300001, 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054759818000000002, 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4510 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.167 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109352+0000", 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4499999999999998e-07 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.168 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109353+0000", 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.71e-07 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109356+0000", 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8770000000000002e-06 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109358+0000", 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3580000000000001e-06 2024-04-23T23:40:37.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163881+0000", 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054522468999999997 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.163966+0000", 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5278000000000006e-05 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.170 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164112+0000", 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00014572000000000001 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4511 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 6848512~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04409576200001, 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054936835000000003, 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.171 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4511 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.109361+0000", 2024-04-23T23:40:37.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110976+0000", 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.001615399 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110980+0000", 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7969999999999998e-06 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110989+0000", 2024-04-23T23:40:37.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.1279999999999997e-06 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.110996+0000", 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5860000000000001e-06 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164156+0000", 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053160316999999999 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164222+0000", 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5483999999999998e-05 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164298+0000", 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6124000000000005e-05 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4512 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7077888~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.175 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04245039, 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053471133999999997, 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4512 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:37.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111006+0000", 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111007+0000", 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4400000000000001e-07 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111008+0000", 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4440000000000001e-06 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111012+0000", 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111015+0000", 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8080000000000001e-06 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164333+0000", 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053318338 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164400+0000", 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6694999999999998e-05 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164477+0000", 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7743000000000004e-05 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4513 3.17 3:e81ff797:::rbd_data.1194833257ef.0000000000000000:4 [read 7307264~16384] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.04243814099999, 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053636841999999997, 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4513 2024-04-23T23:40:37.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111018+0000", 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111019+0000", 2024-04-23T23:40:37.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2999999999999999e-07 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111020+0000", 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.032e-06 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111023+0000", 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.977e-06 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.111025+0000", 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.362e-06 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164520+0000", 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053494909 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164570+0000", 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0426999999999997e-05 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.164655+0000", 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4905000000000001e-05 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4542 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.03824776600001, 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053265892000000002, 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.184 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4542 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:37.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115209+0000", 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115210+0000", 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.33e-07 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115213+0000", 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8779999999999998e-06 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115216+0000", 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1980000000000001e-06 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168465+0000", 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053248814999999998 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168475+0000", 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8500000000000006e-06 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4543 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.038237697, 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299838000000002, 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4543 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115219+0000", 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1799999999999999e-07 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115220+0000", 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.7999999999999993e-07 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115225+0000", 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6149999999999999e-06 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115227+0000", 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4789999999999999e-06 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168507+0000", 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053279921000000001 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168519+0000", 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1625e-05 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4544 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.038226038, 2024-04-23T23:40:37.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053314838000000003, 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4544 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115231+0000", 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1299999999999999e-07 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115232+0000", 2024-04-23T23:40:37.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.018e-06 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115235+0000", 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.852e-06 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115237+0000", 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4619999999999999e-06 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168537+0000", 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053299798000000002 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168545+0000", 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4950000000000008e-06 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4545 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:37.196 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.038216718, 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053348013, 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4545 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115240+0000", 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0900000000000001e-07 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115241+0000", 2024-04-23T23:40:37.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.181e-06 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115245+0000", 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2600000000000001e-06 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115248+0000", 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.044e-06 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168578+0000", 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053330678999999999 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168588+0000", 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6399999999999992e-06 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4546 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.200 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.03820620600001, 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053377083999999998, 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4546 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115250+0000", 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115251+0000", 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1199999999999999e-07 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115252+0000", 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.16e-07 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115255+0000", 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2509999999999999e-06 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115257+0000", 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3120000000000001e-06 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168619+0000", 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053361794999999997 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168627+0000", 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.5979999999999997e-06 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.204 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4547 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.038196766, 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053409259000000001, 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4547 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115260+0000", 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1500000000000001e-07 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115261+0000", 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.8299999999999995e-07 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115265+0000", 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7620000000000001e-06 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115268+0000", 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.039e-06 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168660+0000", 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053391778000000001 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168669+0000", 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.482e-06 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.208 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4548 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.038001673, 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053250174999999997, 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4548 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115455+0000", 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115458+0000", 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.6630000000000002e-06 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115464+0000", 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115467+0000", 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8449999999999996e-06 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168697+0000", 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053229487999999998 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168705+0000", 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1829999999999994e-06 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4549 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:37.212 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.03798064, 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053272131, 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4549 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115476+0000", 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4000000000000002e-07 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115479+0000", 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.509e-06 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115483+0000", 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2969999999999997e-06 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115486+0000", 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8109999999999999e-06 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168739+0000", 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053252624999999998 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168748+0000", 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4490000000000005e-06 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:4550 3.17 3.e9eff817 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:37.216 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 176.03796675000001, 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.053300917000000003, 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 4550 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.115490+0000", 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116976+0000", 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0014859980000000001 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116981+0000", 2024-04-23T23:40:37.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3260000000000003e-06 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.116994+0000", 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2795e-05 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.117004+0000", 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.6849999999999996e-06 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168781+0000", 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.051777831000000003 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:41.168791+0000", 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2820000000000002e-06 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:12538 3.17 3:ea6fefc2:::rbd_data.11943f90bac1.0000000000000000:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 164.43481024499999, 2024-04-23T23:40:37.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.067101577999999995, 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 12538 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718646+0000", 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.718648+0000", 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0150000000000002e-06 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730861+0000", 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.012212403 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730886+0000", 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5289000000000001e-05 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.730898+0000", 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1902999999999999e-05 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731004+0000", 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010647800000000001 2024-04-23T23:40:37.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.731117+0000", 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000112516 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785614+0000", 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.054496971999999998 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785661+0000", 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7203000000000002e-05 2024-04-23T23:40:37.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:52.785748+0000", 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6798999999999993e-05 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:292622 3.6 3.b74753e6 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e158)", 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 27.198814308999999, 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97241263499999997, 2024-04-23T23:40:37.225 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "reached pg", 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 292622 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954642+0000", 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954644+0000", 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.962e-06 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954651+0000", 2024-04-23T23:40:37.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6270000000000002e-06 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954668+0000", 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6884999999999998e-05 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954675+0000", 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.306e-06 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954736+0000", 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1389999999999993e-05 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:09.954747+0000", 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0111e-05 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927043+0000", 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97229668599999997 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.229 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:40:10.927055+0000", 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1668000000000001e-05 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.230 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:37.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:37.232 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:37.233 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:37.233 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:37.243+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:37.332 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:37.344+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:37.374 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:37.375 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:37.375 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:37.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:37.433 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:37.445+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:37.485 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:37.485 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:37.485 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:37.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:37.533 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:37.546+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:50680 3.8 3:15f77e81:::rbd_id.image_client.0-clone18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-23T23:40:37.598 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 138.77719973999999, 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.98069440600000002, 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 50680 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.599 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832147+0000", 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832149+0000", 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.81e-06 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.600 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832157+0000", 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5460000000000003e-06 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832173+0000", 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.5967000000000001e-05 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832180+0000", 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6750000000000002e-06 2024-04-23T23:40:37.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832243+0000", 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2738999999999997e-05 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:18.832251+0000", 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1680000000000004e-06 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.602 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809640+0000", 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.97738831999999998 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809762+0000", 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012254 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.809894+0000", 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00013148200000000001 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.603 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812413+0000", 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0025196300000000001 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812743+0000", 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00032969299999999999 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812799+0000", 2024-04-23T23:40:37.604 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6286999999999998e-05 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:19.812842+0000", 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2549000000000002e-05 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e95)", 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 96.715339967999995, 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0452027960000001, 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.605 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 115927 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.606 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894007+0000", 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894008+0000", 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2309999999999999e-06 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894015+0000", 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.8040000000000004e-06 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.607 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894032+0000", 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7306999999999999e-05 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894045+0000", 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2602000000000001e-05 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894110+0000", 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.5424000000000002e-05 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.608 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op must wait for map", 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.894115+0000", 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8899999999999998e-06 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899708+0000", 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0055924010000000003 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:00.899717+0000", 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4590000000000004e-06 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.609 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.938864+0000", 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0391466119999999 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939034+0000", 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00016990899999999999 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:01.939210+0000", 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000176157 2024-04-23T23:40:37.610 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:116348 3.19 3:9aa8f193:::rbd_header.11942c3bf491:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e99)", 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 92.742510448999994, 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95770830299999998, 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.611 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 116348 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866837+0000", 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.612 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866838+0000", 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1820000000000001e-06 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866844+0000", 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.049e-06 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866856+0000", 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2196e-05 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.613 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866862+0000", 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2500000000000003e-06 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866908+0000", 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5540000000000001e-05 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:04.866916+0000", 2024-04-23T23:40:37.614 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7389999999999999e-06 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824037+0000", 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.95712169599999997 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824209+0000", 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00017198300000000001 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:05.824545+0000", 2024-04-23T23:40:37.615 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00033566800000000001 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274897 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.166313629000001, 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222789299999999, 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.616 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274897 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443033+0000", 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.617 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443034+0000", 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443037+0000", 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7259999999999998e-06 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443043+0000", 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7800000000000003e-06 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.618 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443048+0000", 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9849999999999997e-06 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443158+0000", 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000109406 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443165+0000", 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.4590000000000001e-06 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.619 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145169+0000", 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70200358699999998 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145218+0000", 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8752999999999999e-05 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145261+0000", 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3695000000000001e-05 2024-04-23T23:40:37.620 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274898 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7340032~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.166291557000001, 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70233248500000001, 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.621 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274898 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443055+0000", 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.622 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443056+0000", 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4999999999999998e-07 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443063+0000", 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.567e-06 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443069+0000", 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6290000000000004e-06 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.623 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443074+0000", 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9110000000000001e-06 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443196+0000", 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00012227700000000001 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443200+0000", 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1300000000000003e-06 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.624 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145292+0000", 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702091727 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145339+0000", 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6578e-05 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145388+0000", 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9215999999999998e-05 2024-04-23T23:40:37.625 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274899 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7503872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.166265801000002, 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70242171099999995, 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.626 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274899 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443081+0000", 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.627 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443082+0000", 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7400000000000003e-07 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443084+0000", 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1919999999999999e-06 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443090+0000", 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9070000000000004e-06 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.628 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443095+0000", 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.972e-06 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443229+0000", 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000134373 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443244+0000", 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.4324e-05 2024-04-23T23:40:37.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145420+0000", 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70217669100000002 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145463+0000", 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2925e-05 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.630 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145503+0000", 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9752999999999997e-05 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274900 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7700480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.166246297000001, 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70258161299999999, 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.631 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274900 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.632 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443101+0000", 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8000000000000001e-07 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443103+0000", 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.041e-06 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443109+0000", 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8839999999999999e-06 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.633 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443114+0000", 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4630000000000003e-06 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443271+0000", 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000157813 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443279+0000", 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6720000000000004e-06 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.634 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145531+0000", 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70225232699999995 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145605+0000", 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3835e-05 2024-04-23T23:40:37.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145682+0000", 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7198000000000002e-05 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275016 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 5849088~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165643228999997, 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70222647100000002, 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275016 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.637 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443704+0000", 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6600000000000002e-07 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443707+0000", 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.57e-06 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.638 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443713+0000", 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4030000000000004e-06 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443718+0000", 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0710000000000002e-06 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443761+0000", 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2335e-05 2024-04-23T23:40:37.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443768+0000", 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.939e-06 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145829+0000", 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70206153500000001 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145874+0000", 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5330000000000001e-05 2024-04-23T23:40:37.640 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145930+0000", 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5822000000000002e-05 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275017 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6012928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165619806999999, 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70234174000000005, 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.641 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275017 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.642 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443727+0000", 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443728+0000", 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443730+0000", 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2239999999999998e-06 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.643 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443736+0000", 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0909999999999998e-06 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443741+0000", 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0150000000000003e-06 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443790+0000", 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9472999999999999e-05 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.644 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443796+0000", 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.451e-06 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.145963+0000", 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70216670000000003 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146015+0000", 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1937000000000001e-05 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.645 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146069+0000", 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4413999999999998e-05 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275018 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6045696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165590457, 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70243701300000005, 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.646 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275018 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.647 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443757+0000", 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443759+0000", 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3740000000000001e-06 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.648 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443766+0000", 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4520000000000002e-06 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443771+0000", 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.259e-06 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1056000000000001e-05 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.649 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443819+0000", 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7920000000000004e-06 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146094+0000", 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702274764 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146139+0000", 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4919999999999997e-05 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.650 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146194+0000", 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4923000000000003e-05 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275019 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6209536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165562440999999, 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70254125300000003, 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.651 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275019 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.652 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443785+0000", 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443787+0000", 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3810000000000002e-06 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.653 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443794+0000", 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2759999999999997e-06 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443799+0000", 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8080000000000004e-06 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443836+0000", 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6990000000000003e-05 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.654 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146224+0000", 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70238151100000001 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146271+0000", 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7581999999999999e-05 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146326+0000", 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4762999999999997e-05 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275020 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6406144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165535579, 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70262968999999997, 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.656 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275020 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443811+0000", 2024-04-23T23:40:37.657 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443812+0000", 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8400000000000005e-07 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443814+0000", 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4250000000000001e-06 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.658 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443820+0000", 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0850000000000002e-06 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443826+0000", 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6319999999999996e-06 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8158000000000003e-05 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.659 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8040000000000001e-06 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146345+0000", 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70247612599999998 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146389+0000", 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3523000000000003e-05 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.660 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146441+0000", 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2453000000000001e-05 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275021 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6602752~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165513081, 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.702738007, 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.661 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275021 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.662 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443834+0000", 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.15e-07 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443837+0000", 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1169999999999998e-06 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.663 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443842+0000", 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.8270000000000003e-06 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443847+0000", 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5399999999999997e-06 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7472000000000003e-05 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.664 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443892+0000", 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5259999999999996e-06 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146469+0000", 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70257748600000003 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146518+0000", 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8933000000000001e-05 2024-04-23T23:40:37.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146572+0000", 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3690999999999998e-05 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275022 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6766592~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165492622000002, 2024-04-23T23:40:37.666 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70283203999999999, 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275022 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:37.667 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443854+0000", 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443855+0000", 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8700000000000001e-07 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.668 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443857+0000", 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.272e-06 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443864+0000", 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4189999999999999e-06 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443869+0000", 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2220000000000001e-06 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.669 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9745e-05 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443915+0000", 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.122e-06 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146591+0000", 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70267676000000001 2024-04-23T23:40:37.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146635+0000", 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3269000000000002e-05 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146686+0000", 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1844e-05 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.671 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275023 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 6963200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165463017, 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70291940200000003, 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275023 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443884+0000", 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7300000000000002e-07 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.673 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443886+0000", 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.7579999999999999e-06 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443894+0000", 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.1529999999999997e-06 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443898+0000", 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2009999999999999e-06 2024-04-23T23:40:37.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443936+0000", 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8049000000000001e-05 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443939+0000", 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.41e-06 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146715+0000", 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70277554799999997 2024-04-23T23:40:37.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146763+0000", 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8038000000000003e-05 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146803+0000", 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0871999999999998e-05 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275024 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7159808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.676 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165444166, 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70300233000000001, 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275024 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:37.677 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443903+0000", 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7099999999999998e-07 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.678 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443904+0000", 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2500000000000001e-06 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443908+0000", 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5939999999999998e-06 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443911+0000", 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5600000000000001e-06 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.679 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443961+0000", 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0643999999999998e-05 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443966+0000", 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.5909999999999998e-06 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146824+0000", 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70285771699999999 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.680 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146867+0000", 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3241000000000002e-05 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146905+0000", 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8461999999999999e-05 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275025 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.681 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165433295, 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70311102199999997, 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275025 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.682 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443914+0000", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0800000000000001e-07 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443919+0000", 2024-04-23T23:40:37.683 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7849999999999999e-06 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443925+0000", 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.6949999999999997e-06 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443930+0000", 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5500000000000002e-06 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7121999999999999e-05 2024-04-23T23:40:37.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444001+0000", 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0659999999999997e-06 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146935+0000", 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70293368000000001 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.146985+0000", 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9611000000000003e-05 2024-04-23T23:40:37.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147025+0000", 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0204999999999999e-05 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275026 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7356416~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165409748000002, 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318919599999996, 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.686 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275026 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443937+0000", 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443938+0000", 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7700000000000005e-07 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443950+0000", 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.2508e-05 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.688 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443957+0000", 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.029e-06 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443962+0000", 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9590000000000003e-06 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444022+0000", 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0028000000000002e-05 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.689 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444026+0000", 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5410000000000001e-06 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147046+0000", 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70302000600000003 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147089+0000", 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2799999999999997e-05 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.690 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147127+0000", 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7848000000000001e-05 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275027 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7520256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165367338000003, 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70325747000000005, 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.691 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275027 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.692 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443980+0000", 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.22e-07 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443982+0000", 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8589999999999999e-06 2024-04-23T23:40:37.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443987+0000", 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2240000000000003e-06 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443991+0000", 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.636e-06 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444046+0000", 2024-04-23T23:40:37.694 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444049+0000", 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.529e-06 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147156+0000", 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70310703100000005 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.695 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147198+0000", 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1835999999999997e-05 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147237+0000", 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8952999999999998e-05 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:275028 3.19 3:9ea64717:::rbd_data.1194f2b92c37.0000000000000011:36 [read 7716864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:37.696 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.165349679000002, 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70335332500000003, 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 275028 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443997+0000", 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443998+0000", 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.7399999999999999e-07 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.443999+0000", 2024-04-23T23:40:37.698 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.203e-06 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444003+0000", 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0539999999999996e-06 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444007+0000", 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7409999999999998e-06 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.699 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444062+0000", 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5753e-05 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for peered", 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.444066+0000", 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.4060000000000001e-06 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147250+0000", 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.70318421600000003 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.700 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147312+0000", 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2028999999999999e-05 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.147351+0000", 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8649000000000002e-05 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:37.701 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:37.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:37.703 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:37.715+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:37.804 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:37.816+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:37.847 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:37.847 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:37.847 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:37.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:37.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:40:37.905 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:37.917+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:38.005 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:38.018+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:38.014 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:38.014 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:38.014 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:38.015 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:38.015 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:38.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:38.106 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:38.119+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 169.77278197499999, 2024-04-23T23:40:38.170 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:40:38.172 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.173 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.174 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 160.77308612100001, 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:38.175 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.176 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.177 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.178 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 119.625225465, 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.179 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.180 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.182 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:38.183 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 119.606657234, 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:38.184 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.185 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.186 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.187 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.930158664999993, 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:40:38.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:40:38.191 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 69.925533017000006, 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.192 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:40:38.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.194 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:40:38.195 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 59.956308356000001, 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.197 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:40:38.198 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.199 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:40:38.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:40:38.201 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.202 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983491465999997, 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.203 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.204 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.205 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.206 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983463581999999, 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.207 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:38.208 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.210 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.211 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983444413000001, 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.212 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.213 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:38.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:40:38.215 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983426199999997, 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.216 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.217 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:40:38.218 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:40:38.219 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983397478000001, 2024-04-23T23:40:38.220 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:40:38.222 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:40:38.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983377812000001, 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.225 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:40:38.226 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.228 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983359272999998, 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:40:38.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.230 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.231 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.232 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983329251999997, 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.234 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.235 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.236 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.237 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983309183999999, 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.238 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.239 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.240 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.241 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983290984999996, 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.242 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.243 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.244 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.245 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983273296999997, 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:40:38.246 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.248 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:40:38.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.250 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983255395, 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.251 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:40:38.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:40:38.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:40:38.254 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 58.983237361999997, 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:38.255 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:38.256 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:38.257 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:38.259 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:38.261 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:38.262 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:38.273+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:38.362 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:38.374+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:38.370 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:38.370 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:38.370 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:38.370 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:38.379 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:38.463 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:38.475+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:38.482 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:38.482 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:38.482 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:38.482 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:38.482 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:38.491 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:38.564 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:38.577+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 153.617426876, 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:40:38.595 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.596 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:40:38.597 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.598 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.599 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.600 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:40:38.601 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 98.713672458999994, 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.602 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.603 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.604 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.605 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.606 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 88.597422210000005, 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.607 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.608 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.609 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:40:38.610 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.611 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.428120058999994, 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.612 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.613 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.614 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.615 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420596209999999, 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.616 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.617 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:40:38.618 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:40:38.619 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.620 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420543656999996, 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.621 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.622 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.623 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.624 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.625 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420516856000006, 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:38.626 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:40:38.627 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.628 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.629 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420492977999999, 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.630 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.631 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.632 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.633 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.634 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420471136000003, 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.635 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:38.636 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:40:38.637 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:40:38.638 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.639 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420261581999995, 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:40:38.640 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:40:38.641 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.642 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.643 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420212344000007, 2024-04-23T23:40:38.644 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.645 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:40:38.646 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.647 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.648 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420167340000006, 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.649 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.650 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.651 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:40:38.652 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:40:38.653 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.420132322000001, 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.654 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.655 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:40:38.656 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:40:38.657 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.658 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.419790938999995, 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.659 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:40:38.660 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:40:38.661 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.662 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:38.663 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.419756175000003, 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:38.664 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.665 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.666 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.667 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.41973342, 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.668 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:38.669 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:40:38.670 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:40:38.671 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.672 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.419460788999999, 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.673 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:40:38.674 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.675 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.676 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.677 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.419428159000006, 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.678 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.679 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.680 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.681 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.419222945000001, 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.682 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.683 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.684 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.685 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.686 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 65.419139947999994, 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:40:38.687 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:40:38.688 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:40:38.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:38.690 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:38.691 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:38.691 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:38.692 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:38.692 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-23T23:40:38.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:40:38.694 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:38.706+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:38.694 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:38.794 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:38.807+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:38.797 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:38.797 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:38.797 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:38.797 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:38.807 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:38.813 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:40:38.895 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:38.908+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:38.922 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:38.922 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:38.923 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:38.923 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:38.923 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:38.932 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:38.996 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:39.008+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 187, 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:40:38.822560+0000", 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:39:58.814990+0000", 2024-04-23T23:40:39.004 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:40:09.918526+0000", 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5799936, 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 6, 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:40:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 3, 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "luminous", 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:40:39.006 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:40:39.007 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.008 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:39.009 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:39.010 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:39.011 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:39.012 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 6.9000000953674316, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 6.9000000953674316, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.28999999165534973, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.013 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:39.014 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:39.015 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:39.016 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:39.017 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:39.018 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:39.019 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 3.1600000858306885, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.7400000095367432, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.86000001430511475, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.7200000286102295, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.5, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: "error_message": "pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.020 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "pool_client.0", 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:30.028908+0000", 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 8193, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:39.021 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 32, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 32, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 32, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 32, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 32, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:39.022 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "187", 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 58, 2024-04-23T23:40:39.023 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 187, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:39.024 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:39.025 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.026 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 9.3299999237060547, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.9700000286102295, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 1, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 9.3299999237060547, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.9700000286102295, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737, 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.027 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 165, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:39.028 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.029 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:40:39.030 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:40:39.031 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.032 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.033 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:39.034 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:40:39.035 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.036 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.038 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:40:39.039 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.040 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.041 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.042 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.044 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.045 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.046 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 82, 2024-04-23T23:40:39.047 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 147, 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 55, 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 84, 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.048 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.049 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:40:39.050 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.051 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/2677547801", 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/2677547801", 2024-04-23T23:40:39.052 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/2677547801", 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/2677547801", 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0.8255157470703125, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.054 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.055 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.056 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.057 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.058 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.059 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.3343048095703125, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 24, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 35, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 163, 2024-04-23T23:40:39.060 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 26, 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:40:39.061 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.062 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.063 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.064 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2756265516", 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2756265516", 2024-04-23T23:40:39.065 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2756265516", 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2756265516", 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.066 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.378265380859375, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 161, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:40:39.067 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.068 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.069 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.072 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.744476318359375, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 161, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:39.073 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.075 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:40:39.076 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.077 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:39.078 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:40:39.079 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.080 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:40:39.081 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 84 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.082 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.083 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 26 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:39.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [ 2024-04-23T23:40:39.085 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: "pgid": "3.e", 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: 2, 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: 6 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:40:39.086 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:39.087 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [ 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 11, 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 8 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [ 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:39.088 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 11, 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 1 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [ 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:39.089 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 19, 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 3 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:40:39.090 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:40:39.091 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:40:39.091 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:40:39.091 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:39.091 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:39.094 INFO:tasks.thrashosds.thrasher:j is {'epoch': 187, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:40:38.822560+0000', 'last_up_change': '2024-04-23T23:39:58.814990+0000', 'last_in_change': '2024-04-23T23:40:09.918526+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.1600000858306885, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 2.7200000286102295, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574, 'error_message': 'pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-04-23T23:37:30.028908+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 58, 'snap_epoch': 187, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 9.329999923706055, 'score_stable': 1.9700000286102295, 'optimal_score': 1, 'raw_score_acting': 9.329999923706055, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 82, 'up_from': 147, 'up_thru': 55, 'down_at': 84, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 2677547801}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 2677547801}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 2677547801}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 2677547801}]}, 'public_addr': '172.21.15.77:6809/2677547801', 'cluster_addr': '172.21.15.77:6811/2677547801', 'heartbeat_back_addr': '172.21.15.77:6815/2677547801', 'heartbeat_front_addr': '172.21.15.77:6813/2677547801', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 0.8255157470703125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3343048095703125, 'last_clean_begin': 13, 'last_clean_end': 24, 'up_from': 35, 'up_thru': 163, 'down_at': 26, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2756265516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2756265516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2756265516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2756265516}]}, 'public_addr': '172.21.15.170:6801/2756265516', 'cluster_addr': '172.21.15.170:6803/2756265516', 'heartbeat_back_addr': '172.21.15.170:6807/2756265516', 'heartbeat_front_addr': '172.21.15.170:6805/2756265516', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.378265380859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 161, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.744476318359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 161, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 84}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 26}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.e', 'osds': [2, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 8}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 11, 'length': 1}]}], 'new_purged_snaps': [{'pool': 3, 'snaps': [{'begin': 19, 'length': 3}]}], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:40:39.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668377802999998, 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:39.095 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:39.096 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:39.097 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.098 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.099 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.100 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668359066999997, 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.101 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.102 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:39.103 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.104 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.105 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668340686999997, 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.106 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.107 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:39.108 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.109 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.110 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668321489999997, 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:39.111 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.112 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:39.113 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.114 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.115 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668085203000004, 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:39.116 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.117 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:39.118 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.119 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.120 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668059043, 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.121 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.122 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.123 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:39.124 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.125 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668039374000003, 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.126 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.127 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:39.128 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.129 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:39.130 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.668020953999999, 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.131 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.132 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:39.133 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.134 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.135 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.667874259000001, 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.136 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.137 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.138 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:39.139 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.140 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.666718829999994, 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:39.141 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.142 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:39.143 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.144 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:39.145 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.146 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.666403118000005, 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.147 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:39.148 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.149 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.150 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.151 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.666381087000005, 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.152 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:39.153 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.154 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:39.155 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.156 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.666360521000001, 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.157 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.158 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:39.159 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.160 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.161 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.666339696999998, 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.162 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.163 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.164 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:39.165 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.166 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.663891332999995, 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.167 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:39.168 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.170 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.171 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.172 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.173 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.167877558000001, 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.174 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.175 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:39.176 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:39.177 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.178 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.167861329999994, 2024-04-23T23:40:39.179 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.180 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.181 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.182 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.183 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.167845088999997, 2024-04-23T23:40:39.184 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.185 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:39.186 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.187 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:39.188 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.167829846000004, 2024-04-23T23:40:39.189 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.190 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:39.191 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.192 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:39.193 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 79.167813761000005, 2024-04-23T23:40:39.194 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:39.195 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.196 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:39.197 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:39.198 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:39.199 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:39.200 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:39.201 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:39.214+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:39.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:39.302 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:39.314+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:39.302 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:39.302 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:39.302 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:39.303 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:39.311 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:39.381 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:39.403 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:39.416+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:39.407 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:39.407 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:39.414 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:39.414 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:39.414 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:39.414 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:39.414 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:39.423 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:39.424 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:39.424 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:39.441 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:39.441 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:39.458 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:39.458 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:39.476 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:39.476 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:39.493 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:39.494 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:39.504 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:39.516+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:39.512 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:39.512 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:39.522 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:40:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:40:39.529 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:39.530 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:39.534 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":282,"stamp":"2024-04-23T23:40:38.824192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":415649404,"num_objects":1668,"num_object_clones":40,"num_object_copies":3336,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1668,"num_whiteouts":1315,"num_read":355588,"num_read_kb":1267858,"num_write":23485,"num_write_kb":707701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9233,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21189,"ondisk_log_size":21189,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":471548,"kb_used_data":106436,"kb_used_omap":13,"kb_used_meta":364978,"kb_avail":660131332,"statfs":{"total":676457349120,"available":675974483968,"internally_reserved":0,"allocated":108990464,"data_stored":124727026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14062,"internal_metadata":373737746},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-177132385,"num_objects":-99,"num_object_clones":-26,"num_object_copies":-198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-99,"num_whiteouts":-19,"num_read":1226,"num_read_kb":1047,"num_write":204,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.939566"},"pg_stats":[{"pgid":"3.1f","version":"183'815","reported_seq":6215,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.962445+0000","last_change":"2024-04-23T23:40:34.894762+0000","last_active":"2024-04-23T23:40:34.962445+0000","last_peered":"2024-04-23T23:40:34.962445+0000","last_clean":"2024-04-23T23:40:34.962445+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:40:34.962445+0000","last_undegraded":"2024-04-23T23:40:34.962445+0000","last_fullsized":"2024-04-23T23:40:34.962445+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":815,"log_dups_size":0,"ondisk_log_size":815,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:04:08.290136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0050943569999999999,"stat_sum":{"num_bytes":6119121,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":41,"num_read":8106,"num_read_kb":19509,"num_write":992,"num_write_kb":5087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.1e","version":"183'513","reported_seq":4992,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.887905+0000","last_change":"2024-04-23T23:40:34.887905+0000","last_active":"2024-04-23T23:40:34.887905+0000","last_peered":"2024-04-23T23:40:34.887905+0000","last_clean":"2024-04-23T23:40:34.887905+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:40:34.887905+0000","last_undegraded":"2024-04-23T23:40:34.887905+0000","last_fullsized":"2024-04-23T23:40:34.887905+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:14:03.606623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013034380000000001,"stat_sum":{"num_bytes":4323536,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":52,"num_read":5571,"num_read_kb":29334,"num_write":421,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.1d","version":"183'652","reported_seq":23691,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.968486+0000","last_change":"2024-04-23T23:40:34.894631+0000","last_active":"2024-04-23T23:40:34.968486+0000","last_peered":"2024-04-23T23:40:34.968486+0000","last_clean":"2024-04-23T23:40:34.968486+0000","last_became_active":"2024-04-23T23:40:16.836759+0000","last_became_peered":"2024-04-23T23:40:16.836759+0000","last_unstale":"2024-04-23T23:40:34.968486+0000","last_undegraded":"2024-04-23T23:40:34.968486+0000","last_fullsized":"2024-04-23T23:40:34.968486+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:08.469050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022291979999999999,"stat_sum":{"num_bytes":6054659,"num_objects":60,"num_object_clones":1,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":48,"num_read":24612,"num_read_kb":39427,"num_write":640,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.1c","version":"183'704","reported_seq":16619,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.996463+0000","last_change":"2024-04-23T23:40:34.898571+0000","last_active":"2024-04-23T23:40:34.996463+0000","last_peered":"2024-04-23T23:40:34.996463+0000","last_clean":"2024-04-23T23:40:34.996463+0000","last_became_active":"2024-04-23T23:40:16.836688+0000","last_became_peered":"2024-04-23T23:40:16.836688+0000","last_unstale":"2024-04-23T23:40:34.996463+0000","last_undegraded":"2024-04-23T23:40:34.996463+0000","last_fullsized":"2024-04-23T23:40:34.996463+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":704,"log_dups_size":0,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:55:27.209614+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0057938470000000004,"stat_sum":{"num_bytes":24345144,"num_objects":56,"num_object_clones":4,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":44,"num_read":18190,"num_read_kb":49692,"num_write":704,"num_write_kb":16210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.1b","version":"182'812","reported_seq":5174,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.893833+0000","last_change":"2024-04-23T23:40:34.894117+0000","last_active":"2024-04-23T23:40:34.893833+0000","last_peered":"2024-04-23T23:40:34.893833+0000","last_clean":"2024-04-23T23:40:34.893833+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:40:34.893833+0000","last_undegraded":"2024-04-23T23:40:34.893833+0000","last_fullsized":"2024-04-23T23:40:34.893833+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":812,"log_dups_size":0,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:16:14.127566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004661826,"stat_sum":{"num_bytes":2664524,"num_objects":53,"num_object_clones":1,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":42,"num_read":5929,"num_read_kb":36045,"num_write":1095,"num_write_kb":30807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.1a","version":"181'747","reported_seq":17359,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.001800+0000","last_change":"2024-04-23T23:40:34.894207+0000","last_active":"2024-04-23T23:40:35.001800+0000","last_peered":"2024-04-23T23:40:35.001800+0000","last_clean":"2024-04-23T23:40:35.001800+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:40:35.001800+0000","last_undegraded":"2024-04-23T23:40:35.001800+0000","last_fullsized":"2024-04-23T23:40:35.001800+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:51:34.605564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010724479999999999,"stat_sum":{"num_bytes":21422945,"num_objects":45,"num_object_clones":1,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":33,"num_read":19574,"num_read_kb":31654,"num_write":846,"num_write_kb":19972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.19","version":"184'681","reported_seq":9109,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.967191+0000","last_change":"2024-04-23T23:40:35.900645+0000","last_active":"2024-04-23T23:40:35.967191+0000","last_peered":"2024-04-23T23:40:35.967191+0000","last_clean":"2024-04-23T23:40:35.967191+0000","last_became_active":"2024-04-23T23:39:39.136832+0000","last_became_peered":"2024-04-23T23:39:39.136832+0000","last_unstale":"2024-04-23T23:40:35.967191+0000","last_undegraded":"2024-04-23T23:40:35.967191+0000","last_fullsized":"2024-04-23T23:40:35.967191+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":681,"log_dups_size":0,"ondisk_log_size":681,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:23:07.393084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068810500000000005,"stat_sum":{"num_bytes":56873424,"num_objects":62,"num_object_clones":2,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":54,"num_read":8359,"num_read_kb":49179,"num_write":640,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":439,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"8"}]},{"pgid":"3.18","version":"183'514","reported_seq":3588,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.016570+0000","last_change":"2024-04-23T23:40:34.893540+0000","last_active":"2024-04-23T23:40:35.016570+0000","last_peered":"2024-04-23T23:40:35.016570+0000","last_clean":"2024-04-23T23:40:35.016570+0000","last_became_active":"2024-04-23T23:40:15.841789+0000","last_became_peered":"2024-04-23T23:40:15.841789+0000","last_unstale":"2024-04-23T23:40:35.016570+0000","last_undegraded":"2024-04-23T23:40:35.016570+0000","last_fullsized":"2024-04-23T23:40:35.016570+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":514,"log_dups_size":0,"ondisk_log_size":514,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:01:05.096759+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0043380520000000002,"stat_sum":{"num_bytes":482402,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":35,"num_read":2964,"num_read_kb":42761,"num_write":582,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":283,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.17","version":"181'642","reported_seq":6006,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.894417+0000","last_change":"2024-04-23T23:40:34.894586+0000","last_active":"2024-04-23T23:40:34.894417+0000","last_peered":"2024-04-23T23:40:34.894417+0000","last_clean":"2024-04-23T23:40:34.894417+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:40:34.894417+0000","last_undegraded":"2024-04-23T23:40:34.894417+0000","last_fullsized":"2024-04-23T23:40:34.894417+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":642,"log_dups_size":0,"ondisk_log_size":642,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:54:57.347858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004999776,"stat_sum":{"num_bytes":49401712,"num_objects":55,"num_object_clones":2,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":43,"num_read":6849,"num_read_kb":49823,"num_write":815,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.16","version":"182'800","reported_seq":24401,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-04-23T23:40:36.900361+0000","last_change":"2024-04-23T23:40:36.901049+0000","last_active":"2024-04-23T23:40:36.900361+0000","last_peered":"2024-04-23T23:40:36.900361+0000","last_clean":"2024-04-23T23:40:36.900361+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:40:36.900361+0000","last_undegraded":"2024-04-23T23:40:36.900361+0000","last_fullsized":"2024-04-23T23:40:36.900361+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":800,"log_dups_size":0,"ondisk_log_size":800,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:49:35.150901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087382200000000001,"stat_sum":{"num_bytes":11643946,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":32,"num_read":25631,"num_read_kb":50155,"num_write":939,"num_write_kb":36181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"9"}]},{"pgid":"3.15","version":"183'501","reported_seq":7838,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.893119+0000","last_change":"2024-04-23T23:40:34.893119+0000","last_active":"2024-04-23T23:40:34.893119+0000","last_peered":"2024-04-23T23:40:34.893119+0000","last_clean":"2024-04-23T23:40:34.893119+0000","last_became_active":"2024-04-23T23:39:34.818900+0000","last_became_peered":"2024-04-23T23:39:34.818900+0000","last_unstale":"2024-04-23T23:40:34.893119+0000","last_undegraded":"2024-04-23T23:40:34.893119+0000","last_fullsized":"2024-04-23T23:40:34.893119+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":501,"log_dups_size":0,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:04:58.937182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001424366,"stat_sum":{"num_bytes":2691072,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":412,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":536,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.14","version":"183'941","reported_seq":13169,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.895399+0000","last_change":"2024-04-23T23:40:34.895399+0000","last_active":"2024-04-23T23:40:34.895399+0000","last_peered":"2024-04-23T23:40:34.895399+0000","last_clean":"2024-04-23T23:40:34.895399+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:40:34.895399+0000","last_undegraded":"2024-04-23T23:40:34.895399+0000","last_fullsized":"2024-04-23T23:40:34.895399+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":941,"log_dups_size":0,"ondisk_log_size":941,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:53:45.135766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002382009,"stat_sum":{"num_bytes":5678228,"num_objects":59,"num_object_clones":2,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":44,"num_read":15532,"num_read_kb":20207,"num_write":1201,"num_write_kb":9788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.7","version":"0'0","reported_seq":309,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.885746+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:40:34.885746+0000","last_peered":"2024-04-23T23:40:34.885746+0000","last_clean":"2024-04-23T23:40:34.885746+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:40:34.885746+0000","last_undegraded":"2024-04-23T23:40:34.885746+0000","last_fullsized":"2024-04-23T23:40:34.885746+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"183'462","reported_seq":6250,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.979261+0000","last_change":"2024-04-23T23:40:34.893775+0000","last_active":"2024-04-23T23:40:34.979261+0000","last_peered":"2024-04-23T23:40:34.979261+0000","last_clean":"2024-04-23T23:40:34.979261+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:40:34.979261+0000","last_undegraded":"2024-04-23T23:40:34.979261+0000","last_fullsized":"2024-04-23T23:40:34.979261+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:29:58.109057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004457127,"stat_sum":{"num_bytes":12531732,"num_objects":47,"num_object_clones":1,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":35,"num_read":6290,"num_read_kb":30544,"num_write":375,"num_write_kb":2228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.6","version":"0'0","reported_seq":341,"reported_epoch":184,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.900513+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:40:35.900513+0000","last_peered":"2024-04-23T23:40:35.900513+0000","last_clean":"2024-04-23T23:40:35.900513+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:40:35.900513+0000","last_undegraded":"2024-04-23T23:40:35.900513+0000","last_fullsized":"2024-04-23T23:40:35.900513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"183'784","reported_seq":6781,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.018965+0000","last_change":"2024-04-23T23:40:34.890605+0000","last_active":"2024-04-23T23:40:35.018965+0000","last_peered":"2024-04-23T23:40:35.018965+0000","last_clean":"2024-04-23T23:40:35.018965+0000","last_became_active":"2024-04-23T23:40:16.835190+0000","last_became_peered":"2024-04-23T23:40:16.835190+0000","last_unstale":"2024-04-23T23:40:35.018965+0000","last_undegraded":"2024-04-23T23:40:35.018965+0000","last_fullsized":"2024-04-23T23:40:35.018965+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:39.133118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014612570000000001,"stat_sum":{"num_bytes":3921923,"num_objects":49,"num_object_clones":1,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":37,"num_read":8290,"num_read_kb":60424,"num_write":1074,"num_write_kb":15164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.5","version":"0'0","reported_seq":145,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.891833+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:40:34.891833+0000","last_peered":"2024-04-23T23:40:34.891833+0000","last_clean":"2024-04-23T23:40:34.891833+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:40:34.891833+0000","last_undegraded":"2024-04-23T23:40:34.891833+0000","last_fullsized":"2024-04-23T23:40:34.891833+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"183'626","reported_seq":5366,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.890318+0000","last_change":"2024-04-23T23:40:34.890318+0000","last_active":"2024-04-23T23:40:34.890318+0000","last_peered":"2024-04-23T23:40:34.890318+0000","last_clean":"2024-04-23T23:40:34.890318+0000","last_became_active":"2024-04-23T23:40:04.823474+0000","last_became_peered":"2024-04-23T23:40:04.823474+0000","last_unstale":"2024-04-23T23:40:34.890318+0000","last_undegraded":"2024-04-23T23:40:34.890318+0000","last_fullsized":"2024-04-23T23:40:34.890318+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:46:24.173031+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0041237510000000002,"stat_sum":{"num_bytes":1930036,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":29,"num_read":6236,"num_read_kb":44982,"num_write":593,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.4","version":"0'0","reported_seq":58,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.889063+0000","last_change":"2024-04-23T23:40:10.931459+0000","last_active":"2024-04-23T23:40:34.889063+0000","last_peered":"2024-04-23T23:40:34.889063+0000","last_clean":"2024-04-23T23:40:34.889063+0000","last_became_active":"2024-04-23T23:40:10.931141+0000","last_became_peered":"2024-04-23T23:40:10.931141+0000","last_unstale":"2024-04-23T23:40:34.889063+0000","last_undegraded":"2024-04-23T23:40:34.889063+0000","last_fullsized":"2024-04-23T23:40:34.889063+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:00.838091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"182'818","reported_seq":3901,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.886905+0000","last_change":"2024-04-23T23:40:34.887170+0000","last_active":"2024-04-23T23:40:34.886905+0000","last_peered":"2024-04-23T23:40:34.886905+0000","last_clean":"2024-04-23T23:40:34.886905+0000","last_became_active":"2024-04-23T23:40:16.836403+0000","last_became_peered":"2024-04-23T23:40:16.836403+0000","last_unstale":"2024-04-23T23:40:34.886905+0000","last_undegraded":"2024-04-23T23:40:34.886905+0000","last_fullsized":"2024-04-23T23:40:34.886905+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:14:11.348253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948031,"stat_sum":{"num_bytes":2723299,"num_objects":51,"num_object_clones":2,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":44,"num_read":5944,"num_read_kb":29694,"num_write":1148,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.3","version":"183'687","reported_seq":8330,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.982082+0000","last_change":"2024-04-23T23:40:34.898275+0000","last_active":"2024-04-23T23:40:34.982082+0000","last_peered":"2024-04-23T23:40:34.982082+0000","last_clean":"2024-04-23T23:40:34.982082+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:40:34.982082+0000","last_undegraded":"2024-04-23T23:40:34.982082+0000","last_fullsized":"2024-04-23T23:40:34.982082+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:47:38.338107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0053213490000000004,"stat_sum":{"num_bytes":5713441,"num_objects":45,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":35,"num_read":7705,"num_read_kb":31195,"num_write":752,"num_write_kb":18545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.2","version":"0'0","reported_seq":319,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-04-23T23:40:36.899682+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:40:36.899682+0000","last_peered":"2024-04-23T23:40:36.899682+0000","last_clean":"2024-04-23T23:40:36.899682+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:40:36.899682+0000","last_undegraded":"2024-04-23T23:40:36.899682+0000","last_fullsized":"2024-04-23T23:40:36.899682+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"183'507","reported_seq":3757,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.002165+0000","last_change":"2024-04-23T23:40:34.886851+0000","last_active":"2024-04-23T23:40:35.002165+0000","last_peered":"2024-04-23T23:40:35.002165+0000","last_clean":"2024-04-23T23:40:35.002165+0000","last_became_active":"2024-04-23T23:40:04.823413+0000","last_became_peered":"2024-04-23T23:40:04.823413+0000","last_unstale":"2024-04-23T23:40:35.002165+0000","last_undegraded":"2024-04-23T23:40:35.002165+0000","last_fullsized":"2024-04-23T23:40:35.002165+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:43:34.922331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000684335,"stat_sum":{"num_bytes":29267260,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":39,"num_read":3580,"num_read_kb":45350,"num_write":679,"num_write_kb":72438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.1","version":"0'0","reported_seq":353,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.886479+0000","last_change":"2024-04-23T23:40:10.929291+0000","last_active":"2024-04-23T23:40:34.886479+0000","last_peered":"2024-04-23T23:40:34.886479+0000","last_clean":"2024-04-23T23:40:34.886479+0000","last_became_active":"2024-04-23T23:40:10.929001+0000","last_became_peered":"2024-04-23T23:40:10.929001+0000","last_unstale":"2024-04-23T23:40:34.886479+0000","last_undegraded":"2024-04-23T23:40:34.886479+0000","last_fullsized":"2024-04-23T23:40:34.886479+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:08:51.140875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"179'687","reported_seq":6039,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.889582+0000","last_change":"2024-04-23T23:40:34.890057+0000","last_active":"2024-04-23T23:40:34.889582+0000","last_peered":"2024-04-23T23:40:34.889582+0000","last_clean":"2024-04-23T23:40:34.889582+0000","last_became_active":"2024-04-23T23:40:15.839461+0000","last_became_peered":"2024-04-23T23:40:15.839461+0000","last_unstale":"2024-04-23T23:40:34.889582+0000","last_undegraded":"2024-04-23T23:40:34.889582+0000","last_fullsized":"2024-04-23T23:40:34.889582+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":687,"log_dups_size":0,"ondisk_log_size":687,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:46:27.783402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0009922100000000001,"stat_sum":{"num_bytes":2591344,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":944,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":458,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.891437+0000","last_change":"2024-04-23T23:40:04.823878+0000","last_active":"2024-04-23T23:40:34.891437+0000","last_peered":"2024-04-23T23:40:34.891437+0000","last_clean":"2024-04-23T23:40:34.891437+0000","last_became_active":"2024-04-23T23:40:04.823583+0000","last_became_peered":"2024-04-23T23:40:04.823583+0000","last_unstale":"2024-04-23T23:40:34.891437+0000","last_undegraded":"2024-04-23T23:40:34.891437+0000","last_fullsized":"2024-04-23T23:40:34.891437+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:41:16.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"181'770","reported_seq":4160,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-04-23T23:40:36.900038+0000","last_change":"2024-04-23T23:40:36.900684+0000","last_active":"2024-04-23T23:40:36.900038+0000","last_peered":"2024-04-23T23:40:36.900038+0000","last_clean":"2024-04-23T23:40:36.900038+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:40:36.900038+0000","last_undegraded":"2024-04-23T23:40:36.900038+0000","last_fullsized":"2024-04-23T23:40:36.900038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:39:23.569341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082006799999999997,"stat_sum":{"num_bytes":19045386,"num_objects":42,"num_object_clones":2,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":33,"num_read":5563,"num_read_kb":13091,"num_write":927,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"9"}]},{"pgid":"2.3","version":"0'0","reported_seq":228,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.886091+0000","last_change":"2024-04-23T23:40:16.836919+0000","last_active":"2024-04-23T23:40:34.886091+0000","last_peered":"2024-04-23T23:40:34.886091+0000","last_clean":"2024-04-23T23:40:34.886091+0000","last_became_active":"2024-04-23T23:40:16.836621+0000","last_became_peered":"2024-04-23T23:40:16.836621+0000","last_unstale":"2024-04-23T23:40:34.886091+0000","last_undegraded":"2024-04-23T23:40:34.886091+0000","last_fullsized":"2024-04-23T23:40:34.886091+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:07.521924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":471,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.891562+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:40:34.891562+0000","last_peered":"2024-04-23T23:40:34.891562+0000","last_clean":"2024-04-23T23:40:34.891562+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:40:34.891562+0000","last_undegraded":"2024-04-23T23:40:34.891562+0000","last_fullsized":"2024-04-23T23:40:34.891562+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"183'506","reported_seq":21131,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.897295+0000","last_change":"2024-04-23T23:40:34.897295+0000","last_active":"2024-04-23T23:40:34.897295+0000","last_peered":"2024-04-23T23:40:34.897295+0000","last_clean":"2024-04-23T23:40:34.897295+0000","last_became_active":"2024-04-23T23:40:04.824769+0000","last_became_peered":"2024-04-23T23:40:04.824769+0000","last_unstale":"2024-04-23T23:40:34.897295+0000","last_undegraded":"2024-04-23T23:40:34.897295+0000","last_fullsized":"2024-04-23T23:40:34.897295+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:15:42.504404+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.005555351,"stat_sum":{"num_bytes":2798560,"num_objects":55,"num_object_clones":1,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":47,"num_read":20121,"num_read_kb":46295,"num_write":563,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.9","version":"181'528","reported_seq":5817,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.892720+0000","last_change":"2024-04-23T23:40:34.894203+0000","last_active":"2024-04-23T23:40:34.892720+0000","last_peered":"2024-04-23T23:40:34.892720+0000","last_clean":"2024-04-23T23:40:34.892720+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:40:34.892720+0000","last_undegraded":"2024-04-23T23:40:34.892720+0000","last_fullsized":"2024-04-23T23:40:34.892720+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":528,"log_dups_size":0,"ondisk_log_size":528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:28:47.951575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020872460000000001,"stat_sum":{"num_bytes":5800010,"num_objects":57,"num_object_clones":2,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":45,"num_read":5578,"num_read_kb":29592,"num_write":428,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.a","version":"183'1004","reported_seq":13937,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:35.018535+0000","last_change":"2024-04-23T23:40:34.893221+0000","last_active":"2024-04-23T23:40:35.018535+0000","last_peered":"2024-04-23T23:40:35.018535+0000","last_clean":"2024-04-23T23:40:35.018535+0000","last_became_active":"2024-04-23T23:39:05.815581+0000","last_became_peered":"2024-04-23T23:39:05.815581+0000","last_unstale":"2024-04-23T23:40:35.018535+0000","last_undegraded":"2024-04-23T23:40:35.018535+0000","last_fullsized":"2024-04-23T23:40:35.018535+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1004,"log_dups_size":0,"ondisk_log_size":1004,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:12:10.660153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083802400000000004,"stat_sum":{"num_bytes":4953516,"num_objects":45,"num_object_clones":1,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":32,"num_read":16139,"num_read_kb":43537,"num_write":1152,"num_write_kb":20598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.b","version":"183'580","reported_seq":14729,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.973596+0000","last_change":"2024-04-23T23:40:34.894367+0000","last_active":"2024-04-23T23:40:34.973596+0000","last_peered":"2024-04-23T23:40:34.973596+0000","last_clean":"2024-04-23T23:40:34.973596+0000","last_became_active":"2024-04-23T23:40:17.845508+0000","last_became_peered":"2024-04-23T23:40:17.845508+0000","last_unstale":"2024-04-23T23:40:34.973596+0000","last_undegraded":"2024-04-23T23:40:34.973596+0000","last_fullsized":"2024-04-23T23:40:34.973596+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":580,"log_dups_size":0,"ondisk_log_size":580,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:32:17.668248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048223950000000002,"stat_sum":{"num_bytes":12517913,"num_objects":51,"num_object_clones":2,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":40,"num_read":14269,"num_read_kb":53899,"num_write":520,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":488,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.c","version":"184'437","reported_seq":17337,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-04-23T23:40:36.900782+0000","last_change":"2024-04-23T23:40:36.901583+0000","last_active":"2024-04-23T23:40:36.900782+0000","last_peered":"2024-04-23T23:40:36.900782+0000","last_clean":"2024-04-23T23:40:36.900782+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:40:36.900782+0000","last_undegraded":"2024-04-23T23:40:36.900782+0000","last_fullsized":"2024-04-23T23:40:36.900782+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:13:02.621651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001172544,"stat_sum":{"num_bytes":16686508,"num_objects":61,"num_object_clones":2,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":45,"num_read":16677,"num_read_kb":60953,"num_write":379,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"9"}]},{"pgid":"3.d","version":"180'605","reported_seq":15415,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-04-23T23:40:36.902022+0000","last_change":"2024-04-23T23:40:36.902402+0000","last_active":"2024-04-23T23:40:36.902022+0000","last_peered":"2024-04-23T23:40:36.902022+0000","last_clean":"2024-04-23T23:40:36.902022+0000","last_became_active":"2024-04-23T23:39:33.820772+0000","last_became_peered":"2024-04-23T23:39:33.820772+0000","last_unstale":"2024-04-23T23:40:36.902022+0000","last_undegraded":"2024-04-23T23:40:36.902022+0000","last_fullsized":"2024-04-23T23:40:36.902022+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":605,"log_dups_size":0,"ondisk_log_size":605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:48:11.650402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057425900000000003,"stat_sum":{"num_bytes":4394854,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":491,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"d","length":"9"}]},{"pgid":"3.e","version":"183'791","reported_seq":5322,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.887565+0000","last_change":"2024-04-23T23:40:34.887565+0000","last_active":"2024-04-23T23:40:34.887565+0000","last_peered":"2024-04-23T23:40:34.887565+0000","last_clean":"2024-04-23T23:40:34.887565+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:40:34.887565+0000","last_undegraded":"2024-04-23T23:40:34.887565+0000","last_fullsized":"2024-04-23T23:40:34.887565+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:41:48.515343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011317059999999999,"stat_sum":{"num_bytes":46689653,"num_objects":55,"num_object_clones":3,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":41,"num_read":7181,"num_read_kb":28969,"num_write":897,"num_write_kb":10371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.f","version":"182'703","reported_seq":11941,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.896178+0000","last_change":"2024-04-23T23:40:34.896517+0000","last_active":"2024-04-23T23:40:34.896178+0000","last_peered":"2024-04-23T23:40:34.896178+0000","last_clean":"2024-04-23T23:40:34.896178+0000","last_became_active":"2024-04-23T23:39:35.820757+0000","last_became_peered":"2024-04-23T23:39:35.820757+0000","last_unstale":"2024-04-23T23:40:34.896178+0000","last_undegraded":"2024-04-23T23:40:34.896178+0000","last_fullsized":"2024-04-23T23:40:34.896178+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":703,"log_dups_size":0,"ondisk_log_size":703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:32:00.064747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041991650000000004,"stat_sum":{"num_bytes":2014765,"num_objects":54,"num_object_clones":1,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":47,"num_read":12346,"num_read_kb":51223,"num_write":724,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.10","version":"182'599","reported_seq":27007,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.885896+0000","last_change":"2024-04-23T23:40:34.886280+0000","last_active":"2024-04-23T23:40:34.885896+0000","last_peered":"2024-04-23T23:40:34.885896+0000","last_clean":"2024-04-23T23:40:34.885896+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:40:34.885896+0000","last_undegraded":"2024-04-23T23:40:34.885896+0000","last_fullsized":"2024-04-23T23:40:34.885896+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:50.340968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050493800000000002,"stat_sum":{"num_bytes":4127416,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":634,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.11","version":"179'473","reported_seq":8261,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.892056+0000","last_change":"2024-04-23T23:40:34.892564+0000","last_active":"2024-04-23T23:40:34.892056+0000","last_peered":"2024-04-23T23:40:34.892056+0000","last_clean":"2024-04-23T23:40:34.892056+0000","last_became_active":"2024-04-23T23:39:33.118919+0000","last_became_peered":"2024-04-23T23:39:33.118919+0000","last_unstale":"2024-04-23T23:40:34.892056+0000","last_undegraded":"2024-04-23T23:40:34.892056+0000","last_fullsized":"2024-04-23T23:40:34.892056+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:39.811371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000641505,"stat_sum":{"num_bytes":34133001,"num_objects":54,"num_object_clones":4,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":39,"num_read":7166,"num_read_kb":67518,"num_write":398,"num_write_kb":19044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.12","version":"183'778","reported_seq":7646,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.896279+0000","last_change":"2024-04-23T23:40:34.896279+0000","last_active":"2024-04-23T23:40:34.896279+0000","last_peered":"2024-04-23T23:40:34.896279+0000","last_clean":"2024-04-23T23:40:34.896279+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:40:34.896279+0000","last_undegraded":"2024-04-23T23:40:34.896279+0000","last_fullsized":"2024-04-23T23:40:34.896279+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:07:41.576909+0000","scrub_duration":0,"objects_trimmed":1,"snaptrim_duration":0.0071810040000000004,"stat_sum":{"num_bytes":6147743,"num_objects":58,"num_object_clones":1,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":43,"num_read":9695,"num_read_kb":43222,"num_write":996,"num_write_kb":24020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"f","length":"7"}]},{"pgid":"3.13","version":"180'405","reported_seq":5111,"reported_epoch":183,"state":"active+clean","last_fresh":"2024-04-23T23:40:34.894997+0000","last_change":"2024-04-23T23:40:34.896107+0000","last_active":"2024-04-23T23:40:34.894997+0000","last_peered":"2024-04-23T23:40:34.894997+0000","last_clean":"2024-04-23T23:40:34.894997+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:40:34.894997+0000","last_undegraded":"2024-04-23T23:40:34.894997+0000","last_fullsized":"2024-04-23T23:40:34.894997+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:49:46.985503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.004408258,"stat_sum":{"num_bytes":5369963,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":34,"num_read":4924,"num_read_kb":30267,"num_write":365,"num_write_kb":10329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"f","length":"7"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":415059036,"num_objects":1666,"num_object_clones":40,"num_object_copies":3332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1666,"num_whiteouts":1315,"num_read":355472,"num_read_kb":1267758,"num_write":23326,"num_write_kb":705285,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9227,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97071104,"data_stored":108961736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":21072,"ondisk_log_size":21072,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71640,"kb_used_data":14080,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94300200,"statfs":{"total":96636764160,"available":96563404800,"internally_reserved":0,"allocated":14417920,"data_stored":13195564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":77096,"kb_used_data":19544,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94294744,"statfs":{"total":96636764160,"available":96557817856,"internally_reserved":0,"allocated":20013056,"data_stored":26373871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":52196,"kb_used_data":7120,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94319644,"statfs":{"total":96636764160,"available":96583315456,"internally_reserved":0,"allocated":7290880,"data_stored":6396145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855394,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":70988,"kb_used_data":12344,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94300852,"statfs":{"total":96636764160,"available":96564072448,"internally_reserved":0,"allocated":12640256,"data_stored":11860494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69384,"kb_used_data":11840,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302456,"statfs":{"total":96636764160,"available":96565714944,"internally_reserved":0,"allocated":12124160,"data_stored":15267388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":631360192521,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49384,"kb_used_data":18200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94322456,"statfs":{"total":96636764160,"available":96586194944,"internally_reserved":0,"allocated":18636800,"data_stored":21383885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":80860,"kb_used_data":23308,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94290980,"statfs":{"total":96636764160,"available":96553963520,"internally_reserved":0,"allocated":23867392,"data_stored":30249679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12804096,"data_stored":12551936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12144640,"data_stored":12077147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12312576,"data_stored":12256157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5926912,"data_stored":6279334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10407936,"data_stored":10772589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4825088,"data_stored":5067534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9396224,"data_stored":9095413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:40:39.536 INFO:tasks.thrashosds.thrasher:Setting 3.6 to [2, 3, 6, 5] 2024-04-23T23:40:39.537 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.6', '2', '3', '6', '5'] 2024-04-23T23:40:39.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.6 2 3 6 5 2024-04-23T23:40:39.538 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:39.622 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:39.634+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:39.682 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:39.682 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:39.691 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:39.732 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:39.745+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:39.806 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:39.818+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:39.833 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:39.834 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:39.842 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:39.904 INFO:teuthology.orchestra.run.smithi077.stderr:set 3.6 pg_upmap_items mapping to [2->3,6->5] 2024-04-23T23:40:39.906 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:39.919+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:39.997 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:39.997 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.006 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:40.008 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:40.020+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:40.108 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:40.121+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:40.109 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.109 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:40.209 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:40.222+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:40.260 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.260 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:40.312 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:40.325+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:40.372 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.372 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:40.410 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:40.423+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:40.512 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:40.524+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:40.523 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.523 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:40.613 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:40.626+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:40.673 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.673 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:40.725 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:40.738+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:40.784 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.784 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:40.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-23T23:40:40.834 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:40.846+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:40.916 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:40.929+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:40.944 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:40.945 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:40.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:41.038 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:41.051+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:41.099 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:41.099 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:41.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:41.149 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:41.161+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:41.219 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:41.232+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:41.250 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:41.250 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:41.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:41.343 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:41.355+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:41.401 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:41.401 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:41.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:41.451 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:41.463+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:41.522 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:41.535+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:41.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:41.553 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:41.553 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:41.562 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:41.646 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:41.659+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:41.658 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:41.658 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:41.676 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:41.676 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:41.693 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:41.693 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:41.710 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:41.710 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:41.719 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [ 2024-04-23T23:40:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.719 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:10670 3.0 e31/21 3:001f5e85:::rbd_data.11943f90bac1.0000000000000002:head v 31'36, mlcod=29'34)", 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 173.32204724299999, 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.074611882000000004, 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409036+0000", 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.409037+0000", 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8220000000000001e-06 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.721 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420188+0000", 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.011150663999999999 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420210+0000", 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.1780000000000002e-05 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420219+0000", 2024-04-23T23:40:41.722 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.2450000000000004e-06 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420283+0000", 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.3666999999999999e-05 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.420308+0000", 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.5649000000000001e-05 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.723 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483592+0000", 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.063283434 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:48.483647+0000", 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5621000000000002e-05 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.724 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:14872 3.0 e36/21 3:058730b1:::rbd_data.11943f90bac1.0000000000000001:head v 36'39, mlcod=33'37)", 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 164.322351389, 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.08925495, 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:41.725 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408731+0000", 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.408733+0000", 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.635e-06 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.726 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425121+0000", 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016387839000000001 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425144+0000", 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3271000000000001e-05 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.727 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425156+0000", 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.1956999999999999e-05 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425217+0000", 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0841000000000002e-05 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.425241+0000", 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.3937000000000001e-05 2024-04-23T23:40:41.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497924+0000", 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.072683190999999994 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:37:57.497986+0000", 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.2279000000000005e-05 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.729 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77884 3.0 e75/21 3:069e17af:::rbd_data.1194696b8826.0000000000000003:head v 75'261, mlcod=74'259)", 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 123.174490733, 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01778561, 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.730 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556592+0000", 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.731 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.556594+0000", 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.762e-06 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560329+0000", 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003734907 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560349+0000", 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0568999999999999e-05 2024-04-23T23:40:41.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560380+0000", 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0583000000000002e-05 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560451+0000", 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0937000000000002e-05 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.733 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.560492+0000", 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1230999999999999e-05 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574311+0000", 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.013818898 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.574378+0000", 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6723000000000005e-05 2024-04-23T23:40:41.734 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:77895 3.13 e75/62 3:cfd73d64:::rbd_data.1194696b8826.0000000000000009:head v 75'254, mlcod=71'252)", 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 123.155922502, 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.024361170000000001, 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.735 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575160+0000", 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.736 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.575162+0000", 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.6530000000000001e-06 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580773+0000", 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0056114199999999998 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.737 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580804+0000", 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.1115000000000003e-05 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580818+0000", 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3713000000000001e-05 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580899+0000", 2024-04-23T23:40:41.738 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.0853999999999995e-05 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.580922+0000", 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.2578e-05 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599468+0000", 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018546236000000001 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.739 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:38:38.599521+0000", 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3600999999999997e-05 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256584 3.18 e116/81 3:1f8de885:::rbd_data.1194768b745d.0000000000000004:head v 116'392, mlcod=114'390)", 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:41.740 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 73.479423933000007, 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.031172575000000001, 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.741 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.251659+0000", 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.9599999999999999e-07 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255229+0000", 2024-04-23T23:40:41.742 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0035693389999999999 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255249+0000", 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0322e-05 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255260+0000", 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0651e-05 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.743 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255338+0000", 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.7902000000000001e-05 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.255363+0000", 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.514e-05 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.744 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282755+0000", 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.027392133999999999 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.282831+0000", 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.6590999999999999e-05 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.745 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_repop(client.4500.0:256585 3.4 e116/21 3:27aee72c:::rbd_data.1194768b745d.0000000000000005:head v 116'368, mlcod=114'366)", 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 73.474798285000006, 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.026977067, 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:41.746 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256285+0000", 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.256286+0000", 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0869999999999999e-06 2024-04-23T23:40:41.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259422+0000", 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003136603 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259446+0000", 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.4009999999999999e-05 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.748 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259460+0000", 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3390999999999999e-05 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259543+0000", 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3559000000000004e-05 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.749 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.259571+0000", 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.8305000000000001e-05 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283221+0000", 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.023649083000000001 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.750 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:28.283262+0000", 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1029000000000003e-05 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:274403 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:head [write 0~0] snapc 36=[36] ondisk+write+known_if_redirected+supports_pool_eio e126)", 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 63.505573624, 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018338388000000001, 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.751 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 274403 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225509+0000", 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225511+0000", 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.511e-06 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.753 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225514+0000", 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.0429999999999999e-06 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225519+0000", 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4280000000000004e-06 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.225523+0000", 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.5049999999999999e-06 2024-04-23T23:40:41.754 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229144+0000", 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.0036213 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229238+0000", 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4065000000000001e-05 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.755 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "waiting for subops from 6", 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.229420+0000", 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000181724 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "op_commit", 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.232849+0000", 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.003428834 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243758+0000", 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.010909507000000001 2024-04-23T23:40:41.756 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "commit_sent", 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243809+0000", 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.0574000000000001e-05 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:38.243848+0000", 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.8896999999999997e-05 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.757 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276225 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 409600~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532756734000003, 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947856000000001, 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.758 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276225 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.759 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198326+0000", 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198327+0000", 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4900000000000001e-07 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.760 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198328+0000", 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8780000000000001e-06 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198334+0000", 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7880000000000003e-06 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.761 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198347+0000", 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.3271000000000001e-05 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215091+0000", 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016743826999999999 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215170+0000", 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.8829e-05 2024-04-23T23:40:41.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215274+0000", 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010381400000000001 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276226 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 606208~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:41.763 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532728849999998, 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017115709999999999, 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276226 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.764 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198354+0000", 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4499999999999997e-07 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.765 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198356+0000", 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0379999999999998e-06 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198363+0000", 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.28e-06 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198368+0000", 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.8409999999999999e-06 2024-04-23T23:40:41.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215315+0000", 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.016947090000000001 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215368+0000", 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3239000000000003e-05 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215470+0000", 2024-04-23T23:40:41.767 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101777 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276227 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 770048~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532709681, 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017330037999999999, 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.768 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276227 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198373+0000", 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.769 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198374+0000", 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198375+0000", 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8700000000000001e-06 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.770 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198381+0000", 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.0209999999999996e-06 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198386+0000", 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215514+0000", 2024-04-23T23:40:41.771 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017127972000000002 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215600+0000", 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6077999999999998e-05 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215703+0000", 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000103235 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.772 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276228 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 802816~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532691468000003, 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017521873, 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.773 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276228 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.774 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198391+0000", 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198392+0000", 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.7899999999999999e-07 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198394+0000", 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.775 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198399+0000", 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1839999999999998e-06 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198404+0000", 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7899999999999999e-06 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215763+0000", 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017359290999999999 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215842+0000", 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.9228999999999996e-05 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215913+0000", 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.1120999999999999e-05 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.777 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276229 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 966656~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532662746, 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017675847000000001, 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276229 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198420+0000", 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.779 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198421+0000", 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4700000000000002e-07 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198423+0000", 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.351e-06 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198429+0000", 2024-04-23T23:40:41.780 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9100000000000002e-06 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198433+0000", 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6589999999999998e-06 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215930+0000", 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017496214 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.781 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.215991+0000", 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.1314000000000003e-05 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216096+0000", 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.00010495199999999999 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.782 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276230 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1163264~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.53264308, 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017891267999999998, 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276230 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.783 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.784 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198440+0000", 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.2800000000000002e-07 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198442+0000", 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9549999999999999e-06 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198448+0000", 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7250000000000002e-06 2024-04-23T23:40:41.785 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198452+0000", 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.442e-06 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216149+0000", 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017696877999999999 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.786 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216236+0000", 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.6847000000000004e-05 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216331+0000", 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 9.4993000000000003e-05 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276231 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1359872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.787 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532624540999997, 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018042327, 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276231 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.788 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198458+0000", 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198459+0000", 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.2000000000000001e-07 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.789 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198465+0000", 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.7989999999999996e-06 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198476+0000", 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.0587999999999999e-05 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.790 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198481+0000", 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1819999999999997e-06 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216366+0000", 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.017884740999999999 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216436+0000", 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.0000999999999996e-05 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.791 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216501+0000", 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.4696000000000005e-05 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276232 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1523712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532594520000004, 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018201742999999999, 2024-04-23T23:40:41.792 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276232 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:41.793 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198488+0000", 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198489+0000", 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.7199999999999999e-07 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198491+0000", 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0940000000000002e-06 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198497+0000", 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7320000000000003e-06 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198502+0000", 2024-04-23T23:40:41.795 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3680000000000001e-06 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216595+0000", 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018092772999999999 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216638+0000", 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.3430999999999998e-05 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.796 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216690+0000", 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.1873000000000003e-05 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276233 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1720320~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532574451999999, 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018351136000000001, 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.797 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276233 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.798 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198508+0000", 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198509+0000", 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.32e-07 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.799 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198511+0000", 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.928e-06 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198516+0000", 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5489999999999997e-06 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198521+0000", 2024-04-23T23:40:41.800 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.656e-06 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216718+0000", 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018196927000000002 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216776+0000", 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.7821000000000001e-05 2024-04-23T23:40:41.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216859+0000", 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.3823e-05 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276234 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 1916928~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:41.802 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532556253000003, 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018523181999999999, 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276234 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.803 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198527+0000", 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.6300000000000001e-07 2024-04-23T23:40:41.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198529+0000", 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.852e-06 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198534+0000", 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4859999999999997e-06 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198539+0000", 2024-04-23T23:40:41.805 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4719999999999997e-06 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216924+0000", 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018385656 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.216991+0000", 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 6.6229999999999994e-05 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.806 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217050+0000", 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.9123000000000003e-05 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276235 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2080768~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532538565000003, 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018668724000000001, 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.807 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276235 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.808 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198544+0000", 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198545+0000", 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198546+0000", 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.8479999999999999e-06 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.809 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198552+0000", 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5729999999999998e-06 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198557+0000", 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.6369999999999998e-06 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217085+0000", 2024-04-23T23:40:41.810 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018528663000000001 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217138+0000", 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.2468e-05 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217213+0000", 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.5129000000000005e-05 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276236 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2113536~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532520663, 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018812986, 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.812 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276236 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198562+0000", 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.813 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198563+0000", 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 3.9099999999999999e-07 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198565+0000", 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 2.0490000000000002e-06 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198570+0000", 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.5029999999999997e-06 2024-04-23T23:40:41.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198575+0000", 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.4469999999999999e-06 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217248+0000", 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018673286000000001 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217302+0000", 2024-04-23T23:40:41.815 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.3763e-05 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217375+0000", 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 7.3547000000000006e-05 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: "description": "osd_op(client.4500.0:276237 3.1e 3:7da80972:::rbd_data.1194f2b92c37.0000000000000001:36 [read 2277376~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e127)", 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: "initiated_at": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:41.816 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 62.532502630000003, 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.01901485, 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "continuous": false, 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "type_data": { 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "flag_point": "started", 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "client_info": { 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "client": "client.4500", 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "tid": 276237 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "events": [ 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.817 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "initiated", 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "header_read", 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198580+0000", 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "throttled", 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198581+0000", 2024-04-23T23:40:41.818 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.0900000000000002e-07 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "all_read", 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198583+0000", 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 1.9309999999999998e-06 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "dispatched", 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198588+0000", 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.819 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.198592+0000", 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 4.1339999999999997e-06 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "reached_pg", 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217409+0000", 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.018816685 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "started", 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217494+0000", 2024-04-23T23:40:41.820 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 8.4852999999999995e-05 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: "event": "done", 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: "time": "2024-04-23T23:39:39.217595+0000", 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 0.000101418 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:41.821 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:41.823 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:41.823 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:41.824 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:41.824 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:41.824 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:41.825 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:41.825 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:41.825 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:41.826 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:41.826 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:41.835+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:41.912 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is set 2024-04-23T23:40:41.924 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:41.937+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:297173 3.1c 3:3e6714d9:::rbd_header.11942420a0c9:head [call lock.unlock in=52b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e190)", 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:40:41.959374+0000", 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 0.00064203100000000005, 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00067096500000000004, 2024-04-23T23:40:41.947 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "waiting for sub ops", 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 297173 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959374+0000", 2024-04-23T23:40:41.948 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959374+0000", 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959374+0000", 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8400000000000004e-07 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.949 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959378+0000", 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.4529999999999998e-06 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959387+0000", 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0790000000000007e-06 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.950 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959392+0000", 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4179999999999996e-06 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959429+0000", 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6523999999999998e-05 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959489+0000", 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9919e-05 2024-04-23T23:40:41.951 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 5", 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.959581+0000", 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.2696999999999997e-05 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:40:41.960021+0000", 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000439665 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:41.952 INFO:teuthology.orchestra.run.smithi170.stdout: ], 2024-04-23T23:40:41.953 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 1 2024-04-23T23:40:41.953 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:41.957 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:42.042 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:42.055+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:42.101 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:42.101 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:42.101 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:42.101 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:42.101 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:42.110 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:42.125 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:42.138+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:42.226 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:42.239+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:28790 3.11 3:8bd6e708:::rbd_data.11944d925ee6.000000000000002c:head [delete] snapc b=[b] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:42.255 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 157.27731403600001, 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.94106838500000001, 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 28790 2024-04-23T23:40:42.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988912+0000", 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988913+0000", 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8599999999999998e-07 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988917+0000", 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7900000000000001e-06 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988925+0000", 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3739999999999998e-06 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988932+0000", 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1930000000000004e-06 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988985+0000", 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2825999999999999e-05 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:04.988996+0000", 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0812000000000001e-05 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927594+0000", 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.93859802199999998 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927785+0000", 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000190788 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for subops from 7", 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.927979+0000", 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00019479 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "op_commit", 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.928963+0000", 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00098378300000000001 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "sub_op_commit_rec", 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929877+0000", 2024-04-23T23:40:42.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000913319 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "commit_sent", 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929938+0000", 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0931999999999999e-05 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:05.929981+0000", 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3069999999999999e-05 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:115927 3.1a 3.ac0e573a (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e94)", 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 102.37355961900001, 2024-04-23T23:40:42.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.005836033, 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 115927 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892667+0000", 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892668+0000", 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.409e-06 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892674+0000", 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8320000000000002e-06 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892685+0000", 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1238e-05 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.892694+0000", 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6349999999999995e-06 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897931+0000", 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0052368379999999997 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:38:59.897939+0000", 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0770000000000008e-06 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898490+0000", 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0005511499999999 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:00.898503+0000", 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2853999999999999e-05 2024-04-23T23:40:42.271 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:117080 3.f 3:f3a65002:::rbd_data.1194d32c460f.0000000000000002:head [sparse-read 0~1048576] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104)", 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:42.272 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 92.257309370000002, 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81151329100000003, 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 117080 2024-04-23T23:40:42.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008917+0000", 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008918+0000", 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3459999999999999e-06 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008925+0000", 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2139999999999999e-06 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008946+0000", 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0196000000000001e-05 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.008961+0000", 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5238999999999999e-05 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009107+0000", 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00014602699999999999 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.009114+0000", 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7039999999999997e-06 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819410+0000", 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.81029653999999995 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.819508+0000", 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8031999999999999e-05 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:10.820430+0000", 2024-04-23T23:40:42.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00092199299999999997 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:271682 3.14 3.1a400b14 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.088007219000005, 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64759451400000001, 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.279 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 271682 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178219+0000", 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0499999999999999e-07 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178222+0000", 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1749999999999999e-06 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178228+0000", 2024-04-23T23:40:42.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2199999999999997e-06 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.178233+0000", 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.724e-06 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179250+0000", 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001017724 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.179262+0000", 2024-04-23T23:40:42.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2004000000000001e-05 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825807+0000", 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.646544585 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825814+0000", 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6769999999999998e-06 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.283 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269222 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080483369999996, 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64010147799999995, 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269222 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185743+0000", 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185744+0000", 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.108e-06 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185749+0000", 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5499999999999996e-06 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185760+0000", 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1069e-05 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185767+0000", 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3499999999999999e-06 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185834+0000", 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7294999999999999e-05 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185845+0000", 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0363999999999999e-05 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825837+0000", 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63999226899999995 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825844+0000", 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4730000000000003e-06 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269224 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080430817000007, 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007260399999999, 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.288 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269224 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185795+0000", 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185796+0000", 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3099999999999997e-07 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185799+0000", 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8200000000000001e-06 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185807+0000", 2024-04-23T23:40:42.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7880000000000007e-06 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185813+0000", 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.353e-06 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185869+0000", 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6350000000000001e-05 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185876+0000", 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.759e-06 2024-04-23T23:40:42.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825861+0000", 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63998502000000002 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825868+0000", 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.883e-06 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269226 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.292 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080404016000003, 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007051800000003, 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269226 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:42.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185822+0000", 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185823+0000", 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8100000000000003e-07 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185825+0000", 2024-04-23T23:40:42.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6460000000000002e-06 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185832+0000", 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5440000000000004e-06 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185837+0000", 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4199999999999998e-06 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186200+0000", 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00036300200000000002 2024-04-23T23:40:42.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186216+0000", 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5235999999999999e-05 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825886+0000", 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63967030599999997 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825893+0000", 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7830000000000001e-06 2024-04-23T23:40:42.296 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269228 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080380137999995, 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007168599999997, 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269228 2024-04-23T23:40:42.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185846+0000", 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185847+0000", 2024-04-23T23:40:42.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3000000000000001e-07 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185849+0000", 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3360000000000002e-06 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185856+0000", 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6630000000000004e-06 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185861+0000", 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.259e-06 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186263+0000", 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00040254800000000002 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186272+0000", 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.7860000000000002e-06 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825911+0000", 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63963866800000002 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825918+0000", 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8959999999999997e-06 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269252 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.301 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080358296, 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.64007530899999998, 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269252 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185868+0000", 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5200000000000002e-07 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185871+0000", 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1449999999999998e-06 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185877+0000", 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4799999999999998e-06 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.185882+0000", 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8250000000000004e-06 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186300+0000", 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00041792199999999999 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186308+0000", 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2339999999999994e-06 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825936+0000", 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63962807099999996 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825943+0000", 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1799999999999999e-06 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269253 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080148742000006, 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63989032300000004, 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.306 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269253 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186077+0000", 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186078+0000", 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0500000000000003e-07 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186082+0000", 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.5860000000000001e-06 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186093+0000", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0878e-05 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186099+0000", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186365+0000", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026594999999999999 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186376+0000", 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0448000000000001e-05 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825961+0000", 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.639584865 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825968+0000", 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0729999999999999e-06 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.310 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269255 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080099504000003, 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63986625100000005, 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269255 2024-04-23T23:40:42.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186127+0000", 2024-04-23T23:40:42.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-07 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186130+0000", 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.061e-06 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186142+0000", 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.1452e-05 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186148+0000", 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.84e-06 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186413+0000", 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00026560400000000001 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186422+0000", 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6289999999999999e-06 2024-04-23T23:40:42.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825986+0000", 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63956385100000002 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.825993+0000", 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2450000000000001e-06 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269257 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.315 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080054500000003, 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63984629400000004, 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269257 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186172+0000", 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.44e-07 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186175+0000", 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.655e-06 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186189+0000", 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.3848e-05 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186198+0000", 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.6679999999999996e-06 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.318 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186454+0000", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00025548699999999999 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186462+0000", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5459999999999992e-06 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826011+0000", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63954860400000002 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826018+0000", 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9419999999999998e-06 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269258 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.080019481999997, 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63983631699999999, 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.320 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269258 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186207+0000", 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1600000000000002e-07 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186214+0000", 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4899999999999997e-06 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186220+0000", 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6749999999999996e-06 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186229+0000", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9889999999999998e-06 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186578+0000", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000348971 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186587+0000", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6510000000000007e-06 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826036+0000", 2024-04-23T23:40:42.323 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63944900299999996 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826043+0000", 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1219999999999997e-06 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269291 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079678099000006, 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951985700000002, 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.324 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269291 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186548+0000", 2024-04-23T23:40:42.325 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186549+0000", 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-07 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186553+0000", 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1829999999999996e-06 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186564+0000", 2024-04-23T23:40:42.326 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0575e-05 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186571+0000", 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169999999999999e-06 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186617+0000", 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5772999999999997e-05 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.327 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186625+0000", 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5700000000000004e-06 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826061+0000", 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63943612400000005 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826068+0000", 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0940000000000002e-06 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.328 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269292 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079643335, 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63950905300000005, 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269292 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.329 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186583+0000", 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5599999999999995e-07 2024-04-23T23:40:42.330 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186586+0000", 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6690000000000002e-06 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186592+0000", 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7570000000000001e-06 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186597+0000", 2024-04-23T23:40:42.331 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2920000000000003e-06 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186807+0000", 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00020953700000000001 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186816+0000", 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4169999999999998e-06 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.332 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826085+0000", 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926907799999999 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826092+0000", 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7469999999999999e-06 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269293 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.333 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079620579999997, 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63951093800000003, 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269293 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.334 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186606+0000", 2024-04-23T23:40:42.335 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4799999999999999e-07 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186618+0000", 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2149e-05 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186628+0000", 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7429999999999997e-06 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.336 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186633+0000", 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2429999999999996e-06 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186965+0000", 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00033134499999999998 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186973+0000", 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8349999999999993e-06 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.337 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826110+0000", 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63913630099999996 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826117+0000", 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8739999999999997e-06 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.338 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269294 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079347948999995, 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63926292200000001, 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269294 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.339 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186878+0000", 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186879+0000", 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2200000000000004e-07 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.340 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186882+0000", 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.728e-06 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186892+0000", 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0477e-05 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186900+0000", 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8800000000000008e-06 2024-04-23T23:40:42.341 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187000+0000", 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000100091 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187007+0000", 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.08e-06 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826134+0000", 2024-04-23T23:40:42.342 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63912730799999995 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826141+0000", 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7360000000000004e-06 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269295 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079315319000003, 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63925570899999995, 2024-04-23T23:40:42.343 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269295 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.344 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186911+0000", 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.51e-07 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186914+0000", 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6419999999999999e-06 2024-04-23T23:40:42.345 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186921+0000", 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8050000000000001e-06 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.186926+0000", 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3750000000000002e-06 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187097+0000", 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00017034400000000001 2024-04-23T23:40:42.346 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187104+0000", 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6990000000000003e-06 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826159+0000", 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63905446300000002 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826167+0000", 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8299999999999996e-06 2024-04-23T23:40:42.347 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269326 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079110104999998, 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63907548199999997, 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.348 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269326 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187116+0000", 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.349 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187117+0000", 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5099999999999999e-07 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187121+0000", 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7100000000000001e-06 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187129+0000", 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2619999999999998e-06 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.350 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187135+0000", 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2879999999999998e-06 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187180+0000", 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5370000000000001e-05 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187188+0000", 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8120000000000008e-06 2024-04-23T23:40:42.351 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826185+0000", 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63899637200000003 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826192+0000", 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.917e-06 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.352 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:269336 3.14 3.2d709714 (undecoded) ondisk+retry+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.079027108000005, 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63901756799999998, 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "reached pg", 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 269336 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.353 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187199+0000", 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187200+0000", 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.354 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187203+0000", 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8399999999999999e-06 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187209+0000", 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4849999999999997e-06 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187215+0000", 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.485e-06 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.355 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187254+0000", 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9483999999999997e-05 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.187262+0000", 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2120000000000003e-06 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826210+0000", 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.63894750300000003 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.356 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.826217+0000", 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9840000000000004e-06 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.357 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:42.359 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:42.359 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:42.371+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:42.459 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:42.471+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:42.501 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:42.501 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:42.501 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:42.501 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:42.510 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:42.559 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:42.572+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:42.611 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:42.611 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:42.612 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:42.612 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:42.612 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:42.620 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:42.660 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:42.673+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:42.762 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:42.774+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397536283999997, 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.765 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.769 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397517547999996, 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.773 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397499167999996, 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.774 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:42.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:42.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:42.778 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397479970999996, 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.782 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397243684000003, 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.783 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.784 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.785 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.786 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397217523999998, 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.787 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.788 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.789 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:42.790 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.791 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397197855000002, 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.792 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:42.793 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.794 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.795 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.397179434999998, 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.796 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.797 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:42.798 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.799 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:42.800 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.39703274, 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.801 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:42.802 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.803 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.804 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.395877311000007, 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.805 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.806 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.807 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.808 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.395561599000004, 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.809 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.810 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.811 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.812 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.813 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.395539568000004, 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.814 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.815 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.816 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:42.817 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.395519002, 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.818 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.819 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:42.820 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:42.821 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:42.822 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.395498177999997, 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.823 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:42.824 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.825 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.826 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 83.393049813999994, 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.827 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:42.828 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:42.829 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:42.830 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.897036039, 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.831 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.832 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:42.833 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.834 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:42.835 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.897019811000007, 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.836 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:42.837 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:42.838 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.839 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.897003569999995, 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.840 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.841 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.842 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.843 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.896988327000003, 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:42.844 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.845 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.846 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.847 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 82.896972242000004, 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:42.848 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:42.849 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.850 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:42.851 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:42.852 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:42.853 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:42.897 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:42.910+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:42.961 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:42.961 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:42.961 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:42.963 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:42.976+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:42.971 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:43.064 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:43.077+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:43.114 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:43.114 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:43.114 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:43.115 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:43.115 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:43.123 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:43.165 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:43.177+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426226849000003, 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:43.228 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.229 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.230 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:43.231 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:43.232 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.233 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426196348999994, 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:43.234 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:43.235 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:43.236 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.237 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426157472, 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.238 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.239 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.240 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.241 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.242 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426126822000001, 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.243 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.244 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:43.245 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.246 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426102460999999, 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:43.247 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.248 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.249 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.250 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:43.251 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426080885000005, 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:43.252 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:43.253 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:43.254 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:43.255 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.256 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426061039000004, 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:43.257 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.258 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:43.259 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:43.260 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426030996999998, 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.261 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:43.262 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.263 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:43.264 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:43.265 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.426003144999996, 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.266 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:43.267 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.268 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.269 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.270 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425979953999999, 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.271 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:43.272 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.273 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:43.274 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425873745999994, 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.275 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.276 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.277 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.278 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.279 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425839728, 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.280 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.281 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.282 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.283 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425813109000003, 2024-04-23T23:40:43.284 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.285 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.286 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.287 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.288 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425792389999998, 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.289 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.290 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:43.291 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:43.292 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.293 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425769420999998, 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:43.294 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:43.295 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.296 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.297 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.298 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425750402999995, 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:43.299 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:43.300 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.301 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:43.302 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425732222999997, 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.303 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.304 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:43.305 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.306 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.307 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425711595999999, 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.308 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.309 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:43.310 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:43.311 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:43.312 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425339475000001, 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.313 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.314 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.315 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:43.316 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.317 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.425284156000004, 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.318 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.319 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.320 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:43.321 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.322 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.323 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.323 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:43.324 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:43.324 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:43.337+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:43.425 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:43.437+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:43.467 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:43.467 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:43.467 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:43.467 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:43.476 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:43.525 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:43.538+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:43.577 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:43.578 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:43.578 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:43.578 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:43.578 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:43.586 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:43.626 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:43.638+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:43.689 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:43.689 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:43.689 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:43.689 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:43.689 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 94.882360351000003, 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.690 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.691 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.692 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:43.693 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872398938000003, 2024-04-23T23:40:43.694 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.695 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.696 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:43.697 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:43.698 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:43.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.699 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.699 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.699 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.701 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.701 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.701 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:43.701 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872381563000005, 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.702 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.703 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.704 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.705 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872364118999997, 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.706 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.707 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.708 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.709 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.710 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872228336000006, 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.711 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.712 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:43.713 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.714 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.715 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872209456999997, 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.716 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.717 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.718 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:43.719 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872192081999998, 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.720 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.721 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:43.722 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:43.723 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.724 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872020436, 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.725 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.726 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.727 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.728 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.872003573000001, 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:43.729 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.730 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:43.731 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:43.732 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:43.733 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.871986473999996, 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:43.734 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.735 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.736 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.737 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.871346070000001, 2024-04-23T23:40:43.738 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.739 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.740 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:43.741 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:43.742 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.871278129999993, 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:43.743 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:43.744 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.745 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.746 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.871094107999994, 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:43.747 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.748 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.749 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.750 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:43.751 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870738298999996, 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.752 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:43.753 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:43.754 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:43.755 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.756 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870669845999998, 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:43.757 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:43.758 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.759 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.760 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870594808999996, 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.761 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.762 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:43.763 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:43.764 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.765 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870509428000005, 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:43.766 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:43.767 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:43.768 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:43.769 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870245249999996, 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.770 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.771 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.772 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.773 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.774 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870175290999995, 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:43.775 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:43.776 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.777 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.778 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:43.779 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 69.870107427999997, 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.780 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.781 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:43.782 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:43.783 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:43.784 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:43.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:43.786 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:43.798+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:43.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-23T23:40:43.886 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:43.899+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:43.920 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:43.921 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:43.921 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:43.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-23T23:40:43.934 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:43.975 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:43.975 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:43.995 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:43.996 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:43.996 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:44.008+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:44.013 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:44.013 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:44.030 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:44.030 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:44.049 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:44.050 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:44.067 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:44.067 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:44.082 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.082 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.085 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:44.085 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:44.088 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:44.101+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:44.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:44.102 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:44.103 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:44.189 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:44.201+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:44.206 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.207 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.215 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-23T23:40:44.300 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:44.312+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:44.358 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.359 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-23T23:40:44.409 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:44.421+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:44.492 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:44.505+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:44.509 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.510 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-23T23:40:44.603 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:44.616+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:44.662 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.662 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-23T23:40:44.694 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:44.707+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:44.795 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:44.808+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:44.814 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.814 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-23T23:40:44.896 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:44.908+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:44.921 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 5, 6, 4, 7, 0] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 4, 6, 7, 5, 3] 2024-04-23T23:40:44.921 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-23T23:40:44.922 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-23T23:40:44.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-23T23:40:44.926 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:44.926 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:44.932 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is set 2024-04-23T23:40:44.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-23T23:40:45.031 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:45.044+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:45.097 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:45.110+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:45.100 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:45.101 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:45.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-23T23:40:45.198 INFO:tasks.ceph.osd.3.smithi077.stderr:2024-04-23T23:40:45.210+0000 7f30ed878640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 55616) UID: 0 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 193, 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "fsid": "f73eea51-5002-4eee-8d85-f2db649bc1b5", 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "created": "2024-04-23T23:37:04.013555+0000", 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "modified": "2024-04-23T23:40:44.932280+0000", 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "last_up_change": "2024-04-23T23:39:58.814990+0000", 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "last_in_change": "2024-04-23T23:40:09.918526+0000", 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_num": 5806080, 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_set": [ 2024-04-23T23:40:45.233 INFO:teuthology.orchestra.run.smithi077.stdout: "nodeep-scrub", 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "noscrub", 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "pglog_hardlimit", 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "purged_snapdirs", 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "recovery_deletes", 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "sortbitwise" 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_version": 6, 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "full_ratio": 0.94999998807907104, 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_snapshot": "", 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_max": 3, 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd": 8, 2024-04-23T23:40:45.234 INFO:teuthology.orchestra.run.smithi077.stdout: "require_min_compat_client": "luminous", 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "min_compat_client": "luminous", 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "require_osd_release": "squid", 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_crimson": false, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "pools": [ 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 1, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": ".mgr", 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:16.233938+0000", 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:45.235 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 1, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 1, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 1, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 1, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 1, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:45.236 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "17", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:45.237 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:45.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "options": { 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_max": 32, 2024-04-23T23:40:45.239 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_min": 1 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": {} 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 6.9000000953674316, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 6.9000000953674316, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.28999999165534973, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 2, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:45.240 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 2, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "rbd", 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:22.007673+0000", 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool", 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:45.241 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 8, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 8, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 8, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 8, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 8, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:45.242 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "20", 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 0, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 0, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:45.243 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:45.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:40:45.245 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 3.1600000858306885, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.7400000095367432, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 0.86000001430511475, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 2.7200000286102295, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.5, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "error_message": "pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.246 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": "pool_client.0", 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "create_time": "2024-04-23T23:37:30.028908+0000", 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 8193, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "type": 1, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 2, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": 1, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_rule": 0, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_count": 0, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_target": 0, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_barrier": 0, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "object_hash": 2, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscale_mode": "off", 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": 32, 2024-04-23T23:40:45.247 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num": 32, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_placement_num_target": 32, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_target": 32, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num_pending": 32, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "last_pg_merge_meta": { 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "source_pgid": "0.0", 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "ready_epoch": 0, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_started": 0, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "last_epoch_clean": 0, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "source_version": "0'0", 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "target_version": "0'0" 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.248 INFO:teuthology.orchestra.run.smithi077.stdout: "last_change": "193", 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend": "0", 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "last_force_op_resend_preluminous": "0", 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "auid": 0, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_mode": "selfmanaged", 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_seq": 58, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "snap_epoch": 193, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_snaps": [], 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps": "[]", 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_bytes": 0, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "quota_max_objects": 0, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "tiers": [], 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "tier_of": -1, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "read_tier": -1, 2024-04-23T23:40:45.249 INFO:teuthology.orchestra.run.smithi077.stdout: "write_tier": -1, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_mode": "none", 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_bytes": 0, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "target_max_objects": 0, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_flush_age": 0, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "cache_min_evict_age": 0, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profile": "", 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_params": { 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "none" 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.250 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_period": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_count": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "use_gmt_hitset": true, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "min_read_recency_for_promote": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "min_write_recency_for_promote": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_grade_decay_rate": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "hit_set_search_last_n": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "grade_table": [], 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "stripe_width": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "expected_num_objects": 0, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "fast_read": false, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "options": {}, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "application_metadata": { 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd": {} 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "read_balance": { 2024-04-23T23:40:45.251 INFO:teuthology.orchestra.run.smithi077.stdout: "score_type": "Fair distribution", 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "score_acting": 9.3299999237060547, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "score_stable": 1.9700000286102295, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "optimal_score": 1, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_acting": 9.3299999237060547, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "raw_score_stable": 1.9700000286102295, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity_weighted": 0.68213081359863281, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity": 0.77999997138977051, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "average_primary_affinity_weighted": 0.68000000715255737, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "error_message": "pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate" 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:40:45.252 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "83bcc6ca-0a72-4e35-94f8-5e998f400255", 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 165, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.253 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.254 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6802", 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6803", 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6806", 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6807", 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6804", 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6805", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1910915292 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6801/1910915292", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6803/1910915292", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6807/1910915292", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6805/1910915292", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "1f301988-977e-4d44-8e15-1bb166701438", 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 14, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:45.258 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6816", 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6817", 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6818", 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6819", 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.260 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6822", 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6823", 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.261 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6820", 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6821", 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2701012491 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6817/2701012491", 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6819/2701012491", 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6823/2701012491", 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6821/2701012491", 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "49ee3814-425e-4ec5-9f7c-b007d26b4249", 2024-04-23T23:40:45.263 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.264 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6824", 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6825", 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6826", 2024-04-23T23:40:45.265 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6827", 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6830", 2024-04-23T23:40:45.266 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6831", 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6828", 2024-04-23T23:40:45.267 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6829", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 14105002 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6825/14105002", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6827/14105002", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6831/14105002", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6829/14105002", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.268 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "60cfa342-4270-4d01-b26b-4a9fabb8ff1f", 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 0, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 82, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 147, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 55, 2024-04-23T23:40:45.269 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 84, 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6808", 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6809", 2024-04-23T23:40:45.270 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6810", 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6811", 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.271 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6814", 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6815", 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.272 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6812", 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6813", 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2677547801 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.77:6809/2677547801", 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.77:6811/2677547801", 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.77:6815/2677547801", 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.77:6813/2677547801", 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "eba66f3c-1472-4e43-971d-bfc106e6533a", 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.274 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 0.8255157470703125, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 1, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 164, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6824", 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.275 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6825", 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6826", 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.276 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6827", 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6830", 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6831", 2024-04-23T23:40:45.277 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6828", 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6829", 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1333725690 2024-04-23T23:40:45.278 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6825/1333725690", 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6827/1333725690", 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6831/1333725690", 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6829/1333725690", 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "bf8b21e7-277d-485b-a249-5739b1ea5e14", 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.279 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.3343048095703125, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 13, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 24, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 35, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 163, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 26, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6800", 2024-04-23T23:40:45.280 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6801", 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6802", 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.281 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6803", 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6806", 2024-04-23T23:40:45.282 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6807", 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6804", 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.283 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6805", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2756265516 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6801/2756265516", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6803/2756265516", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6807/2756265516", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6805/2756265516", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.284 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "9c77bfe9-4574-4be7-b13c-97352d0b36b4", 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.378265380859375, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 161, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.285 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6816", 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6817", 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.286 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6818", 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6819", 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.287 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6822", 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6823", 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.288 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6820", 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6821", 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1055419423 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.289 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6817/1055419423", 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6819/1055419423", 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6823/1055419423", 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6821/1055419423", 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "uuid": "6a7a0184-9708-4d0a-a230-722480d38bed", 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "up": 1, 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "in": 1, 2024-04-23T23:40:45.290 INFO:teuthology.orchestra.run.smithi077.stdout: "weight": 1, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_affinity": 0.744476318359375, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_begin": 0, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "last_clean_end": 0, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "up_from": 13, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "up_thru": 161, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "down_at": 0, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "lost_at": 0, 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addrs": { 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6808", 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6809", 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addrs": { 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6810", 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.292 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6811", 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addrs": { 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6814", 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.293 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6815", 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addrs": { 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6812", 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-04-23T23:40:45.294 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.170:6813", 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2863840516 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "public_addr": "172.21.15.170:6809/2863840516", 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_addr": "172.21.15.170:6811/2863840516", 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_back_addr": "172.21.15.170:6815/2863840516", 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "heartbeat_front_addr": "172.21.15.170:6813/2863840516", 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "state": [ 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "exists", 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "up" 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_xinfo": [ 2024-04-23T23:40:45.295 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 0, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.291145+0000", 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 1, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.296 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.258527+0000", 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 2, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.327333+0000", 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 3, 2024-04-23T23:40:45.297 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 65536, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.322206+0000", 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 84 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 4, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.298 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.377293+0000", 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 5, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.334347+0000", 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 26 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.299 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 6, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.311178+0000", 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": 7, 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "down_stamp": "0.000000", 2024-04-23T23:40:45.300 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_probability": 0, 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "laggy_interval": 0, 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "features": 4540701547738038271, 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "old_weight": 0, 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "last_purged_snaps_scrub": "2024-04-23T23:37:11.388211+0000", 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "dead_epoch": 0 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap": [ 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "pgid": "3.e", 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: "osds": [ 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: 2, 2024-04-23T23:40:45.301 INFO:teuthology.orchestra.run.smithi077.stdout: 6 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_items": [], 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_upmap_primaries": [], 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_temp": [], 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "primary_temp": [], 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklist": {}, 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "range_blocklist": {}, 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "erasure_code_profiles": { 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "default": { 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-failure-domain": "osd", 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "k": "2", 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "m": "1", 2024-04-23T23:40:45.302 INFO:teuthology.orchestra.run.smithi077.stdout: "plugin": "jerasure", 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "technique": "reed_sol_van" 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "removed_snaps_queue": [ 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 5, 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 8 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.303 INFO:teuthology.orchestra.run.smithi077.stdout: "new_removed_snaps": [ 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "pool": 3, 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "snaps": [ 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "begin": 5, 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "length": 1 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "new_purged_snaps": [], 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_node_flags": {}, 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "device_class_flags": {}, 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode": { 2024-04-23T23:40:45.304 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_enabled": false, 2024-04-23T23:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_bucket_count": 0, 2024-04-23T23:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout: "degraded_stretch_mode": 0, 2024-04-23T23:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout: "recovering_stretch_mode": 0, 2024-04-23T23:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout: "stretch_mode_bucket": 0 2024-04-23T23:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-04-23T23:40:45.305 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:45.307 INFO:tasks.thrashosds.thrasher:j is {'epoch': 193, 'fsid': 'f73eea51-5002-4eee-8d85-f2db649bc1b5', 'created': '2024-04-23T23:37:04.013555+0000', 'modified': '2024-04-23T23:40:44.932280+0000', 'last_up_change': '2024-04-23T23:39:58.814990+0000', 'last_in_change': '2024-04-23T23:40:09.918526+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 6, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T23:37:16.233938+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-23T23:37:22.007673+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 3.1600000858306885, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 2.7200000286102295, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574, 'error_message': 'pool 2 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-04-23T23:37:30.028908+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '193', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 58, 'snap_epoch': 193, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 9.329999923706055, 'score_stable': 1.9700000286102295, 'optimal_score': 1, 'raw_score_acting': 9.329999923706055, 'raw_score_stable': 1.9700000286102295, 'primary_affinity_weighted': 0.6821308135986328, 'average_primary_affinity': 0.7799999713897705, 'average_primary_affinity_weighted': 0.6800000071525574, 'error_message': 'pool 3 has acting primaries on OSD(s) with primary affinity 0, read balance score is not accurate'}}], 'osds': [{'osd': 0, 'uuid': '83bcc6ca-0a72-4e35-94f8-5e998f400255', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 165, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6800', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6801', 'nonce': 1910915292}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6802', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6803', 'nonce': 1910915292}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6806', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6807', 'nonce': 1910915292}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6804', 'nonce': 1910915292}, {'type': 'v1', 'addr': '172.21.15.77:6805', 'nonce': 1910915292}]}, 'public_addr': '172.21.15.77:6801/1910915292', 'cluster_addr': '172.21.15.77:6803/1910915292', 'heartbeat_back_addr': '172.21.15.77:6807/1910915292', 'heartbeat_front_addr': '172.21.15.77:6805/1910915292', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '1f301988-977e-4d44-8e15-1bb166701438', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 14, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6816', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6817', 'nonce': 2701012491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6818', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6819', 'nonce': 2701012491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6822', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6823', 'nonce': 2701012491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6820', 'nonce': 2701012491}, {'type': 'v1', 'addr': '172.21.15.77:6821', 'nonce': 2701012491}]}, 'public_addr': '172.21.15.77:6817/2701012491', 'cluster_addr': '172.21.15.77:6819/2701012491', 'heartbeat_back_addr': '172.21.15.77:6823/2701012491', 'heartbeat_front_addr': '172.21.15.77:6821/2701012491', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '49ee3814-425e-4ec5-9f7c-b007d26b4249', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6824', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6825', 'nonce': 14105002}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6826', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6827', 'nonce': 14105002}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6830', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6831', 'nonce': 14105002}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6828', 'nonce': 14105002}, {'type': 'v1', 'addr': '172.21.15.77:6829', 'nonce': 14105002}]}, 'public_addr': '172.21.15.77:6825/14105002', 'cluster_addr': '172.21.15.77:6827/14105002', 'heartbeat_back_addr': '172.21.15.77:6831/14105002', 'heartbeat_front_addr': '172.21.15.77:6829/14105002', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '60cfa342-4270-4d01-b26b-4a9fabb8ff1f', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 13, 'last_clean_end': 82, 'up_from': 147, 'up_thru': 55, 'down_at': 84, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6808', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6809', 'nonce': 2677547801}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6810', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6811', 'nonce': 2677547801}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6814', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6815', 'nonce': 2677547801}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6812', 'nonce': 2677547801}, {'type': 'v1', 'addr': '172.21.15.77:6813', 'nonce': 2677547801}]}, 'public_addr': '172.21.15.77:6809/2677547801', 'cluster_addr': '172.21.15.77:6811/2677547801', 'heartbeat_back_addr': '172.21.15.77:6815/2677547801', 'heartbeat_front_addr': '172.21.15.77:6813/2677547801', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': 'eba66f3c-1472-4e43-971d-bfc106e6533a', 'up': 1, 'in': 1, 'weight': 0.8255157470703125, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 164, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6824', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6825', 'nonce': 1333725690}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6826', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6827', 'nonce': 1333725690}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6830', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6831', 'nonce': 1333725690}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6828', 'nonce': 1333725690}, {'type': 'v1', 'addr': '172.21.15.170:6829', 'nonce': 1333725690}]}, 'public_addr': '172.21.15.170:6825/1333725690', 'cluster_addr': '172.21.15.170:6827/1333725690', 'heartbeat_back_addr': '172.21.15.170:6831/1333725690', 'heartbeat_front_addr': '172.21.15.170:6829/1333725690', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'bf8b21e7-277d-485b-a249-5739b1ea5e14', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3343048095703125, 'last_clean_begin': 13, 'last_clean_end': 24, 'up_from': 35, 'up_thru': 163, 'down_at': 26, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6800', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6801', 'nonce': 2756265516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6802', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6803', 'nonce': 2756265516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6806', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6807', 'nonce': 2756265516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6804', 'nonce': 2756265516}, {'type': 'v1', 'addr': '172.21.15.170:6805', 'nonce': 2756265516}]}, 'public_addr': '172.21.15.170:6801/2756265516', 'cluster_addr': '172.21.15.170:6803/2756265516', 'heartbeat_back_addr': '172.21.15.170:6807/2756265516', 'heartbeat_front_addr': '172.21.15.170:6805/2756265516', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '9c77bfe9-4574-4be7-b13c-97352d0b36b4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.378265380859375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 161, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6816', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6817', 'nonce': 1055419423}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6818', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6819', 'nonce': 1055419423}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6822', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6823', 'nonce': 1055419423}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6820', 'nonce': 1055419423}, {'type': 'v1', 'addr': '172.21.15.170:6821', 'nonce': 1055419423}]}, 'public_addr': '172.21.15.170:6817/1055419423', 'cluster_addr': '172.21.15.170:6819/1055419423', 'heartbeat_back_addr': '172.21.15.170:6823/1055419423', 'heartbeat_front_addr': '172.21.15.170:6821/1055419423', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': '6a7a0184-9708-4d0a-a230-722480d38bed', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.744476318359375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 161, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6808', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6809', 'nonce': 2863840516}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6810', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6811', 'nonce': 2863840516}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6814', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6815', 'nonce': 2863840516}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.170:6812', 'nonce': 2863840516}, {'type': 'v1', 'addr': '172.21.15.170:6813', 'nonce': 2863840516}]}, 'public_addr': '172.21.15.170:6809/2863840516', 'cluster_addr': '172.21.15.170:6811/2863840516', 'heartbeat_back_addr': '172.21.15.170:6815/2863840516', 'heartbeat_front_addr': '172.21.15.170:6813/2863840516', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.291145+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.258527+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.327333+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.322206+0000', 'dead_epoch': 84}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.377293+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.334347+0000', 'dead_epoch': 26}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.311178+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-23T23:37:11.388211+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '3.e', 'osds': [2, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 5, 'length': 8}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 5, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-23T23:40:45.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:40:45.308 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:45.308 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:45.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-23T23:40:45.309 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:45.319+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:45.407 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:45.420+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:45.452 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:45.452 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:45.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-23T23:40:45.508 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:45.521+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:45.563 INFO:teuthology.orchestra.run.smithi077.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:45.564 INFO:teuthology.orchestra.run.smithi077.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:45.572 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-23T23:40:45.617 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:45.630+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:45.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:40:45.639 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:40:45.651 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2024-04-23T23:40:44.937333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":218926763,"num_objects":1500,"num_object_clones":9,"num_object_copies":3000,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1500,"num_whiteouts":1295,"num_read":356923,"num_read_kb":1269004,"num_write":23787,"num_write_kb":707769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9233,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21578,"ondisk_log_size":21578,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":454500,"kb_used_data":71320,"kb_used_omap":13,"kb_used_meta":383026,"kb_avail":660148380,"statfs":{"total":676457349120,"available":675991941120,"internally_reserved":0,"allocated":73031680,"data_stored":63198068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14062,"internal_metadata":392218898},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40995050,"num_objects":-23,"num_object_clones":-4,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":-1,"num_read":170,"num_read_kb":147,"num_write":34,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.019152"},"pg_stats":[{"pgid":"3.1f","version":"188'830","reported_seq":6269,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.986746+0000","last_change":"2024-04-23T23:40:39.917673+0000","last_active":"2024-04-23T23:40:39.986746+0000","last_peered":"2024-04-23T23:40:39.986746+0000","last_clean":"2024-04-23T23:40:39.986746+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:40:39.986746+0000","last_undegraded":"2024-04-23T23:40:39.986746+0000","last_fullsized":"2024-04-23T23:40:39.986746+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":830,"log_dups_size":0,"ondisk_log_size":830,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:53:59.083719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013012189999999999,"stat_sum":{"num_bytes":4954341,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":41,"num_read":8137,"num_read_kb":19533,"num_write":1008,"num_write_kb":5091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.1e","version":"188'517","reported_seq":5032,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.992892+0000","last_change":"2024-04-23T23:40:39.919710+0000","last_active":"2024-04-23T23:40:39.992892+0000","last_peered":"2024-04-23T23:40:39.992892+0000","last_clean":"2024-04-23T23:40:39.992892+0000","last_became_active":"2024-04-23T23:38:29.051598+0000","last_became_peered":"2024-04-23T23:38:29.051598+0000","last_unstale":"2024-04-23T23:40:39.992892+0000","last_undegraded":"2024-04-23T23:40:39.992892+0000","last_fullsized":"2024-04-23T23:40:39.992892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":517,"log_dups_size":0,"ondisk_log_size":517,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:12:43.891059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091214400000000004,"stat_sum":{"num_bytes":825382,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":52,"num_read":5573,"num_read_kb":29335,"num_write":425,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.1d","version":"188'659","reported_seq":23733,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.991304+0000","last_change":"2024-04-23T23:40:39.913286+0000","last_active":"2024-04-23T23:40:39.991304+0000","last_peered":"2024-04-23T23:40:39.991304+0000","last_clean":"2024-04-23T23:40:39.991304+0000","last_became_active":"2024-04-23T23:40:16.836759+0000","last_became_peered":"2024-04-23T23:40:16.836759+0000","last_unstale":"2024-04-23T23:40:39.991304+0000","last_undegraded":"2024-04-23T23:40:39.991304+0000","last_fullsized":"2024-04-23T23:40:39.991304+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:29:33.239855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013127099999999999,"stat_sum":{"num_bytes":3116032,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":645,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.1c","version":"188'742","reported_seq":16790,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.021924+0000","last_change":"2024-04-23T23:40:39.913224+0000","last_active":"2024-04-23T23:40:40.021924+0000","last_peered":"2024-04-23T23:40:40.021924+0000","last_clean":"2024-04-23T23:40:40.021924+0000","last_became_active":"2024-04-23T23:40:16.836688+0000","last_became_peered":"2024-04-23T23:40:16.836688+0000","last_unstale":"2024-04-23T23:40:40.021924+0000","last_undegraded":"2024-04-23T23:40:40.021924+0000","last_fullsized":"2024-04-23T23:40:40.021924+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":742,"log_dups_size":0,"ondisk_log_size":742,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:17:16.543983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012734490000000001,"stat_sum":{"num_bytes":468992,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":42,"num_read":18421,"num_read_kb":49896,"num_write":734,"num_write_kb":16216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.1b","version":"188'829","reported_seq":5231,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.034027+0000","last_change":"2024-04-23T23:40:39.916737+0000","last_active":"2024-04-23T23:40:40.034027+0000","last_peered":"2024-04-23T23:40:40.034027+0000","last_clean":"2024-04-23T23:40:40.034027+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:40:40.034027+0000","last_undegraded":"2024-04-23T23:40:40.034027+0000","last_fullsized":"2024-04-23T23:40:40.034027+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":829,"log_dups_size":0,"ondisk_log_size":829,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:06:17.242350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00072619899999999996,"stat_sum":{"num_bytes":993317,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":41,"num_read":5966,"num_read_kb":36073,"num_write":1111,"num_write_kb":30812,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.1a","version":"188'753","reported_seq":17433,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.021590+0000","last_change":"2024-04-23T23:40:39.912711+0000","last_active":"2024-04-23T23:40:40.021590+0000","last_peered":"2024-04-23T23:40:40.021590+0000","last_clean":"2024-04-23T23:40:40.021590+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:40:40.021590+0000","last_undegraded":"2024-04-23T23:40:40.021590+0000","last_fullsized":"2024-04-23T23:40:40.021590+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":753,"log_dups_size":0,"ondisk_log_size":753,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:45:10.877885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000919909,"stat_sum":{"num_bytes":5586881,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":32,"num_read":19607,"num_read_kb":31687,"num_write":850,"num_write_kb":19972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.19","version":"188'683","reported_seq":9146,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.995465+0000","last_change":"2024-04-23T23:40:40.995785+0000","last_active":"2024-04-23T23:40:40.995465+0000","last_peered":"2024-04-23T23:40:40.995465+0000","last_clean":"2024-04-23T23:40:40.995465+0000","last_became_active":"2024-04-23T23:39:39.136832+0000","last_became_peered":"2024-04-23T23:39:39.136832+0000","last_unstale":"2024-04-23T23:40:40.995465+0000","last_undegraded":"2024-04-23T23:40:40.995465+0000","last_fullsized":"2024-04-23T23:40:40.995465+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:45:53.867164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046616000000000002,"stat_sum":{"num_bytes":55681488,"num_objects":60,"num_object_clones":2,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":54,"num_read":8359,"num_read_kb":49179,"num_write":642,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":439,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"9","length":"a"}]},{"pgid":"3.18","version":"188'526","reported_seq":3639,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.916812+0000","last_change":"2024-04-23T23:40:39.916812+0000","last_active":"2024-04-23T23:40:39.916812+0000","last_peered":"2024-04-23T23:40:39.916812+0000","last_clean":"2024-04-23T23:40:39.916812+0000","last_became_active":"2024-04-23T23:40:15.841789+0000","last_became_peered":"2024-04-23T23:40:15.841789+0000","last_unstale":"2024-04-23T23:40:39.916812+0000","last_undegraded":"2024-04-23T23:40:39.916812+0000","last_fullsized":"2024-04-23T23:40:39.916812+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":526,"log_dups_size":0,"ondisk_log_size":526,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:51:23.095312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075562700000000003,"stat_sum":{"num_bytes":162816,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":596,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":283,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.17","version":"187'648","reported_seq":6049,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.917175+0000","last_change":"2024-04-23T23:40:39.917413+0000","last_active":"2024-04-23T23:40:39.917175+0000","last_peered":"2024-04-23T23:40:39.917175+0000","last_clean":"2024-04-23T23:40:39.917175+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:40:39.917175+0000","last_undegraded":"2024-04-23T23:40:39.917175+0000","last_fullsized":"2024-04-23T23:40:39.917175+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":648,"log_dups_size":0,"ondisk_log_size":648,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:28:05.062160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012032430000000001,"stat_sum":{"num_bytes":46365773,"num_objects":50,"num_object_clones":1,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":819,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.16","version":"190'802","reported_seq":24438,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-04-23T23:40:41.935234+0000","last_change":"2024-04-23T23:40:41.935234+0000","last_active":"2024-04-23T23:40:41.935234+0000","last_peered":"2024-04-23T23:40:41.935234+0000","last_clean":"2024-04-23T23:40:41.935234+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:40:41.935234+0000","last_undegraded":"2024-04-23T23:40:41.935234+0000","last_fullsized":"2024-04-23T23:40:41.935234+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:37:49.295605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052625199999999995,"stat_sum":{"num_bytes":9587754,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":32,"num_read":25631,"num_read_kb":50155,"num_write":941,"num_write_kb":36181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"b"}]},{"pgid":"3.15","version":"188'503","reported_seq":7875,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.986120+0000","last_change":"2024-04-23T23:40:39.986120+0000","last_active":"2024-04-23T23:40:39.986120+0000","last_peered":"2024-04-23T23:40:39.986120+0000","last_clean":"2024-04-23T23:40:39.986120+0000","last_became_active":"2024-04-23T23:39:34.818900+0000","last_became_peered":"2024-04-23T23:39:34.818900+0000","last_unstale":"2024-04-23T23:40:39.986120+0000","last_undegraded":"2024-04-23T23:40:39.986120+0000","last_fullsized":"2024-04-23T23:40:39.986120+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:39:30.257429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002991081,"stat_sum":{"num_bytes":1343488,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":414,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":536,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.14","version":"188'961","reported_seq":13227,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.983840+0000","last_change":"2024-04-23T23:40:39.913700+0000","last_active":"2024-04-23T23:40:39.983840+0000","last_peered":"2024-04-23T23:40:39.983840+0000","last_clean":"2024-04-23T23:40:39.983840+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:40:39.983840+0000","last_undegraded":"2024-04-23T23:40:39.983840+0000","last_fullsized":"2024-04-23T23:40:39.983840+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":961,"log_dups_size":0,"ondisk_log_size":961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:11:21.870053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016763069999999999,"stat_sum":{"num_bytes":771558,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":42,"num_read":15563,"num_read_kb":20231,"num_write":1218,"num_write_kb":9792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.7","version":"0'0","reported_seq":319,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.924454+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:40:39.924454+0000","last_peered":"2024-04-23T23:40:39.924454+0000","last_clean":"2024-04-23T23:40:39.924454+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:40:39.924454+0000","last_undegraded":"2024-04-23T23:40:39.924454+0000","last_fullsized":"2024-04-23T23:40:39.924454+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"188'495","reported_seq":6401,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.002715+0000","last_change":"2024-04-23T23:40:39.917550+0000","last_active":"2024-04-23T23:40:40.002715+0000","last_peered":"2024-04-23T23:40:40.002715+0000","last_clean":"2024-04-23T23:40:40.002715+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:40:40.002715+0000","last_undegraded":"2024-04-23T23:40:40.002715+0000","last_fullsized":"2024-04-23T23:40:40.002715+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:59:35.162585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001275932,"stat_sum":{"num_bytes":610346,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":35,"num_read":6502,"num_read_kb":30727,"num_write":396,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.6","version":"0'0","reported_seq":351,"reported_epoch":189,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.995345+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:40:40.995345+0000","last_peered":"2024-04-23T23:40:40.995345+0000","last_clean":"2024-04-23T23:40:40.995345+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:40:40.995345+0000","last_undegraded":"2024-04-23T23:40:40.995345+0000","last_fullsized":"2024-04-23T23:40:40.995345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"188'791","reported_seq":6823,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.988518+0000","last_change":"2024-04-23T23:40:39.917115+0000","last_active":"2024-04-23T23:40:39.988518+0000","last_peered":"2024-04-23T23:40:39.988518+0000","last_clean":"2024-04-23T23:40:39.988518+0000","last_became_active":"2024-04-23T23:40:16.835190+0000","last_became_peered":"2024-04-23T23:40:16.835190+0000","last_unstale":"2024-04-23T23:40:39.988518+0000","last_undegraded":"2024-04-23T23:40:39.988518+0000","last_fullsized":"2024-04-23T23:40:39.988518+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:09:34.696726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001009242,"stat_sum":{"num_bytes":840113,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":36,"num_read":8290,"num_read_kb":60424,"num_write":1079,"num_write_kb":15164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":482,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.983107+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:40:39.983107+0000","last_peered":"2024-04-23T23:40:39.983107+0000","last_clean":"2024-04-23T23:40:39.983107+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:40:39.983107+0000","last_undegraded":"2024-04-23T23:40:39.983107+0000","last_fullsized":"2024-04-23T23:40:39.983107+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"188'630","reported_seq":5406,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.993844+0000","last_change":"2024-04-23T23:40:39.919404+0000","last_active":"2024-04-23T23:40:39.993844+0000","last_peered":"2024-04-23T23:40:39.993844+0000","last_clean":"2024-04-23T23:40:39.993844+0000","last_became_active":"2024-04-23T23:40:04.823474+0000","last_became_peered":"2024-04-23T23:40:04.823474+0000","last_unstale":"2024-04-23T23:40:39.993844+0000","last_undegraded":"2024-04-23T23:40:39.993844+0000","last_fullsized":"2024-04-23T23:40:39.993844+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":630,"log_dups_size":0,"ondisk_log_size":630,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:00.205080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00075591600000000003,"stat_sum":{"num_bytes":328428,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":597,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.4","version":"0'0","reported_seq":68,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.915934+0000","last_change":"2024-04-23T23:40:10.931459+0000","last_active":"2024-04-23T23:40:39.915934+0000","last_peered":"2024-04-23T23:40:39.915934+0000","last_clean":"2024-04-23T23:40:39.915934+0000","last_became_active":"2024-04-23T23:40:10.931141+0000","last_became_peered":"2024-04-23T23:40:10.931141+0000","last_unstale":"2024-04-23T23:40:39.915934+0000","last_undegraded":"2024-04-23T23:40:39.915934+0000","last_fullsized":"2024-04-23T23:40:39.915934+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:44:00.838091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"182'818","reported_seq":3938,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.009240+0000","last_change":"2024-04-23T23:40:39.919107+0000","last_active":"2024-04-23T23:40:40.009240+0000","last_peered":"2024-04-23T23:40:40.009240+0000","last_clean":"2024-04-23T23:40:40.009240+0000","last_became_active":"2024-04-23T23:40:16.836403+0000","last_became_peered":"2024-04-23T23:40:16.836403+0000","last_unstale":"2024-04-23T23:40:40.009240+0000","last_undegraded":"2024-04-23T23:40:40.009240+0000","last_fullsized":"2024-04-23T23:40:40.009240+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":818,"log_dups_size":0,"ondisk_log_size":818,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:50:34.780072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00048985399999999996,"stat_sum":{"num_bytes":2723299,"num_objects":51,"num_object_clones":2,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":44,"num_read":5947,"num_read_kb":29695,"num_write":1148,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.3","version":"188'714","reported_seq":8411,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:40.006564+0000","last_change":"2024-04-23T23:40:39.913000+0000","last_active":"2024-04-23T23:40:40.006564+0000","last_peered":"2024-04-23T23:40:40.006564+0000","last_clean":"2024-04-23T23:40:40.006564+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:40:40.006564+0000","last_undegraded":"2024-04-23T23:40:40.006564+0000","last_fullsized":"2024-04-23T23:40:40.006564+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":714,"log_dups_size":0,"ondisk_log_size":714,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:22:45.329860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001185413,"stat_sum":{"num_bytes":1626112,"num_objects":38,"num_object_clones":2,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":33,"num_read":7735,"num_read_kb":31225,"num_write":775,"num_write_kb":18560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.2","version":"0'0","reported_seq":329,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-04-23T23:40:41.934436+0000","last_change":"2024-04-23T23:37:54.880151+0000","last_active":"2024-04-23T23:40:41.934436+0000","last_peered":"2024-04-23T23:40:41.934436+0000","last_clean":"2024-04-23T23:40:41.934436+0000","last_became_active":"2024-04-23T23:37:54.879873+0000","last_became_peered":"2024-04-23T23:37:54.879873+0000","last_unstale":"2024-04-23T23:40:41.934436+0000","last_undegraded":"2024-04-23T23:40:41.934436+0000","last_fullsized":"2024-04-23T23:40:41.934436+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:39:37.613852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"188'535","reported_seq":3903,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.992054+0000","last_change":"2024-04-23T23:40:39.919110+0000","last_active":"2024-04-23T23:40:39.992054+0000","last_peered":"2024-04-23T23:40:39.992054+0000","last_clean":"2024-04-23T23:40:39.992054+0000","last_became_active":"2024-04-23T23:40:04.823413+0000","last_became_peered":"2024-04-23T23:40:04.823413+0000","last_unstale":"2024-04-23T23:40:39.992054+0000","last_undegraded":"2024-04-23T23:40:39.992054+0000","last_fullsized":"2024-04-23T23:40:39.992054+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:04:38.761283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052266900000000002,"stat_sum":{"num_bytes":26703148,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":39,"num_read":3791,"num_read_kb":45532,"num_write":702,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.1","version":"0'0","reported_seq":363,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.918597+0000","last_change":"2024-04-23T23:40:10.929291+0000","last_active":"2024-04-23T23:40:39.918597+0000","last_peered":"2024-04-23T23:40:39.918597+0000","last_clean":"2024-04-23T23:40:39.918597+0000","last_became_active":"2024-04-23T23:40:10.929001+0000","last_became_peered":"2024-04-23T23:40:10.929001+0000","last_unstale":"2024-04-23T23:40:39.918597+0000","last_undegraded":"2024-04-23T23:40:39.918597+0000","last_fullsized":"2024-04-23T23:40:39.918597+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:08:51.140875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"188'689","reported_seq":6076,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.917075+0000","last_change":"2024-04-23T23:40:39.917075+0000","last_active":"2024-04-23T23:40:39.917075+0000","last_peered":"2024-04-23T23:40:39.917075+0000","last_clean":"2024-04-23T23:40:39.917075+0000","last_became_active":"2024-04-23T23:40:15.839461+0000","last_became_peered":"2024-04-23T23:40:15.839461+0000","last_unstale":"2024-04-23T23:40:39.917075+0000","last_undegraded":"2024-04-23T23:40:39.917075+0000","last_fullsized":"2024-04-23T23:40:39.917075+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":689,"log_dups_size":0,"ondisk_log_size":689,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:48:59.826165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011822320000000001,"stat_sum":{"num_bytes":824320,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":946,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":458,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"2.0","version":"0'0","reported_seq":242,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.982158+0000","last_change":"2024-04-23T23:40:04.823878+0000","last_active":"2024-04-23T23:40:39.982158+0000","last_peered":"2024-04-23T23:40:39.982158+0000","last_clean":"2024-04-23T23:40:39.982158+0000","last_became_active":"2024-04-23T23:40:04.823583+0000","last_became_peered":"2024-04-23T23:40:04.823583+0000","last_unstale":"2024-04-23T23:40:39.982158+0000","last_undegraded":"2024-04-23T23:40:39.982158+0000","last_fullsized":"2024-04-23T23:40:39.982158+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:41:16.304329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"188'778","reported_seq":4202,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-04-23T23:40:41.934782+0000","last_change":"2024-04-23T23:40:41.935099+0000","last_active":"2024-04-23T23:40:41.934782+0000","last_peered":"2024-04-23T23:40:41.934782+0000","last_clean":"2024-04-23T23:40:41.934782+0000","last_became_active":"2024-04-23T23:38:19.812630+0000","last_became_peered":"2024-04-23T23:38:19.812630+0000","last_unstale":"2024-04-23T23:40:41.934782+0000","last_undegraded":"2024-04-23T23:40:41.934782+0000","last_fullsized":"2024-04-23T23:40:41.934782+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:12:03.127829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052859999999999995,"stat_sum":{"num_bytes":63504,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":33,"num_read":5563,"num_read_kb":13091,"num_write":931,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"b"}]},{"pgid":"2.3","version":"0'0","reported_seq":238,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.918508+0000","last_change":"2024-04-23T23:40:16.836919+0000","last_active":"2024-04-23T23:40:39.918508+0000","last_peered":"2024-04-23T23:40:39.918508+0000","last_clean":"2024-04-23T23:40:39.918508+0000","last_became_active":"2024-04-23T23:40:16.836621+0000","last_became_peered":"2024-04-23T23:40:16.836621+0000","last_unstale":"2024-04-23T23:40:39.918508+0000","last_undegraded":"2024-04-23T23:40:39.918508+0000","last_fullsized":"2024-04-23T23:40:39.918508+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:47:07.521924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":481,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.982742+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:40:39.982742+0000","last_peered":"2024-04-23T23:40:39.982742+0000","last_clean":"2024-04-23T23:40:39.982742+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:40:39.982742+0000","last_undegraded":"2024-04-23T23:40:39.982742+0000","last_fullsized":"2024-04-23T23:40:39.982742+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"188'509","reported_seq":21169,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.984932+0000","last_change":"2024-04-23T23:40:39.984932+0000","last_active":"2024-04-23T23:40:39.984932+0000","last_peered":"2024-04-23T23:40:39.984932+0000","last_clean":"2024-04-23T23:40:39.984932+0000","last_became_active":"2024-04-23T23:40:04.824769+0000","last_became_peered":"2024-04-23T23:40:04.824769+0000","last_unstale":"2024-04-23T23:40:39.984932+0000","last_undegraded":"2024-04-23T23:40:39.984932+0000","last_fullsized":"2024-04-23T23:40:39.984932+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":509,"log_dups_size":0,"ondisk_log_size":509,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:59:42.095574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020169760000000002,"stat_sum":{"num_bytes":1745888,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":46,"num_read":20121,"num_read_kb":46295,"num_write":564,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":316,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.9","version":"188'533","reported_seq":5856,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.912811+0000","last_change":"2024-04-23T23:40:39.912811+0000","last_active":"2024-04-23T23:40:39.912811+0000","last_peered":"2024-04-23T23:40:39.912811+0000","last_clean":"2024-04-23T23:40:39.912811+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:40:39.912811+0000","last_undegraded":"2024-04-23T23:40:39.912811+0000","last_fullsized":"2024-04-23T23:40:39.912811+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:12.871474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001031732,"stat_sum":{"num_bytes":4980561,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":429,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.a","version":"188'1030","reported_seq":14048,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.913616+0000","last_change":"2024-04-23T23:40:39.913616+0000","last_active":"2024-04-23T23:40:39.913616+0000","last_peered":"2024-04-23T23:40:39.913616+0000","last_clean":"2024-04-23T23:40:39.913616+0000","last_became_active":"2024-04-23T23:39:05.815581+0000","last_became_peered":"2024-04-23T23:39:05.815581+0000","last_unstale":"2024-04-23T23:40:39.913616+0000","last_undegraded":"2024-04-23T23:40:39.913616+0000","last_fullsized":"2024-04-23T23:40:39.913616+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1030,"log_dups_size":0,"ondisk_log_size":1030,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:13:23.111951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013139790000000001,"stat_sum":{"num_bytes":2513798,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":32,"num_read":16242,"num_read_kb":43629,"num_write":1170,"num_write_kb":20599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.b","version":"188'585","reported_seq":14771,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.961892+0000","last_change":"2024-04-23T23:40:39.917310+0000","last_active":"2024-04-23T23:40:39.961892+0000","last_peered":"2024-04-23T23:40:39.961892+0000","last_clean":"2024-04-23T23:40:39.961892+0000","last_became_active":"2024-04-23T23:40:17.845508+0000","last_became_peered":"2024-04-23T23:40:17.845508+0000","last_unstale":"2024-04-23T23:40:39.961892+0000","last_undegraded":"2024-04-23T23:40:39.961892+0000","last_fullsized":"2024-04-23T23:40:39.961892+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:51:23.462808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001115017,"stat_sum":{"num_bytes":11180575,"num_objects":46,"num_object_clones":1,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":523,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":488,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.c","version":"190'470","reported_seq":17477,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-04-23T23:40:41.935685+0000","last_change":"2024-04-23T23:40:41.935685+0000","last_active":"2024-04-23T23:40:41.935685+0000","last_peered":"2024-04-23T23:40:41.935685+0000","last_clean":"2024-04-23T23:40:41.935685+0000","last_became_active":"2024-04-23T23:38:19.812691+0000","last_became_peered":"2024-04-23T23:38:19.812691+0000","last_unstale":"2024-04-23T23:40:41.935685+0000","last_undegraded":"2024-04-23T23:40:41.935685+0000","last_fullsized":"2024-04-23T23:40:41.935685+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:47:04.129981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00053664000000000001,"stat_sum":{"num_bytes":1550524,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":402,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"b"}]},{"pgid":"3.d","version":"190'608","reported_seq":15453,"reported_epoch":190,"state":"active+clean","last_fresh":"2024-04-23T23:40:42.000786+0000","last_change":"2024-04-23T23:40:41.935625+0000","last_active":"2024-04-23T23:40:42.000786+0000","last_peered":"2024-04-23T23:40:42.000786+0000","last_clean":"2024-04-23T23:40:42.000786+0000","last_became_active":"2024-04-23T23:39:33.820772+0000","last_became_peered":"2024-04-23T23:39:33.820772+0000","last_unstale":"2024-04-23T23:40:42.000786+0000","last_undegraded":"2024-04-23T23:40:42.000786+0000","last_fullsized":"2024-04-23T23:40:42.000786+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":608,"log_dups_size":0,"ondisk_log_size":608,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:41:44.580842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078307799999999999,"stat_sum":{"num_bytes":765798,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":494,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"8","length":"b"}]},{"pgid":"3.e","version":"188'834","reported_seq":5475,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.997591+0000","last_change":"2024-04-23T23:40:39.919474+0000","last_active":"2024-04-23T23:40:39.997591+0000","last_peered":"2024-04-23T23:40:39.997591+0000","last_clean":"2024-04-23T23:40:39.997591+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:40:39.997591+0000","last_undegraded":"2024-04-23T23:40:39.997591+0000","last_fullsized":"2024-04-23T23:40:39.997591+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":834,"log_dups_size":0,"ondisk_log_size":834,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:56:48.861350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078685500000000004,"stat_sum":{"num_bytes":23752355,"num_objects":45,"num_object_clones":1,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":40,"num_read":7380,"num_read_kb":29139,"num_write":933,"num_write_kb":10382,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.f","version":"187'707","reported_seq":11982,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.985431+0000","last_change":"2024-04-23T23:40:39.986846+0000","last_active":"2024-04-23T23:40:39.985431+0000","last_peered":"2024-04-23T23:40:39.985431+0000","last_clean":"2024-04-23T23:40:39.985431+0000","last_became_active":"2024-04-23T23:39:35.820757+0000","last_became_peered":"2024-04-23T23:39:35.820757+0000","last_unstale":"2024-04-23T23:40:39.985431+0000","last_undegraded":"2024-04-23T23:40:39.985431+0000","last_fullsized":"2024-04-23T23:40:39.985431+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":707,"log_dups_size":0,"ondisk_log_size":707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:47:21.309295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0035607149999999999,"stat_sum":{"num_bytes":456128,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":46,"num_read":12349,"num_read_kb":51224,"num_write":726,"num_write_kb":21019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.10","version":"188'601","reported_seq":27044,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.925059+0000","last_change":"2024-04-23T23:40:39.925059+0000","last_active":"2024-04-23T23:40:39.925059+0000","last_peered":"2024-04-23T23:40:39.925059+0000","last_clean":"2024-04-23T23:40:39.925059+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:40:39.925059+0000","last_undegraded":"2024-04-23T23:40:39.925059+0000","last_fullsized":"2024-04-23T23:40:39.925059+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:55:50.425021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050804799999999998,"stat_sum":{"num_bytes":2165760,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":636,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.11","version":"188'487","reported_seq":8308,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.912486+0000","last_change":"2024-04-23T23:40:39.912486+0000","last_active":"2024-04-23T23:40:39.912486+0000","last_peered":"2024-04-23T23:40:39.912486+0000","last_clean":"2024-04-23T23:40:39.912486+0000","last_became_active":"2024-04-23T23:39:33.118919+0000","last_became_peered":"2024-04-23T23:39:33.118919+0000","last_unstale":"2024-04-23T23:40:39.912486+0000","last_undegraded":"2024-04-23T23:40:39.912486+0000","last_fullsized":"2024-04-23T23:40:39.912486+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:58:42.321842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070852600000000001,"stat_sum":{"num_bytes":796627,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":37,"num_read":7166,"num_read_kb":67518,"num_write":404,"num_write_kb":19044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.12","version":"188'783","reported_seq":7686,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.983935+0000","last_change":"2024-04-23T23:40:39.916398+0000","last_active":"2024-04-23T23:40:39.983935+0000","last_peered":"2024-04-23T23:40:39.983935+0000","last_clean":"2024-04-23T23:40:39.983935+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:40:39.983935+0000","last_undegraded":"2024-04-23T23:40:39.983935+0000","last_fullsized":"2024-04-23T23:40:39.983935+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":783,"log_dups_size":0,"ondisk_log_size":783,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:06.628333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050174400000000004,"stat_sum":{"num_bytes":3653279,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":42,"num_read":9695,"num_read_kb":43222,"num_write":999,"num_write_kb":24020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"9"}]},{"pgid":"3.13","version":"188'411","reported_seq":5154,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-04-23T23:40:39.989124+0000","last_change":"2024-04-23T23:40:39.984208+0000","last_active":"2024-04-23T23:40:39.989124+0000","last_peered":"2024-04-23T23:40:39.989124+0000","last_clean":"2024-04-23T23:40:39.989124+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:40:39.989124+0000","last_undegraded":"2024-04-23T23:40:39.989124+0000","last_fullsized":"2024-04-23T23:40:39.989124+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:16:42.566916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00166204,"stat_sum":{"num_bytes":1198010,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":34,"num_read":4927,"num_read_kb":30268,"num_write":371,"num_write_kb":10329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a","length":"9"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":218336395,"num_objects":1498,"num_object_clones":9,"num_object_copies":2996,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1498,"num_whiteouts":1295,"num_read":356807,"num_read_kb":1268904,"num_write":23628,"num_write_kb":705353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9227,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":69025792,"data_stored":79021671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},"log_size":21461,"ondisk_log_size":21461,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":69024,"kb_used_data":11468,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94302816,"statfs":{"total":96636764160,"available":96566083584,"internally_reserved":0,"allocated":11743232,"data_stored":10401018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68784,"kb_used_data":11236,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94303056,"statfs":{"total":96636764160,"available":96566329344,"internally_reserved":0,"allocated":11505664,"data_stored":10046611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":58915274},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51292,"kb_used_data":6228,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94320548,"statfs":{"total":96636764160,"available":96584241152,"internally_reserved":0,"allocated":6377472,"data_stored":5015729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855395,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66412,"kb_used_data":7776,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94305428,"statfs":{"total":96636764160,"available":96568758272,"internally_reserved":0,"allocated":7962624,"data_stored":6626130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63628,"kb_used_data":6056,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94308212,"statfs":{"total":96636764160,"available":96571609088,"internally_reserved":0,"allocated":6201344,"data_stored":4674771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":0,"seq":631360192523,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":63176,"kb_used_data":13948,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94308664,"statfs":{"total":96636764160,"available":96572071936,"internally_reserved":0,"allocated":14282752,"data_stored":12966575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72184,"kb_used_data":14608,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94299656,"statfs":{"total":96636764160,"available":96562847744,"internally_reserved":0,"allocated":14958592,"data_stored":13467234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8056832,"data_stored":7742051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":9461760,"data_stored":9288016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":10059776,"data_stored":9920070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29253632,"data_stored":40861626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2162688,"data_stored":1813610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5668864,"data_stored":5506872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2134016,"data_stored":1952064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2228224,"data_stored":1937362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:40:45.652 INFO:tasks.thrashosds.thrasher:Setting 3.f to [6, 2] 2024-04-23T23:40:45.652 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.f', '6', '2'] 2024-04-23T23:40:45.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.f 6 2 2024-04-23T23:40:45.689 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:45.689 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:45.698 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-23T23:40:45.742 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:45.753+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:45.811 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:45.823+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:45.844 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:45.844 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:45.853 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-23T23:40:45.911 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:45.924+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:46.008 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:46.008 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:46.012 INFO:tasks.ceph.osd.7.smithi170.stderr:2024-04-23T23:40:46.025+0000 7f831d089640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 31969) UID: 0 2024-04-23T23:40:46.018 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-23T23:40:46.113 INFO:tasks.ceph.osd.6.smithi170.stderr:2024-04-23T23:40:46.126+0000 7f29721f3640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 31967) UID: 0 2024-04-23T23:40:46.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-23T23:40:46.160 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:46.160 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:46.169 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-23T23:40:46.214 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:46.227+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:46.235 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0: {} 2024-04-23T23:40:46.235 INFO:teuthology.orchestra.run.smithi077.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-23T23:40:46.252 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1: {} 2024-04-23T23:40:46.252 INFO:teuthology.orchestra.run.smithi077.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-23T23:40:46.269 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2: {} 2024-04-23T23:40:46.269 INFO:teuthology.orchestra.run.smithi077.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-23T23:40:46.285 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3: {} 2024-04-23T23:40:46.285 INFO:teuthology.orchestra.run.smithi077.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-23T23:40:46.303 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4: {} 2024-04-23T23:40:46.303 INFO:teuthology.orchestra.run.smithi077.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-23T23:40:46.311 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument 2024-04-23T23:40:46.311 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-23T23:40:46.316 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:46.329+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:46.320 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-23T23:40:46.321 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5: {} 2024-04-23T23:40:46.321 INFO:teuthology.orchestra.run.smithi077.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-23T23:40:46.337 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6: {} 2024-04-23T23:40:46.337 INFO:teuthology.orchestra.run.smithi077.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-23T23:40:46.354 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7: {} 2024-04-23T23:40:46.354 INFO:teuthology.orchestra.run.smithi077.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-23T23:40:46.416 INFO:tasks.ceph.osd.1.smithi077.stderr:2024-04-23T23:40:46.429+0000 7fed82fbe640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 32299) UID: 0 2024-04-23T23:40:46.464 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160817 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3127296~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.097209883999994, 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049035984999999997, 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.465 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160817 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379242+0000", 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379243+0000", 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0600000000000001e-07 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379245+0000", 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.854e-06 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379251+0000", 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9889999999999997e-06 2024-04-23T23:40:46.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379255+0000", 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3390000000000003e-06 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428117+0000", 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048862296 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428192+0000", 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5092999999999994e-05 2024-04-23T23:40:46.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428278+0000", 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6007999999999994e-05 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160818 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3142656~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.097191147999993, 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049219008000000002, 2024-04-23T23:40:46.469 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160818 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379261+0000", 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379262+0000", 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1100000000000001e-07 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379264+0000", 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.978e-06 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379269+0000", 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9059999999999999e-06 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379274+0000", 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3470000000000001e-06 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428306+0000", 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049032098000000003 2024-04-23T23:40:46.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428379+0000", 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2766000000000001e-05 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428480+0000", 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000101502 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.473 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160887 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3153920~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.097172767999993, 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049373025000000001, 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160887 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379280+0000", 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379282+0000", 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0099999999999998e-06 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379288+0000", 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6810000000000003e-06 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379293+0000", 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9899999999999997e-06 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.476 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428511+0000", 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049218269000000002 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428564+0000", 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3226000000000002e-05 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428653+0000", 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8460000000000003e-05 2024-04-23T23:40:46.477 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160888 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3169280~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.097153571000007, 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049513392000000003, 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.478 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160888 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379299+0000", 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379301+0000", 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8870000000000001e-06 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379306+0000", 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2320000000000001e-06 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379311+0000", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3889999999999998e-06 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428679+0000", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049368790000000003 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428735+0000", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5080000000000001e-05 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428812+0000", 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7577999999999995e-05 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160889 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3184640~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.096917284, 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049487121000000002, 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.482 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160889 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379535+0000", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379536+0000", 2024-04-23T23:40:46.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0200000000000002e-07 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379539+0000", 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2930000000000001e-06 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379546+0000", 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.793e-06 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379551+0000", 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-06 2024-04-23T23:40:46.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428853+0000", 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049301178000000001 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.428932+0000", 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9708000000000003e-05 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429022+0000", 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9796999999999994e-05 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.485 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160890 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3200000~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.096891123999995, 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049585780000000003, 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160890 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.486 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379561+0000", 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379562+0000", 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2399999999999999e-07 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379564+0000", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2060000000000001e-06 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379570+0000", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9440000000000002e-06 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379575+0000", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8890000000000001e-06 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429051+0000", 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049475897999999997 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429093+0000", 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2735000000000003e-05 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429147+0000", 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3684000000000003e-05 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160891 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3215360~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.096871454999999, 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049754894000000001, 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160891 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.490 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379581+0000", 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9999999999999998e-07 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379583+0000", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8789999999999999e-06 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379589+0000", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7509999999999997e-06 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379593+0000", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5510000000000001e-06 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429169+0000", 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049575938 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429247+0000", 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7237000000000006e-05 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429336+0000", 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9137999999999999e-05 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160892 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3230720~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.096853034999995, 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049863035, 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160892 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379599+0000", 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379717+0000", 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000117299 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379724+0000", 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9199999999999998e-06 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379731+0000", 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.99e-06 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379736+0000", 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7790000000000001e-06 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429365+0000", 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049628304999999998 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429408+0000", 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3823999999999999e-05 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429462+0000", 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3918000000000001e-05 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.497 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160893 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3246080~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.096706339999997, 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049910843000000003, 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.498 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160893 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.379746+0000", 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380866+0000", 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0011196649999999999 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380871+0000", 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380881+0000", 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0857e-05 2024-04-23T23:40:46.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380889+0000", 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6569999999999997e-06 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429498+0000", 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048608540999999998 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429575+0000", 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7849999999999995e-05 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429657+0000", 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1407000000000002e-05 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160894 3.10 3:0b11201d:::rbd_data.11943a52a299.0000000000000005:30 [read 3261440~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.095550911000004, 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048879110000000003, 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.502 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160894 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380901+0000", 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380902+0000", 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3200000000000005e-07 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380907+0000", 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.276e-06 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380915+0000", 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4869999999999996e-06 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.380921+0000", 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9359999999999996e-06 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429680+0000", 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048759692 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429724+0000", 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3661000000000001e-05 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.429781+0000", 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6526000000000001e-05 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160896 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3161088~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.095235199000001, 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049025481000000003, 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.506 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160896 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381217+0000", 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381218+0000", 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.9200000000000001e-07 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381220+0000", 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.5500000000000001e-06 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381227+0000", 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.776e-06 2024-04-23T23:40:46.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381232+0000", 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2950000000000001e-06 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430145+0000", 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048912590999999998 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430191+0000", 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6588999999999997e-05 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430243+0000", 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1187999999999998e-05 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160897 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3176448~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.095213168000001, 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049221752000000001, 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.510 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160897 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381239+0000", 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381240+0000", 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6100000000000001e-07 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381242+0000", 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1639999999999999e-06 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381248+0000", 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3840000000000002e-06 2024-04-23T23:40:46.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381253+0000", 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1499999999999998e-06 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430276+0000", 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049023071000000001 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430366+0000", 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0019000000000007e-05 2024-04-23T23:40:46.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430461+0000", 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4503e-05 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160898 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3191808~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.095192601999997, 2024-04-23T23:40:46.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049334065000000003, 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160898 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.515 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381260+0000", 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9200000000000002e-07 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381262+0000", 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.108e-06 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381268+0000", 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.122e-06 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381274+0000", 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8769999999999998e-06 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430500+0000", 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049225809000000002 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430543+0000", 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2586000000000002e-05 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430594+0000", 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1171000000000002e-05 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160899 3.10 3:0aa2cf3b:::rbd_data.11943a52a299.0000000000000006:30 [read 3207168~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.518 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.095171777999994, 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049456095999999998, 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160899 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.381281+0000", 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383482+0000", 2024-04-23T23:40:46.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0022015619999999998 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383487+0000", 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4660000000000001e-06 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383497+0000", 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0370999999999999e-05 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383504+0000", 2024-04-23T23:40:46.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2099999999999996e-06 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430621+0000", 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047116697999999999 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430675+0000", 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4508000000000001e-05 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.430737+0000", 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1280999999999998e-05 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.522 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:160919 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3252224~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 87.092723414000005, 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048965521999999997, 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 160919 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.523 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.383729+0000", 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385334+0000", 2024-04-23T23:40:46.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001604891 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385340+0000", 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.733e-06 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385352+0000", 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.2378000000000001e-05 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.385360+0000", 2024-04-23T23:40:46.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6340000000000001e-06 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432558+0000", 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.047198863000000001 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432630+0000", 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1891999999999995e-05 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.432694+0000", 2024-04-23T23:40:46.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4131e-05 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167623 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3593216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.596709638999997, 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048960229000000001, 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.527 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167623 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879743+0000", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879744+0000", 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9999999999999996e-07 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879746+0000", 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1579999999999999e-06 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879750+0000", 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3019999999999996e-06 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879754+0000", 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1489999999999996e-06 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928544+0000", 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048789712999999998 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928623+0000", 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9484e-05 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928703+0000", 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9523000000000004e-05 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167624 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3608576~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.596693411000004, 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122635999999997, 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.531 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167624 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879759+0000", 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879760+0000", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9899999999999999e-07 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879762+0000", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0209999999999998e-06 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879766+0000", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4549999999999997e-06 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879770+0000", 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1869999999999999e-06 2024-04-23T23:40:46.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928730+0000", 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.048959388999999999 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928801+0000", 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0968000000000002e-05 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928882+0000", 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0717000000000007e-05 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.534 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167625 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3623936~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.596677170000007, 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279853999999998, 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167625 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.535 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879775+0000", 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879776+0000", 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3900000000000004e-07 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879778+0000", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7290000000000001e-06 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879782+0000", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.194e-06 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879786+0000", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8999999999999999e-06 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928908+0000", 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049122627000000002 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.928979+0000", 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0803999999999995e-05 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929055+0000", 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5760999999999995e-05 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167626 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3639296~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.596661927, 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049443323999999997, 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167626 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.539 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879790+0000", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879791+0000", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0270000000000001e-06 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879793+0000", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.03e-06 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879798+0000", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2930000000000002e-06 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879802+0000", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9960000000000004e-06 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929082+0000", 2024-04-23T23:40:46.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049279874000000001 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929153+0000", 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1415999999999995e-05 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929234+0000", 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0687999999999997e-05 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.542 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:167627 3.10 3:0a548247:::rbd_data.11943a52a299.0000000000000008:30 [read 3654656~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 86.596645842000001, 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049600651000000003, 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 167627 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879806+0000", 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879807+0000", 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7000000000000003e-07 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879809+0000", 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0339999999999999e-06 2024-04-23T23:40:46.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879814+0000", 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2610000000000004e-06 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.879820+0000", 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0340000000000002e-06 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929261+0000", 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.049441073000000002 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929332+0000", 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0648000000000005e-05 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:19.929407+0000", 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5630999999999995e-05 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.546 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:46.548 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-23T23:40:46.548 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:46.560+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:46.649 INFO:tasks.ceph.osd.2.smithi077.stderr:2024-04-23T23:40:46.661+0000 7f9f2a97e640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 32304) UID: 0 2024-04-23T23:40:46.691 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:46.691 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:46.691 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:46.699 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-23T23:40:46.750 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:46.763+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:46.801 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:46.802 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:46.802 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:46.802 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:46.802 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:46.810 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-23T23:40:46.851 INFO:tasks.ceph.osd.0.smithi077.stderr:2024-04-23T23:40:46.863+0000 7f7a9cfa2640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 32290) UID: 0 2024-04-23T23:40:46.933 INFO:teuthology.orchestra.run.smithi077.stderr:set 3.f pg_upmap mapping to [6,2] 2024-04-23T23:40:46.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:40:46.953 INFO:tasks.ceph.osd.5.smithi170.stderr:2024-04-23T23:40:46.965+0000 7f59c5e26640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 41066) UID: 0 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273340 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:46.962 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.160054580999997, 2024-04-23T23:40:46.965 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010376918, 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273340 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:46.966 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813084+0000", 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3700000000000001e-07 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.967 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813086+0000", 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1320000000000001e-06 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813090+0000", 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2300000000000002e-06 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813094+0000", 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9360000000000001e-06 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.968 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000238893 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting_for_map not empty", 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813339+0000", 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814794+0000", 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014557039999999999 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.969 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814810+0000", 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.5362999999999998e-05 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823293+0000", 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0084828349999999 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823382+0000", 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.9736999999999998e-05 2024-04-23T23:40:46.970 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823461+0000", 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8240999999999998e-05 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273344 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 177152~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.160024081000003, 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010594851, 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.971 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273344 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813114+0000", 2024-04-23T23:40:46.972 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813115+0000", 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8999999999999997e-07 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813117+0000", 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2400000000000002e-06 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813123+0000", 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.784e-06 2024-04-23T23:40:46.973 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813128+0000", 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0100000000000003e-06 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814846+0000", 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017178880000000001 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814852+0000", 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2360000000000001e-06 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.974 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823510+0000", 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.008658608 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823583+0000", 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2973999999999996e-05 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823709+0000", 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000125621 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.975 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273350 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 201728~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159985203999994, 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0107248799999999, 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273350 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.976 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813153+0000", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813154+0000", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0200000000000002e-07 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.977 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813156+0000", 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.486e-06 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813162+0000", 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3080000000000004e-06 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813168+0000", 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6359999999999999e-06 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.978 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814879+0000", 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017105480000000001 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814884+0000", 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0719999999999999e-06 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823736+0000", 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.00885241 2024-04-23T23:40:46.979 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823806+0000", 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0314999999999993e-05 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823878+0000", 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1602999999999999e-05 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.980 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273353 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 226304~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159954553999995, 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010872134, 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273353 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.981 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813184+0000", 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9000000000000002e-07 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813186+0000", 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.2000000000000001e-06 2024-04-23T23:40:46.982 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813192+0000", 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9179999999999999e-06 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813199+0000", 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2189999999999998e-06 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814909+0000", 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017091109999999999 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.983 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814914+0000", 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8279999999999999e-06 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823920+0000", 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009005653 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.823989+0000", 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8705e-05 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.984 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824056+0000", 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.711e-05 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273358 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 106496~0] snapc 0=[] RETRY=4 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159930192999994, 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0110711569999999, 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.985 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273358 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813208+0000", 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.986 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813209+0000", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813211+0000", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1900000000000002e-06 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813217+0000", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.336e-06 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813222+0000", 2024-04-23T23:40:46.987 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.113e-06 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814972+0000", 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001750178 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814979+0000", 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1530000000000002e-06 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.988 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824119+0000", 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0091409179999999 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824196+0000", 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6349999999999999e-05 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824279+0000", 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.3455000000000006e-05 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.989 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273371 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 129024~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159908616999999, 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011248742, 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273371 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.990 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813230+0000", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1699999999999999e-07 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.991 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813232+0000", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9910000000000001e-06 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813238+0000", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8340000000000004e-06 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813243+0000", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0810000000000001e-06 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815004+0000", 2024-04-23T23:40:46.992 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001760745 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815009+0000", 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.412e-06 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824321+0000", 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0093114059999999 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.993 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824402+0000", 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1042000000000001e-05 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824478+0000", 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6814e-05 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273372 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 104448~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:46.994 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159888770999999, 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011410318, 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273372 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.995 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813250+0000", 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.63e-07 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813252+0000", 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.3870000000000002e-06 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.996 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813262+0000", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.7610000000000002e-06 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813268+0000", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3049999999999998e-06 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815033+0000", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017642370000000001 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:46.997 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815039+0000", 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1099999999999999e-06 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824517+0000", 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0094784859999999 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824596+0000", 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8982999999999999e-05 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:46.998 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824660+0000", 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3585999999999997e-05 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273377 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 153600~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159858729000007, 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0115681299999999, 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:46.999 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273377 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:47.000 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813280+0000", 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6199999999999998e-07 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813283+0000", 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.8260000000000001e-06 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.001 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813289+0000", 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1999999999999999e-06 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813294+0000", 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.203e-06 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815081+0000", 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001786323 2024-04-23T23:40:47.002 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815089+0000", 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2439999999999993e-06 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824700+0000", 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009610938 2024-04-23T23:40:47.003 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824774+0000", 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4276000000000005e-05 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824848+0000", 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3658000000000005e-05 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.004 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273378 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 178176~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159830877000005, 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0117440579999999, 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273378 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.005 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813307+0000", 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813308+0000", 2024-04-23T23:40:47.006 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813310+0000", 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1440000000000001e-06 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813317+0000", 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8750000000000002e-06 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.007 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813323+0000", 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8300000000000001e-06 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815127+0000", 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018043790000000001 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815133+0000", 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.173e-06 2024-04-23T23:40:47.008 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824896+0000", 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.009762354 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.824982+0000", 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.6578999999999999e-05 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825051+0000", 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9238000000000004e-05 2024-04-23T23:40:47.009 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273397 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159807685999994, 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011944009, 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.010 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273397 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:47.011 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813331+0000", 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6699999999999999e-07 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813333+0000", 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9599999999999999e-06 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.012 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813338+0000", 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.361e-06 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813343+0000", 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8269999999999997e-06 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815159+0000", 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0018160819999999999 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.013 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815166+0000", 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9299999999999997e-06 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825102+0000", 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0099362940000001 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825201+0000", 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.8092999999999997e-05 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.014 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825275+0000", 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4095000000000001e-05 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273402 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159701478000002, 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0120394500000001, 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.015 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273402 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.016 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813437+0000", 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0500000000000003e-07 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813441+0000", 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3289999999999998e-06 2024-04-23T23:40:47.017 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813449+0000", 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.5010000000000004e-06 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813456+0000", 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.28e-06 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.018 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815192+0000", 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0017362720000000001 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815197+0000", 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.66e-06 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825313+0000", 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010115713 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.019 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825382+0000", 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8462999999999998e-05 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825476+0000", 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.4627000000000001e-05 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.020 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273405 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159667459999994, 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0121690029999999, 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273405 2024-04-23T23:40:47.021 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.022 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813471+0000", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6400000000000003e-07 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813478+0000", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1539999999999996e-06 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813485+0000", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5390000000000004e-06 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.023 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813490+0000", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1189999999999996e-06 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815222+0000", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001732195 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815229+0000", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3260000000000001e-06 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825505+0000", 2024-04-23T23:40:47.024 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010276164 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825571+0000", 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6266999999999994e-05 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825640+0000", 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8775000000000005e-05 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.025 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273410 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 154624~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159640840999998, 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012316284, 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273410 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.026 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813497+0000", 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813498+0000", 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6499999999999999e-07 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.027 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813500+0000", 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.1940000000000001e-06 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813506+0000", 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1979999999999998e-06 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813511+0000", 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2699999999999998e-06 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.028 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815254+0000", 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001743042 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815259+0000", 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.8189999999999997e-06 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825670+0000", 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0104110550000001 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.029 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825745+0000", 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4313999999999994e-05 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825814+0000", 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8926999999999999e-05 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273418 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 200704~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.030 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159620122000007, 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0124705970000001, 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273418 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.031 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813518+0000", 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813519+0000", 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2100000000000002e-07 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.032 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813521+0000", 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.007e-06 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813526+0000", 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6119999999999998e-06 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813534+0000", 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2470000000000008e-06 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.033 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815290+0000", 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001755125 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815296+0000", 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0939999999999996e-06 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825852+0000", 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0105567200000001 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.034 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825920+0000", 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7799000000000006e-05 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825989+0000", 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8571999999999993e-05 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273421 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 225280~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.035 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159597152999993, 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012633286, 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273421 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:47.036 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813541+0000", 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813542+0000", 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8200000000000001e-07 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813543+0000", 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9589999999999998e-06 2024-04-23T23:40:47.037 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813549+0000", 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4909999999999996e-06 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813555+0000", 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7080000000000002e-06 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815347+0000", 2024-04-23T23:40:47.038 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001792566 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815355+0000", 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4490000000000002e-06 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826019+0000", 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0106644170000001 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.039 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826098+0000", 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8541000000000006e-05 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826174+0000", 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6773000000000005e-05 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273436 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 105472~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.040 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159578135000004, 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0128034749999999, 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273436 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.041 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813560+0000", 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813561+0000", 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.34e-07 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.042 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813562+0000", 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7770000000000001e-06 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813568+0000", 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.1760000000000001e-06 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813573+0000", 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4260000000000002e-06 2024-04-23T23:40:47.043 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815384+0000", 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001810671 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815388+0000", 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0260000000000001e-06 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826205+0000", 2024-04-23T23:40:47.044 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010817367 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826282+0000", 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7317000000000005e-05 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826364+0000", 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.1280999999999996e-05 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.045 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273439 3.15 3:ab78e418:::rbd_data.119414ff45cc.000000000000019c:32 [read 130048~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159559955000006, 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.01298073, 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273439 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.046 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813578+0000", 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813579+0000", 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8299999999999998e-07 2024-04-23T23:40:47.047 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813581+0000", 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.95e-06 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813587+0000", 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2600000000000002e-06 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813593+0000", 2024-04-23T23:40:47.048 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.947e-06 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815413+0000", 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001819796 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815416+0000", 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.202e-06 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.049 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826396+0000", 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.010980043 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826491+0000", 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5074999999999994e-05 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826559+0000", 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8073999999999999e-05 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.050 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273458 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 177152~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159539327999994, 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013116997, 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.051 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273458 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.052 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813599+0000", 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1199999999999998e-07 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813601+0000", 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.872e-06 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813606+0000", 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.118e-06 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.053 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813740+0000", 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000133416 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815438+0000", 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0016985279999999999 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.054 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815441+0000", 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.9639999999999999e-06 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826586+0000", 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011144834 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826651+0000", 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5347999999999998e-05 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.055 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826716+0000", 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4505000000000007e-05 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273465 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 201728~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159167206999996, 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.012910038, 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.056 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273465 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813971+0000", 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.057 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813972+0000", 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.6599999999999995e-07 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813976+0000", 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9689999999999996e-06 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813985+0000", 2024-04-23T23:40:47.058 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0289999999999994e-06 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.813992+0000", 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3560000000000004e-06 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815463+0000", 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.001470821 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.059 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815473+0000", 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5179999999999993e-06 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826742+0000", 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.011269612 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826814+0000", 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2094999999999993e-05 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.060 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826881+0000", 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6872000000000006e-05 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273466 3.15 3:afc7ad2f:::rbd_data.119414ff45cc.0000000000000196:32 [read 226304~0] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e122)", 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.159111887999998, 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.013010164, 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.061 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273466 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814026+0000", 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.062 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814027+0000", 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4700000000000001e-07 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814030+0000", 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2100000000000002e-06 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814039+0000", 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.8829999999999995e-06 2024-04-23T23:40:47.063 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.814046+0000", 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8759999999999999e-06 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815494+0000", 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.0014485069999999999 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.815500+0000", 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5650000000000001e-06 2024-04-23T23:40:47.064 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826906+0000", 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0114064009999999 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826973+0000", 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6353999999999995e-05 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.065 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827037+0000", 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3820999999999998e-05 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.066 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:47.068 INFO:teuthology.orchestra.run.smithi077.stdout:All operations completed A-OK! 2024-04-23T23:40:47.068 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-23T23:40:47.069 INFO:tasks.ceph.osd.4.smithi170.stderr:2024-04-23T23:40:47.080+0000 7f1b85291640 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 31961) UID: 0 2024-04-23T23:40:47.069 DEBUG:teuthology.parallel:result is None 2024-04-23T23:40:47.070 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-04-23T23:40:47.079 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-23T23:40:47.120 INFO:tasks.thrashosds:joining thrashosds 2024-04-23T23:40:47.222 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:47.222 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:47.222 INFO:teuthology.orchestra.run.smithi170.stdout: "num_ops": 0 2024-04-23T23:40:47.223 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:47.231 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-23T23:40:47.333 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:47.333 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [], 2024-04-23T23:40:47.333 INFO:teuthology.orchestra.run.smithi170.stdout: "complaint_time": 30, 2024-04-23T23:40:47.333 INFO:teuthology.orchestra.run.smithi170.stdout: "num_blocked_ops": 0 2024-04-23T23:40:47.333 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:47.341 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-23T23:40:47.446 INFO:teuthology.orchestra.run.smithi170.stdout:{ 2024-04-23T23:40:47.446 INFO:teuthology.orchestra.run.smithi170.stdout: "size": 20, 2024-04-23T23:40:47.446 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 600, 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "ops": [ 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:116781 3.16 3:6ad21877:::rbd_object_map.1194c20c5cbf:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103)", 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 98.638753170000001, 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.0029888140000001, 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.447 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 116781 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818651+0000", 2024-04-23T23:40:47.448 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818652+0000", 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.314e-06 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818657+0000", 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5199999999999999e-06 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.449 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818666+0000", 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.5840000000000001e-06 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818674+0000", 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.9549999999999992e-06 2024-04-23T23:40:47.450 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818728+0000", 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3513000000000001e-05 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:08.818739+0000", 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.111e-05 2024-04-23T23:40:47.451 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821437+0000", 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.002698101 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821566+0000", 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00012873499999999999 2024-04-23T23:40:47.452 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:09.821640+0000", 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3981999999999997e-05 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273190 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 179200~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.453 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628791757000002, 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99752160700000003, 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273190 2024-04-23T23:40:47.454 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828612+0000", 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.455 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828613+0000", 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0399999999999996e-07 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828614+0000", 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.75e-06 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.456 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828620+0000", 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.519e-06 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828624+0000", 2024-04-23T23:40:47.457 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999998e-06 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829365+0000", 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000740634 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829371+0000", 2024-04-23T23:40:47.458 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7060000000000001e-06 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.825998+0000", 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99662696500000003 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826070+0000", 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2454999999999997e-05 2024-04-23T23:40:47.459 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826134+0000", 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3713999999999993e-05 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.460 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273195 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 203776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628774382000003, 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99765712900000003, 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.461 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273195 2024-04-23T23:40:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.462 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.463 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:47.463 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.463 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.463 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.463 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828630+0000", 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.89e-07 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.464 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828632+0000", 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.759e-06 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828637+0000", 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4060000000000004e-06 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.465 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828642+0000", 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829390+0000", 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00074869900000000002 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.466 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829396+0000", 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4759999999999997e-06 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826157+0000", 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99676120700000004 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826224+0000", 2024-04-23T23:40:47.467 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7096999999999998e-05 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826287+0000", 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2555e-05 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.468 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273198 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 108544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628756937999995, 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99779343899999995, 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.469 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273198 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.470 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.471 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828647+0000", 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3500000000000002e-07 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828649+0000", 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.81e-06 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.472 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828655+0000", 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3170000000000001e-06 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828659+0000", 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6480000000000002e-06 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.473 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829416+0000", 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00075662899999999998 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829421+0000", 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5099999999999998e-06 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826312+0000", 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99689053299999997 2024-04-23T23:40:47.474 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826379+0000", 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7125999999999994e-05 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826440+0000", 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1431000000000002e-05 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.475 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273228 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 32768~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628621155000005, 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783441799999995, 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.476 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273228 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.477 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828783+0000", 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2900000000000004e-07 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.478 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828785+0000", 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.809e-06 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828791+0000", 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4790000000000004e-06 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.479 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828796+0000", 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6899999999999997e-06 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829444+0000", 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00064762800000000003 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.480 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829449+0000", 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5199999999999997e-06 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826463+0000", 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99701344300000005 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.481 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826535+0000", 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.2218000000000005e-05 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826617+0000", 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2101999999999994e-05 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.482 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273232 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 57344~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628602275999995, 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798719499999999, 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.483 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273232 2024-04-23T23:40:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.484 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.485 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828802+0000", 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3599999999999999e-07 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828804+0000", 2024-04-23T23:40:47.486 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.9999999999999999e-06 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828809+0000", 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3399999999999997e-06 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828814+0000", 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5900000000000001e-06 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.487 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829474+0000", 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066011399999999995 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829480+0000", 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7910000000000001e-06 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.488 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826641+0000", 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99716081199999995 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826709+0000", 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7891000000000004e-05 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.489 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826789+0000", 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.0321000000000006e-05 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273235 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 81920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:47.490 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628584900999996, 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99812192899999996, 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273235 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.491 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828819+0000", 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828820+0000", 2024-04-23T23:40:47.492 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2599999999999998e-07 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828821+0000", 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7600000000000001e-06 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828827+0000", 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3759999999999999e-06 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.493 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828831+0000", 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.656e-06 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829500+0000", 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00066888600000000005 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829506+0000", 2024-04-23T23:40:47.494 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5260000000000001e-06 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826812+0000", 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99730646599999995 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826879+0000", 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7267999999999994e-05 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.495 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826941+0000", 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1564999999999998e-05 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273276 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 9216~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628413254999998, 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99811386999999996, 2024-04-23T23:40:47.496 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273276 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.497 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828991+0000", 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.3599999999999999e-07 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.498 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828993+0000", 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.6980000000000001e-06 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.828998+0000", 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.186e-06 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.499 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829002+0000", 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.4329999999999997e-06 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829527+0000", 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00052430499999999998 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829532+0000", 2024-04-23T23:40:47.500 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5219999999999998e-06 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.826962+0000", 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99742972500000004 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827027+0000", 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5188e-05 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.501 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827105+0000", 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7377000000000001e-05 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273277 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 33792~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628396391999999, 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826318599999997, 2024-04-23T23:40:47.502 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273277 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:47.503 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829008+0000", 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2800000000000003e-07 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.504 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829010+0000", 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7689999999999999e-06 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829015+0000", 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6540000000000004e-06 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.505 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829020+0000", 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.357e-06 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829554+0000", 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.00053388000000000003 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829559+0000", 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.339e-06 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.506 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827126+0000", 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997567553 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827193+0000", 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6983999999999994e-05 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.507 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827271+0000", 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7322000000000003e-05 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273282 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 58368~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.628379292999995, 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99841404099999997, 2024-04-23T23:40:47.508 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273282 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.509 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829025+0000", 2024-04-23T23:40:47.510 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.2099999999999998e-07 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829027+0000", 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.8050000000000001e-06 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829032+0000", 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.4110000000000004e-06 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.511 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829037+0000", 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6059999999999996e-06 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829579+0000", 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.000541976 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.512 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829584+0000", 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3419999999999998e-06 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827293+0000", 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99770925399999999 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827361+0000", 2024-04-23T23:40:47.513 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7156999999999994e-05 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827439+0000", 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8169000000000003e-05 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.514 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273311 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 80896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.627738889, 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99793863299999996, 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.515 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273311 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.516 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829665+0000", 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.9400000000000001e-07 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.517 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829668+0000", 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0700000000000001e-06 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829673+0000", 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5960000000000003e-06 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.518 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829678+0000", 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.605e-06 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829719+0000", 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.1508999999999998e-05 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829725+0000", 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1739999999999997e-06 2024-04-23T23:40:47.519 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827460+0000", 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99773470600000003 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827536+0000", 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.5788e-05 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.520 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827604+0000", 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.7791000000000002e-05 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273317 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 10240~1024] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.627670949000006, 2024-04-23T23:40:47.521 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99805101299999999, 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273317 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.522 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829733+0000", 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829734+0000", 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.7300000000000001e-07 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.523 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829736+0000", 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6199999999999999e-06 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829742+0000", 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.9599999999999997e-06 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.524 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829747+0000", 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0180000000000001e-06 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829811+0000", 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.3944999999999998e-05 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829818+0000", 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0430000000000002e-06 2024-04-23T23:40:47.525 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827627+0000", 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99780904299999995 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827693+0000", 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5951999999999995e-05 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.526 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827784+0000", 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 9.0958999999999994e-05 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273345 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 106496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.627486927000007, 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998026462, 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.527 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273345 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.528 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829917+0000", 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829919+0000", 2024-04-23T23:40:47.529 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.0930000000000001e-06 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829925+0000", 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3900000000000001e-06 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829929+0000", 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.5410000000000002e-06 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.530 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829970+0000", 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0679000000000001e-05 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.829977+0000", 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8179999999999998e-06 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827811+0000", 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99783377299999998 2024-04-23T23:40:47.531 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827878+0000", 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6832e-05 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827944+0000", 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6005000000000002e-05 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.532 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273401 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 225280~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.627131117999994, 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99788094299999996, 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273401 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.533 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.534 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830273+0000", 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.15e-07 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830275+0000", 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.7439999999999999e-06 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.535 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830281+0000", 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2009999999999996e-06 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830286+0000", 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8659999999999997e-06 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.536 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830323+0000", 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6850999999999997e-05 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830329+0000", 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4359999999999999e-06 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.827989+0000", 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.997660031 2024-04-23T23:40:47.537 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828072+0000", 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2211000000000003e-05 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828154+0000", 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 8.2287999999999995e-05 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.538 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273420 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 105472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.627062664999997, 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99798873300000002, 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.539 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273420 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830341+0000", 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.540 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830342+0000", 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.0999999999999998e-07 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830345+0000", 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.6709999999999999e-06 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.541 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830351+0000", 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6200000000000001e-06 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830357+0000", 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.5330000000000002e-06 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830400+0000", 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.2858999999999997e-05 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.542 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830406+0000", 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.4570000000000002e-06 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828194+0000", 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99778756700000004 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828264+0000", 2024-04-23T23:40:47.543 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.0191000000000006e-05 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828330+0000", 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6224999999999997e-05 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273423 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 130048~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:47.544 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.626987627999995, 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99836395, 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273423 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:47.545 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830416+0000", 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830417+0000", 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7100000000000002e-07 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.546 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830420+0000", 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.824e-06 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830426+0000", 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.212e-06 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.547 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830431+0000", 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.0880000000000002e-06 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830485+0000", 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3978999999999999e-05 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830491+0000", 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.241e-06 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.548 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828631+0000", 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99813980400000002 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828709+0000", 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.7748000000000002e-05 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.549 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828780+0000", 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1483000000000007e-05 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273428 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 154624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.626902247000004, 2024-04-23T23:40:47.550 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.998482973, 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273428 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.551 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830502+0000", 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.68e-07 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.552 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830505+0000", 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.0060000000000001e-06 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830513+0000", 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.3989999999999998e-06 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830518+0000", 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.3469999999999998e-06 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.553 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830556+0000", 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.8073e-05 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830562+0000", 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.6130000000000003e-06 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.554 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828832+0000", 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99826968800000004 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828910+0000", 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.8347000000000001e-05 2024-04-23T23:40:47.555 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.828985+0000", 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.4832000000000005e-05 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.556 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273462 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 177152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.626638068999995, 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99840076899999997, 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.557 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273462 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.558 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830766+0000", 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.3099999999999999e-07 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.559 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830768+0000", 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 1.916e-06 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830773+0000", 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2769999999999996e-06 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.560 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830778+0000", 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.6759999999999998e-06 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830819+0000", 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.0748999999999999e-05 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.561 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830826+0000", 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.9260000000000003e-06 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829024+0000", 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99819795499999997 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829096+0000", 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1841000000000006e-05 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.562 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829167+0000", 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1098000000000003e-05 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273469 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 201728~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.626568109999994, 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99849254300000001, 2024-04-23T23:40:47.563 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273469 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.564 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830836+0000", 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.75e-07 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830839+0000", 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.4880000000000001e-06 2024-04-23T23:40:47.565 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830845+0000", 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1260000000000003e-06 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830850+0000", 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.2580000000000003e-06 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.566 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830888+0000", 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.7771999999999997e-05 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830894+0000", 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.2040000000000002e-06 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829194+0000", 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99829931900000002 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.567 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829262+0000", 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.8720000000000006e-05 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829328+0000", 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.6081000000000006e-05 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.568 INFO:teuthology.orchestra.run.smithi170.stdout: "description": "osd_op(client.4500.0:273470 3.7 3:e1577bb2:::rbd_data.119414ff45cc.0000000000000198:32 [read 226304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e121)", 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "initiated_at": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "age": 73.626500246999996, 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99858561400000001, 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "continuous": false, 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "type_data": { 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "flag_point": "started", 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client_info": { 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client": "client.4500", 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "client_addr": "172.21.15.77:0/1960815585", 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "tid": 273470 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: "events": [ 2024-04-23T23:40:47.569 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "initiated", 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "header_read", 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.570 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "throttled", 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830904+0000", 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.8599999999999998e-07 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "all_read", 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830907+0000", 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 2.649e-06 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "dispatched", 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830913+0000", 2024-04-23T23:40:47.571 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.1240000000000002e-06 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "queued_for_pg", 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830918+0000", 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 4.95e-06 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830954+0000", 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 3.6451e-05 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.572 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "waiting for peered", 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:33.830960+0000", 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 5.7339999999999996e-06 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "reached_pg", 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829353+0000", 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 0.99839239599999996 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "started", 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829418+0000", 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 6.5512000000000006e-05 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: }, 2024-04-23T23:40:47.573 INFO:teuthology.orchestra.run.smithi170.stdout: { 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "event": "done", 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "time": "2024-04-23T23:39:34.829489+0000", 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: "duration": 7.1311999999999998e-05 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: } 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout: ] 2024-04-23T23:40:47.574 INFO:teuthology.orchestra.run.smithi170.stdout:} 2024-04-23T23:40:47.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-23T23:40:47.682 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:47.683 INFO:teuthology.orchestra.run.smithi077.stdout: "num_ops": 0 2024-04-23T23:40:47.683 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:47.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-23T23:40:47.793 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [], 2024-04-23T23:40:47.793 INFO:teuthology.orchestra.run.smithi077.stdout: "complaint_time": 30, 2024-04-23T23:40:47.794 INFO:teuthology.orchestra.run.smithi077.stdout: "num_blocked_ops": 0 2024-04-23T23:40:47.794 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:47.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-23T23:40:47.904 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:40:47.904 INFO:teuthology.orchestra.run.smithi077.stdout: "size": 20, 2024-04-23T23:40:47.904 INFO:teuthology.orchestra.run.smithi077.stdout: "duration": 600, 2024-04-23T23:40:47.904 INFO:teuthology.orchestra.run.smithi077.stdout: "ops": [] 2024-04-23T23:40:47.904 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:40:47.946 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:40:49.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-23T23:40:50.956 INFO:teuthology.orchestra.run.smithi077.stderr:noscrub is unset 2024-04-23T23:40:50.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-23T23:40:51.953 INFO:tasks.thrashosds.thrasher:inning osd 2024-04-23T23:40:51.953 INFO:tasks.thrashosds.thrasher:Adding osd 3 2024-04-23T23:40:51.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 3 2024-04-23T23:40:51.955 INFO:teuthology.orchestra.run.smithi077.stderr:nodeep-scrub is unset 2024-04-23T23:40:52.253 INFO:tasks.ceph.mon.a.smithi077.stderr:2024-04-23T23:40:52.266+0000 7f7374a68640 -1 mon.a@0(leader).osd e200 definitely_dead 0 2024-04-23T23:40:52.960 INFO:teuthology.orchestra.run.smithi077.stderr:marked in osd.3. 2024-04-23T23:40:52.983 INFO:tasks.thrashosds.thrasher:Added osd 3 2024-04-23T23:40:52.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-23T23:40:53.100 INFO:teuthology.orchestra.run.smithi077.stdout:mon.a: {} 2024-04-23T23:40:53.100 INFO:teuthology.orchestra.run.smithi077.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T23:40:53.110 INFO:teuthology.orchestra.run.smithi077.stdout:mon.b: {} 2024-04-23T23:40:53.110 INFO:teuthology.orchestra.run.smithi077.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T23:40:53.118 INFO:teuthology.orchestra.run.smithi077.stdout:mon.c: {} 2024-04-23T23:40:53.119 INFO:teuthology.orchestra.run.smithi077.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-23T23:40:53.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-23T23:40:53.822 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.0 to 1 (10000) 2024-04-23T23:40:53.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-23T23:40:54.816 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-23T23:40:54.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-23T23:40:55.979 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.1 to 1 (10000) 2024-04-23T23:40:55.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-23T23:40:56.980 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-23T23:40:56.999 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-23T23:40:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.2 to 1 (10000) 2024-04-23T23:40:58.002 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-23T23:40:58.818 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-23T23:40:58.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-23T23:40:59.817 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.4 to 1 (10000) 2024-04-23T23:40:59.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-23T23:41:00.821 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-23T23:41:00.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-23T23:41:01.819 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.6 to 1 (10000) 2024-04-23T23:41:01.836 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-23T23:41:02.821 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-23T23:41:02.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-23T23:41:03.825 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.7 to 1 (10000) 2024-04-23T23:41:03.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-23T23:41:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-23T23:41:05.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-23T23:41:06.021 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.5 to 1 (10000) 2024-04-23T23:41:06.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-23T23:41:07.027 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-23T23:41:07.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-23T23:41:08.036 INFO:teuthology.orchestra.run.smithi077.stderr:reweighted osd.3 to 1 (10000) 2024-04-23T23:41:08.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-23T23:41:09.040 INFO:teuthology.orchestra.run.smithi077.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-23T23:41:09.056 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-23T23:41:09.056 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-23T23:41:09.056 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-23T23:41:09.056 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-23T23:41:09.056 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T23:41:09.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T23:41:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:09.341 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":217,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:41:09.049381+0000","last_up_change":"2024-04-23T23:39:58.814990+0000","last_in_change":"2024-04-23T23:40:52.972238+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T23:37:16.233938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T23:37:22.007673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-04-23T23:37:30.028908+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":58,"snap_epoch":195,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6801","nonce":1910915292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6803","nonce":1910915292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6807","nonce":1910915292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6805","nonce":1910915292}]},"public_addr":"172.21.15.77:6801/1910915292","cluster_addr":"172.21.15.77:6803/1910915292","heartbeat_back_addr":"172.21.15.77:6807/1910915292","heartbeat_front_addr":"172.21.15.77:6805/1910915292","state":["exists","up"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6817","nonce":2701012491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6819","nonce":2701012491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6823","nonce":2701012491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6821","nonce":2701012491}]},"public_addr":"172.21.15.77:6817/2701012491","cluster_addr":"172.21.15.77:6819/2701012491","heartbeat_back_addr":"172.21.15.77:6823/2701012491","heartbeat_front_addr":"172.21.15.77:6821/2701012491","state":["exists","up"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6825","nonce":14105002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6827","nonce":14105002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6831","nonce":14105002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6829","nonce":14105002}]},"public_addr":"172.21.15.77:6825/14105002","cluster_addr":"172.21.15.77:6827/14105002","heartbeat_back_addr":"172.21.15.77:6831/14105002","heartbeat_front_addr":"172.21.15.77:6829/14105002","state":["exists","up"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":82,"up_from":147,"up_thru":207,"down_at":84,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6809","nonce":2677547801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6811","nonce":2677547801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6815","nonce":2677547801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6813","nonce":2677547801}]},"public_addr":"172.21.15.77:6809/2677547801","cluster_addr":"172.21.15.77:6811/2677547801","heartbeat_back_addr":"172.21.15.77:6815/2677547801","heartbeat_front_addr":"172.21.15.77:6813/2677547801","state":["exists","up"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6825","nonce":1333725690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6827","nonce":1333725690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6831","nonce":1333725690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6829","nonce":1333725690}]},"public_addr":"172.21.15.170:6825/1333725690","cluster_addr":"172.21.15.170:6827/1333725690","heartbeat_back_addr":"172.21.15.170:6831/1333725690","heartbeat_front_addr":"172.21.15.170:6829/1333725690","state":["exists","up"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":24,"up_from":35,"up_thru":215,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6801","nonce":2756265516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6803","nonce":2756265516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6807","nonce":2756265516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6805","nonce":2756265516}]},"public_addr":"172.21.15.170:6801/2756265516","cluster_addr":"172.21.15.170:6803/2756265516","heartbeat_back_addr":"172.21.15.170:6807/2756265516","heartbeat_front_addr":"172.21.15.170:6805/2756265516","state":["exists","up"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6817","nonce":1055419423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6819","nonce":1055419423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6823","nonce":1055419423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6821","nonce":1055419423}]},"public_addr":"172.21.15.170:6817/1055419423","cluster_addr":"172.21.15.170:6819/1055419423","heartbeat_back_addr":"172.21.15.170:6823/1055419423","heartbeat_front_addr":"172.21.15.170:6821/1055419423","state":["exists","up"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":213,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6809","nonce":2863840516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6811","nonce":2863840516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6815","nonce":2863840516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6813","nonce":2863840516}]},"public_addr":"172.21.15.170:6809/2863840516","cluster_addr":"172.21.15.170:6811/2863840516","heartbeat_back_addr":"172.21.15.170:6815/2863840516","heartbeat_front_addr":"172.21.15.170:6813/2863840516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.291145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.258527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.327333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.322206+0000","dead_epoch":84},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.377293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.334347+0000","dead_epoch":26},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.311178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.388211+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.e","osds":[2,6]},{"pgid":"3.f","osds":[6,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:41:09.353 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T23:41:09.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T23:41:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:09.638 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":217,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:41:09.049381+0000","last_up_change":"2024-04-23T23:39:58.814990+0000","last_in_change":"2024-04-23T23:40:52.972238+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T23:37:16.233938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T23:37:22.007673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-04-23T23:37:30.028908+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":58,"snap_epoch":195,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6801","nonce":1910915292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6803","nonce":1910915292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6807","nonce":1910915292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6805","nonce":1910915292}]},"public_addr":"172.21.15.77:6801/1910915292","cluster_addr":"172.21.15.77:6803/1910915292","heartbeat_back_addr":"172.21.15.77:6807/1910915292","heartbeat_front_addr":"172.21.15.77:6805/1910915292","state":["exists","up"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6817","nonce":2701012491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6819","nonce":2701012491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6823","nonce":2701012491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6821","nonce":2701012491}]},"public_addr":"172.21.15.77:6817/2701012491","cluster_addr":"172.21.15.77:6819/2701012491","heartbeat_back_addr":"172.21.15.77:6823/2701012491","heartbeat_front_addr":"172.21.15.77:6821/2701012491","state":["exists","up"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6825","nonce":14105002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6827","nonce":14105002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6831","nonce":14105002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6829","nonce":14105002}]},"public_addr":"172.21.15.77:6825/14105002","cluster_addr":"172.21.15.77:6827/14105002","heartbeat_back_addr":"172.21.15.77:6831/14105002","heartbeat_front_addr":"172.21.15.77:6829/14105002","state":["exists","up"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":82,"up_from":147,"up_thru":207,"down_at":84,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6809","nonce":2677547801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6811","nonce":2677547801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6815","nonce":2677547801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6813","nonce":2677547801}]},"public_addr":"172.21.15.77:6809/2677547801","cluster_addr":"172.21.15.77:6811/2677547801","heartbeat_back_addr":"172.21.15.77:6815/2677547801","heartbeat_front_addr":"172.21.15.77:6813/2677547801","state":["exists","up"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6825","nonce":1333725690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6827","nonce":1333725690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6831","nonce":1333725690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6829","nonce":1333725690}]},"public_addr":"172.21.15.170:6825/1333725690","cluster_addr":"172.21.15.170:6827/1333725690","heartbeat_back_addr":"172.21.15.170:6831/1333725690","heartbeat_front_addr":"172.21.15.170:6829/1333725690","state":["exists","up"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":24,"up_from":35,"up_thru":215,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6801","nonce":2756265516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6803","nonce":2756265516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6807","nonce":2756265516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6805","nonce":2756265516}]},"public_addr":"172.21.15.170:6801/2756265516","cluster_addr":"172.21.15.170:6803/2756265516","heartbeat_back_addr":"172.21.15.170:6807/2756265516","heartbeat_front_addr":"172.21.15.170:6805/2756265516","state":["exists","up"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6817","nonce":1055419423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6819","nonce":1055419423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6823","nonce":1055419423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6821","nonce":1055419423}]},"public_addr":"172.21.15.170:6817/1055419423","cluster_addr":"172.21.15.170:6819/1055419423","heartbeat_back_addr":"172.21.15.170:6823/1055419423","heartbeat_front_addr":"172.21.15.170:6821/1055419423","state":["exists","up"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":213,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6809","nonce":2863840516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6811","nonce":2863840516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6815","nonce":2863840516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6813","nonce":2863840516}]},"public_addr":"172.21.15.170:6809/2863840516","cluster_addr":"172.21.15.170:6811/2863840516","heartbeat_back_addr":"172.21.15.170:6815/2863840516","heartbeat_front_addr":"172.21.15.170:6813/2863840516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.291145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.258527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.327333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.322206+0000","dead_epoch":84},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.377293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.334347+0000","dead_epoch":26},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.311178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.388211+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.e","osds":[2,6]},{"pgid":"3.f","osds":[6,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:41:09.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T23:41:09.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T23:41:09.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T23:41:09.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T23:41:09.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T23:41:09.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T23:41:09.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T23:41:09.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T23:41:09.893 INFO:teuthology.orchestra.run.smithi077.stdout:150323855401 2024-04-23T23:41:09.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T23:41:09.894 INFO:teuthology.orchestra.run.smithi077.stdout:631360192529 2024-04-23T23:41:09.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T23:41:09.895 INFO:teuthology.orchestra.run.smithi077.stdout:55834574898 2024-04-23T23:41:09.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T23:41:09.896 INFO:teuthology.orchestra.run.smithi077.stdout:55834574900 2024-04-23T23:41:09.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T23:41:09.897 INFO:teuthology.orchestra.run.smithi077.stdout:55834574898 2024-04-23T23:41:09.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T23:41:09.899 INFO:teuthology.orchestra.run.smithi077.stdout:55834574899 2024-04-23T23:41:09.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T23:41:09.899 INFO:teuthology.orchestra.run.smithi077.stdout:55834574899 2024-04-23T23:41:09.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T23:41:09.900 INFO:teuthology.orchestra.run.smithi077.stdout:60129542194 2024-04-23T23:41:09.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T23:41:10.448 INFO:teuthology.orchestra.run.smithi077.stdout:150323855400 2024-04-23T23:41:10.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 150323855401 got 150323855400 for osd.5 2024-04-23T23:41:10.501 INFO:teuthology.orchestra.run.smithi077.stdout:55834574897 2024-04-23T23:41:10.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574897 for osd.7 2024-04-23T23:41:10.515 INFO:teuthology.orchestra.run.smithi077.stdout:55834574899 2024-04-23T23:41:10.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574899 for osd.0 2024-04-23T23:41:10.531 INFO:teuthology.orchestra.run.smithi077.stdout:55834574898 2024-04-23T23:41:10.533 INFO:teuthology.orchestra.run.smithi077.stdout:55834574897 2024-04-23T23:41:10.541 INFO:teuthology.orchestra.run.smithi077.stdout:60129542193 2024-04-23T23:41:10.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574898 for osd.6 2024-04-23T23:41:10.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574897 for osd.4 2024-04-23T23:41:10.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542193 for osd.1 2024-04-23T23:41:10.567 INFO:teuthology.orchestra.run.smithi077.stdout:55834574898 2024-04-23T23:41:10.575 INFO:teuthology.orchestra.run.smithi077.stdout:631360192527 2024-04-23T23:41:10.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574898 for osd.2 2024-04-23T23:41:10.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 631360192529 got 631360192527 for osd.3 2024-04-23T23:41:11.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T23:41:11.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T23:41:11.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T23:41:11.552 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T23:41:11.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T23:41:11.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T23:41:11.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T23:41:11.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T23:41:12.001 INFO:teuthology.orchestra.run.smithi077.stdout:150323855401 2024-04-23T23:41:12.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 150323855401 got 150323855401 for osd.5 2024-04-23T23:41:12.021 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.047 INFO:teuthology.orchestra.run.smithi077.stdout:55834574898 2024-04-23T23:41:12.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574898 for osd.7 2024-04-23T23:41:12.061 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.126 INFO:teuthology.orchestra.run.smithi077.stdout:55834574898 2024-04-23T23:41:12.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574898 got 55834574898 for osd.4 2024-04-23T23:41:12.140 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.142 INFO:teuthology.orchestra.run.smithi077.stdout:55834574900 2024-04-23T23:41:12.143 INFO:teuthology.orchestra.run.smithi077.stdout:55834574900 2024-04-23T23:41:12.154 INFO:teuthology.orchestra.run.smithi077.stdout:631360192529 2024-04-23T23:41:12.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574900 got 55834574900 for osd.0 2024-04-23T23:41:12.158 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.163 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574900 for osd.6 2024-04-23T23:41:12.163 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 631360192529 got 631360192529 for osd.3 2024-04-23T23:41:12.166 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.168 INFO:teuthology.orchestra.run.smithi077.stdout:60129542194 2024-04-23T23:41:12.174 INFO:teuthology.orchestra.run.smithi077.stdout:55834574900 2024-04-23T23:41:12.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542194 got 60129542194 for osd.1 2024-04-23T23:41:12.182 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574899 got 55834574900 for osd.2 2024-04-23T23:41:12.187 DEBUG:teuthology.parallel:result is None 2024-04-23T23:41:12.188 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-23T23:41:12.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:12.510 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:12.511 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:12.522 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-23T23:41:12.243056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22033,"ondisk_log_size":22033,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467172,"kb_used_data":21656,"kb_used_omap":20,"kb_used_meta":445355,"kb_avail":754507548,"statfs":{"total":773094113280,"available":772615729152,"internally_reserved":0,"allocated":22175744,"data_stored":11429184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":456043980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001194"},"pg_stats":[{"pgid":"3.1f","version":"195'850","reported_seq":6388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053268+0000","last_change":"2024-04-23T23:40:46.952803+0000","last_active":"2024-04-23T23:41:09.053268+0000","last_peered":"2024-04-23T23:41:09.053268+0000","last_clean":"2024-04-23T23:41:09.053268+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:09.053268+0000","last_undegraded":"2024-04-23T23:41:09.053268+0000","last_fullsized":"2024-04-23T23:41:09.053268+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:29.685374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'523","reported_seq":5131,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053031+0000","last_change":"2024-04-23T23:40:58.839474+0000","last_active":"2024-04-23T23:41:09.053031+0000","last_peered":"2024-04-23T23:41:09.053031+0000","last_clean":"2024-04-23T23:41:09.053031+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:09.053031+0000","last_undegraded":"2024-04-23T23:41:09.053031+0000","last_fullsized":"2024-04-23T23:41:09.053031+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:59.446652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"193'665","reported_seq":23785,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:08.059066+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:38.056866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"195'773","reported_seq":16975,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506021+0000","last_change":"2024-04-23T23:41:08.058573+0000","last_active":"2024-04-23T23:41:09.506021+0000","last_peered":"2024-04-23T23:41:09.506021+0000","last_clean":"2024-04-23T23:41:09.506021+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:09.506021+0000","last_undegraded":"2024-04-23T23:41:09.506021+0000","last_fullsized":"2024-04-23T23:41:09.506021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:02.250704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"192'846","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052885+0000","last_change":"2024-04-23T23:40:46.952426+0000","last_active":"2024-04-23T23:41:09.052885+0000","last_peered":"2024-04-23T23:41:09.052885+0000","last_clean":"2024-04-23T23:41:09.052885+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:09.052885+0000","last_undegraded":"2024-04-23T23:41:09.052885+0000","last_fullsized":"2024-04-23T23:41:09.052885+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:18.804252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"195'770","reported_seq":17589,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053552+0000","last_change":"2024-04-23T23:40:46.952178+0000","last_active":"2024-04-23T23:41:09.053552+0000","last_peered":"2024-04-23T23:41:09.053552+0000","last_clean":"2024-04-23T23:41:09.053552+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:09.053552+0000","last_undegraded":"2024-04-23T23:41:09.053552+0000","last_fullsized":"2024-04-23T23:41:09.053552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:46.733880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"194'691","reported_seq":9606,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505707+0000","last_change":"2024-04-23T23:40:59.005552+0000","last_active":"2024-04-23T23:41:09.505707+0000","last_peered":"2024-04-23T23:41:09.505707+0000","last_clean":"2024-04-23T23:41:09.505707+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:09.505707+0000","last_undegraded":"2024-04-23T23:41:09.505707+0000","last_fullsized":"2024-04-23T23:41:09.505707+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:51.413923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"192'527","reported_seq":3734,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053080+0000","last_change":"2024-04-23T23:40:58.009381+0000","last_active":"2024-04-23T23:41:09.053080+0000","last_peered":"2024-04-23T23:41:09.053080+0000","last_clean":"2024-04-23T23:41:09.053080+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:09.053080+0000","last_undegraded":"2024-04-23T23:41:09.053080+0000","last_fullsized":"2024-04-23T23:41:09.053080+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.551844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"194'656","reported_seq":6150,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053177+0000","last_change":"2024-04-23T23:40:46.953281+0000","last_active":"2024-04-23T23:41:09.053177+0000","last_peered":"2024-04-23T23:41:09.053177+0000","last_clean":"2024-04-23T23:41:09.053177+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:09.053177+0000","last_undegraded":"2024-04-23T23:41:09.053177+0000","last_fullsized":"2024-04-23T23:41:09.053177+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:59:36.009122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"195'819","reported_seq":24537,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505889+0000","last_change":"2024-04-23T23:40:46.959487+0000","last_active":"2024-04-23T23:41:09.505889+0000","last_peered":"2024-04-23T23:41:09.505889+0000","last_clean":"2024-04-23T23:41:09.505889+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:09.505889+0000","last_undegraded":"2024-04-23T23:41:09.505889+0000","last_fullsized":"2024-04-23T23:41:09.505889+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:47.683153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"192'513","reported_seq":8317,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506416+0000","last_change":"2024-04-23T23:40:57.005009+0000","last_active":"2024-04-23T23:41:09.506416+0000","last_peered":"2024-04-23T23:41:09.506416+0000","last_clean":"2024-04-23T23:41:09.506416+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:09.506416+0000","last_undegraded":"2024-04-23T23:41:09.506416+0000","last_fullsized":"2024-04-23T23:41:09.506416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:38.944188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"193'990","reported_seq":13434,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053660+0000","last_change":"2024-04-23T23:40:46.951655+0000","last_active":"2024-04-23T23:41:09.053660+0000","last_peered":"2024-04-23T23:41:09.053660+0000","last_clean":"2024-04-23T23:41:09.053660+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:09.053660+0000","last_undegraded":"2024-04-23T23:41:09.053660+0000","last_fullsized":"2024-04-23T23:41:09.053660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:39.609261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506191+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:41:09.506191+0000","last_peered":"2024-04-23T23:41:09.506191+0000","last_clean":"2024-04-23T23:41:09.506191+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:09.506191+0000","last_undegraded":"2024-04-23T23:41:09.506191+0000","last_fullsized":"2024-04-23T23:41:09.506191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"195'508","reported_seq":6509,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053079+0000","last_change":"2024-04-23T23:40:46.951937+0000","last_active":"2024-04-23T23:41:09.053079+0000","last_peered":"2024-04-23T23:41:09.053079+0000","last_clean":"2024-04-23T23:41:09.053079+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:09.053079+0000","last_undegraded":"2024-04-23T23:41:09.053079+0000","last_fullsized":"2024-04-23T23:41:09.053079+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:34.479922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":406,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505801+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:41:09.505801+0000","last_peered":"2024-04-23T23:41:09.505801+0000","last_clean":"2024-04-23T23:41:09.505801+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:09.505801+0000","last_undegraded":"2024-04-23T23:41:09.505801+0000","last_fullsized":"2024-04-23T23:41:09.505801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"193'808","reported_seq":6934,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053192+0000","last_change":"2024-04-23T23:40:59.839248+0000","last_active":"2024-04-23T23:41:09.053192+0000","last_peered":"2024-04-23T23:41:09.053192+0000","last_clean":"2024-04-23T23:41:09.053192+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:09.053192+0000","last_undegraded":"2024-04-23T23:41:09.053192+0000","last_fullsized":"2024-04-23T23:41:09.053192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:49.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506431+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:41:09.506431+0000","last_peered":"2024-04-23T23:41:09.506431+0000","last_clean":"2024-04-23T23:41:09.506431+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:09.506431+0000","last_undegraded":"2024-04-23T23:41:09.506431+0000","last_fullsized":"2024-04-23T23:41:09.506431+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"192'635","reported_seq":5469,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505587+0000","last_change":"2024-04-23T23:40:58.000674+0000","last_active":"2024-04-23T23:41:09.505587+0000","last_peered":"2024-04-23T23:41:09.505587+0000","last_clean":"2024-04-23T23:41:09.505587+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:09.505587+0000","last_undegraded":"2024-04-23T23:41:09.505587+0000","last_fullsized":"2024-04-23T23:41:09.505587+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:50.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505689+0000","last_change":"2024-04-23T23:40:58.005393+0000","last_active":"2024-04-23T23:41:09.505689+0000","last_peered":"2024-04-23T23:41:09.505689+0000","last_clean":"2024-04-23T23:41:09.505689+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:09.505689+0000","last_undegraded":"2024-04-23T23:41:09.505689+0000","last_fullsized":"2024-04-23T23:41:09.505689+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:41:05.587146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"194'827","reported_seq":3997,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506173+0000","last_change":"2024-04-23T23:41:08.060452+0000","last_active":"2024-04-23T23:41:09.506173+0000","last_peered":"2024-04-23T23:41:09.506173+0000","last_clean":"2024-04-23T23:41:09.506173+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:09.506173+0000","last_undegraded":"2024-04-23T23:41:09.506173+0000","last_fullsized":"2024-04-23T23:41:09.506173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:08.587415+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"195'748","reported_seq":8566,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053593+0000","last_change":"2024-04-23T23:40:46.950766+0000","last_active":"2024-04-23T23:41:09.053593+0000","last_peered":"2024-04-23T23:41:09.053593+0000","last_clean":"2024-04-23T23:41:09.053593+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:09.053593+0000","last_undegraded":"2024-04-23T23:41:09.053593+0000","last_fullsized":"2024-04-23T23:41:09.053593+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:50.475530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505822+0000","last_change":"2024-04-23T23:41:08.169629+0000","last_active":"2024-04-23T23:41:09.505822+0000","last_peered":"2024-04-23T23:41:09.505822+0000","last_clean":"2024-04-23T23:41:09.505822+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:09.505822+0000","last_undegraded":"2024-04-23T23:41:09.505822+0000","last_fullsized":"2024-04-23T23:41:09.505822+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:02.570364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"193'542","reported_seq":3978,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505650+0000","last_change":"2024-04-23T23:40:57.998148+0000","last_active":"2024-04-23T23:41:09.505650+0000","last_peered":"2024-04-23T23:41:09.505650+0000","last_clean":"2024-04-23T23:41:09.505650+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:09.505650+0000","last_undegraded":"2024-04-23T23:41:09.505650+0000","last_fullsized":"2024-04-23T23:41:09.505650+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:26.714306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":426,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505549+0000","last_change":"2024-04-23T23:40:53.840908+0000","last_active":"2024-04-23T23:41:09.505549+0000","last_peered":"2024-04-23T23:41:09.505549+0000","last_clean":"2024-04-23T23:41:09.505549+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:09.505549+0000","last_undegraded":"2024-04-23T23:41:09.505549+0000","last_fullsized":"2024-04-23T23:41:09.505549+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:25.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"192'694","reported_seq":6684,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052844+0000","last_change":"2024-04-23T23:41:03.842535+0000","last_active":"2024-04-23T23:41:09.052844+0000","last_peered":"2024-04-23T23:41:09.052844+0000","last_clean":"2024-04-23T23:41:09.052844+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:09.052844+0000","last_undegraded":"2024-04-23T23:41:09.052844+0000","last_fullsized":"2024-04-23T23:41:09.052844+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:35.426802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506307+0000","last_change":"2024-04-23T23:41:06.111378+0000","last_active":"2024-04-23T23:41:09.506307+0000","last_peered":"2024-04-23T23:41:09.506307+0000","last_clean":"2024-04-23T23:41:09.506307+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:09.506307+0000","last_undegraded":"2024-04-23T23:41:09.506307+0000","last_fullsized":"2024-04-23T23:41:09.506307+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:16.658130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"194'781","reported_seq":4286,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053189+0000","last_change":"2024-04-23T23:40:58.007032+0000","last_active":"2024-04-23T23:41:09.053189+0000","last_peered":"2024-04-23T23:41:09.053189+0000","last_clean":"2024-04-23T23:41:09.053189+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:09.053189+0000","last_undegraded":"2024-04-23T23:41:09.053189+0000","last_fullsized":"2024-04-23T23:41:09.053189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:20.921506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505850+0000","last_change":"2024-04-23T23:41:08.055163+0000","last_active":"2024-04-23T23:41:09.505850+0000","last_peered":"2024-04-23T23:41:09.505850+0000","last_clean":"2024-04-23T23:41:09.505850+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:09.505850+0000","last_undegraded":"2024-04-23T23:41:09.505850+0000","last_fullsized":"2024-04-23T23:41:09.505850+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:28:04.238966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":539,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506366+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:41:09.506366+0000","last_peered":"2024-04-23T23:41:09.506366+0000","last_clean":"2024-04-23T23:41:09.506366+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:09.506366+0000","last_undegraded":"2024-04-23T23:41:09.506366+0000","last_fullsized":"2024-04-23T23:41:09.506366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"193'515","reported_seq":21248,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052952+0000","last_change":"2024-04-23T23:40:57.005334+0000","last_active":"2024-04-23T23:41:09.052952+0000","last_peered":"2024-04-23T23:41:09.052952+0000","last_clean":"2024-04-23T23:41:09.052952+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:09.052952+0000","last_undegraded":"2024-04-23T23:41:09.052952+0000","last_fullsized":"2024-04-23T23:41:09.052952+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.072466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"195'542","reported_seq":5959,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053658+0000","last_change":"2024-04-23T23:40:46.952121+0000","last_active":"2024-04-23T23:41:09.053658+0000","last_peered":"2024-04-23T23:41:09.053658+0000","last_clean":"2024-04-23T23:41:09.053658+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:09.053658+0000","last_undegraded":"2024-04-23T23:41:09.053658+0000","last_fullsized":"2024-04-23T23:41:09.053658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:03.085576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"194'1061","reported_seq":14211,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506057+0000","last_change":"2024-04-23T23:41:03.842188+0000","last_active":"2024-04-23T23:41:09.506057+0000","last_peered":"2024-04-23T23:41:09.506057+0000","last_clean":"2024-04-23T23:41:09.506057+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:09.506057+0000","last_undegraded":"2024-04-23T23:41:09.506057+0000","last_fullsized":"2024-04-23T23:41:09.506057+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:27:51.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"194'593","reported_seq":14871,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053055+0000","last_change":"2024-04-23T23:40:58.839397+0000","last_active":"2024-04-23T23:41:09.053055+0000","last_peered":"2024-04-23T23:41:09.053055+0000","last_clean":"2024-04-23T23:41:09.053055+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:09.053055+0000","last_undegraded":"2024-04-23T23:41:09.053055+0000","last_fullsized":"2024-04-23T23:41:09.053055+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.244095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"193'477","reported_seq":17866,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506130+0000","last_change":"2024-04-23T23:41:08.058546+0000","last_active":"2024-04-23T23:41:09.506130+0000","last_peered":"2024-04-23T23:41:09.506130+0000","last_clean":"2024-04-23T23:41:09.506130+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:09.506130+0000","last_undegraded":"2024-04-23T23:41:09.506130+0000","last_fullsized":"2024-04-23T23:41:09.506130+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:12.587030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"193'615","reported_seq":15497,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506318+0000","last_change":"2024-04-23T23:41:06.043877+0000","last_active":"2024-04-23T23:41:09.506318+0000","last_peered":"2024-04-23T23:41:09.506318+0000","last_clean":"2024-04-23T23:41:09.506318+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:09.506318+0000","last_undegraded":"2024-04-23T23:41:09.506318+0000","last_fullsized":"2024-04-23T23:41:09.506318+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:36.941806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"195'861","reported_seq":5666,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505704+0000","last_change":"2024-04-23T23:40:46.950831+0000","last_active":"2024-04-23T23:41:09.505704+0000","last_peered":"2024-04-23T23:41:09.505704+0000","last_clean":"2024-04-23T23:41:09.505704+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:09.505704+0000","last_undegraded":"2024-04-23T23:41:09.505704+0000","last_fullsized":"2024-04-23T23:41:09.505704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:52.747665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"192'722","reported_seq":12050,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506183+0000","last_change":"2024-04-23T23:41:03.841556+0000","last_active":"2024-04-23T23:41:09.506183+0000","last_peered":"2024-04-23T23:41:09.506183+0000","last_clean":"2024-04-23T23:41:09.506183+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:09.506183+0000","last_undegraded":"2024-04-23T23:41:09.506183+0000","last_fullsized":"2024-04-23T23:41:09.506183+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:39.447349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"193'609","reported_seq":27144,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505909+0000","last_change":"2024-04-23T23:40:46.953889+0000","last_active":"2024-04-23T23:41:09.505909+0000","last_peered":"2024-04-23T23:41:09.505909+0000","last_clean":"2024-04-23T23:41:09.505909+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:09.505909+0000","last_undegraded":"2024-04-23T23:41:09.505909+0000","last_fullsized":"2024-04-23T23:41:09.505909+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:11:52.992581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'513","reported_seq":8473,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:06.042645+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:37.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"193'805","reported_seq":7805,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052811+0000","last_change":"2024-04-23T23:40:46.950968+0000","last_active":"2024-04-23T23:41:09.052811+0000","last_peered":"2024-04-23T23:41:09.052811+0000","last_clean":"2024-04-23T23:41:09.052811+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:09.052811+0000","last_undegraded":"2024-04-23T23:41:09.052811+0000","last_fullsized":"2024-04-23T23:41:09.052811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:24.147887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"194'437","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506347+0000","last_change":"2024-04-23T23:40:46.955255+0000","last_active":"2024-04-23T23:41:09.506347+0000","last_peered":"2024-04-23T23:41:09.506347+0000","last_clean":"2024-04-23T23:41:09.506347+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:09.506347+0000","last_undegraded":"2024-04-23T23:41:09.506347+0000","last_fullsized":"2024-04-23T23:41:09.506347+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:20.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":21916,"ondisk_log_size":21916,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82836,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289004,"statfs":{"total":96636764160,"available":96551940096,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":81590730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51788,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320052,"statfs":{"total":96636764160,"available":96583733248,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855401,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61200,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94310640,"statfs":{"total":96636764160,"available":96574095360,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192529,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42780,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329060,"statfs":{"total":96636764160,"available":96592957440,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55948,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315892,"statfs":{"total":96636764160,"available":96579473408,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:12.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:12.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:12.816 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-23T23:41:12.243056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22033,"ondisk_log_size":22033,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467172,"kb_used_data":21656,"kb_used_omap":20,"kb_used_meta":445355,"kb_avail":754507548,"statfs":{"total":773094113280,"available":772615729152,"internally_reserved":0,"allocated":22175744,"data_stored":11429184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":456043980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001194"},"pg_stats":[{"pgid":"3.1f","version":"195'850","reported_seq":6388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053268+0000","last_change":"2024-04-23T23:40:46.952803+0000","last_active":"2024-04-23T23:41:09.053268+0000","last_peered":"2024-04-23T23:41:09.053268+0000","last_clean":"2024-04-23T23:41:09.053268+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:09.053268+0000","last_undegraded":"2024-04-23T23:41:09.053268+0000","last_fullsized":"2024-04-23T23:41:09.053268+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:29.685374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'523","reported_seq":5131,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053031+0000","last_change":"2024-04-23T23:40:58.839474+0000","last_active":"2024-04-23T23:41:09.053031+0000","last_peered":"2024-04-23T23:41:09.053031+0000","last_clean":"2024-04-23T23:41:09.053031+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:09.053031+0000","last_undegraded":"2024-04-23T23:41:09.053031+0000","last_fullsized":"2024-04-23T23:41:09.053031+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:59.446652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"193'665","reported_seq":23785,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:08.059066+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:38.056866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"195'773","reported_seq":16975,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506021+0000","last_change":"2024-04-23T23:41:08.058573+0000","last_active":"2024-04-23T23:41:09.506021+0000","last_peered":"2024-04-23T23:41:09.506021+0000","last_clean":"2024-04-23T23:41:09.506021+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:09.506021+0000","last_undegraded":"2024-04-23T23:41:09.506021+0000","last_fullsized":"2024-04-23T23:41:09.506021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:02.250704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"192'846","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052885+0000","last_change":"2024-04-23T23:40:46.952426+0000","last_active":"2024-04-23T23:41:09.052885+0000","last_peered":"2024-04-23T23:41:09.052885+0000","last_clean":"2024-04-23T23:41:09.052885+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:09.052885+0000","last_undegraded":"2024-04-23T23:41:09.052885+0000","last_fullsized":"2024-04-23T23:41:09.052885+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:18.804252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"195'770","reported_seq":17589,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053552+0000","last_change":"2024-04-23T23:40:46.952178+0000","last_active":"2024-04-23T23:41:09.053552+0000","last_peered":"2024-04-23T23:41:09.053552+0000","last_clean":"2024-04-23T23:41:09.053552+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:09.053552+0000","last_undegraded":"2024-04-23T23:41:09.053552+0000","last_fullsized":"2024-04-23T23:41:09.053552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:46.733880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"194'691","reported_seq":9606,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505707+0000","last_change":"2024-04-23T23:40:59.005552+0000","last_active":"2024-04-23T23:41:09.505707+0000","last_peered":"2024-04-23T23:41:09.505707+0000","last_clean":"2024-04-23T23:41:09.505707+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:09.505707+0000","last_undegraded":"2024-04-23T23:41:09.505707+0000","last_fullsized":"2024-04-23T23:41:09.505707+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:51.413923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"192'527","reported_seq":3734,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053080+0000","last_change":"2024-04-23T23:40:58.009381+0000","last_active":"2024-04-23T23:41:09.053080+0000","last_peered":"2024-04-23T23:41:09.053080+0000","last_clean":"2024-04-23T23:41:09.053080+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:09.053080+0000","last_undegraded":"2024-04-23T23:41:09.053080+0000","last_fullsized":"2024-04-23T23:41:09.053080+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.551844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"194'656","reported_seq":6150,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053177+0000","last_change":"2024-04-23T23:40:46.953281+0000","last_active":"2024-04-23T23:41:09.053177+0000","last_peered":"2024-04-23T23:41:09.053177+0000","last_clean":"2024-04-23T23:41:09.053177+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:09.053177+0000","last_undegraded":"2024-04-23T23:41:09.053177+0000","last_fullsized":"2024-04-23T23:41:09.053177+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:59:36.009122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"195'819","reported_seq":24537,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505889+0000","last_change":"2024-04-23T23:40:46.959487+0000","last_active":"2024-04-23T23:41:09.505889+0000","last_peered":"2024-04-23T23:41:09.505889+0000","last_clean":"2024-04-23T23:41:09.505889+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:09.505889+0000","last_undegraded":"2024-04-23T23:41:09.505889+0000","last_fullsized":"2024-04-23T23:41:09.505889+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:47.683153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"192'513","reported_seq":8317,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506416+0000","last_change":"2024-04-23T23:40:57.005009+0000","last_active":"2024-04-23T23:41:09.506416+0000","last_peered":"2024-04-23T23:41:09.506416+0000","last_clean":"2024-04-23T23:41:09.506416+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:09.506416+0000","last_undegraded":"2024-04-23T23:41:09.506416+0000","last_fullsized":"2024-04-23T23:41:09.506416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:38.944188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"193'990","reported_seq":13434,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053660+0000","last_change":"2024-04-23T23:40:46.951655+0000","last_active":"2024-04-23T23:41:09.053660+0000","last_peered":"2024-04-23T23:41:09.053660+0000","last_clean":"2024-04-23T23:41:09.053660+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:09.053660+0000","last_undegraded":"2024-04-23T23:41:09.053660+0000","last_fullsized":"2024-04-23T23:41:09.053660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:39.609261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506191+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:41:09.506191+0000","last_peered":"2024-04-23T23:41:09.506191+0000","last_clean":"2024-04-23T23:41:09.506191+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:09.506191+0000","last_undegraded":"2024-04-23T23:41:09.506191+0000","last_fullsized":"2024-04-23T23:41:09.506191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"195'508","reported_seq":6509,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053079+0000","last_change":"2024-04-23T23:40:46.951937+0000","last_active":"2024-04-23T23:41:09.053079+0000","last_peered":"2024-04-23T23:41:09.053079+0000","last_clean":"2024-04-23T23:41:09.053079+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:09.053079+0000","last_undegraded":"2024-04-23T23:41:09.053079+0000","last_fullsized":"2024-04-23T23:41:09.053079+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:34.479922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":406,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505801+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:41:09.505801+0000","last_peered":"2024-04-23T23:41:09.505801+0000","last_clean":"2024-04-23T23:41:09.505801+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:09.505801+0000","last_undegraded":"2024-04-23T23:41:09.505801+0000","last_fullsized":"2024-04-23T23:41:09.505801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"193'808","reported_seq":6934,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053192+0000","last_change":"2024-04-23T23:40:59.839248+0000","last_active":"2024-04-23T23:41:09.053192+0000","last_peered":"2024-04-23T23:41:09.053192+0000","last_clean":"2024-04-23T23:41:09.053192+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:09.053192+0000","last_undegraded":"2024-04-23T23:41:09.053192+0000","last_fullsized":"2024-04-23T23:41:09.053192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:49.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506431+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:41:09.506431+0000","last_peered":"2024-04-23T23:41:09.506431+0000","last_clean":"2024-04-23T23:41:09.506431+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:09.506431+0000","last_undegraded":"2024-04-23T23:41:09.506431+0000","last_fullsized":"2024-04-23T23:41:09.506431+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"192'635","reported_seq":5469,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505587+0000","last_change":"2024-04-23T23:40:58.000674+0000","last_active":"2024-04-23T23:41:09.505587+0000","last_peered":"2024-04-23T23:41:09.505587+0000","last_clean":"2024-04-23T23:41:09.505587+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:09.505587+0000","last_undegraded":"2024-04-23T23:41:09.505587+0000","last_fullsized":"2024-04-23T23:41:09.505587+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:50.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505689+0000","last_change":"2024-04-23T23:40:58.005393+0000","last_active":"2024-04-23T23:41:09.505689+0000","last_peered":"2024-04-23T23:41:09.505689+0000","last_clean":"2024-04-23T23:41:09.505689+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:09.505689+0000","last_undegraded":"2024-04-23T23:41:09.505689+0000","last_fullsized":"2024-04-23T23:41:09.505689+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:41:05.587146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"194'827","reported_seq":3997,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506173+0000","last_change":"2024-04-23T23:41:08.060452+0000","last_active":"2024-04-23T23:41:09.506173+0000","last_peered":"2024-04-23T23:41:09.506173+0000","last_clean":"2024-04-23T23:41:09.506173+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:09.506173+0000","last_undegraded":"2024-04-23T23:41:09.506173+0000","last_fullsized":"2024-04-23T23:41:09.506173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:08.587415+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"195'748","reported_seq":8566,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053593+0000","last_change":"2024-04-23T23:40:46.950766+0000","last_active":"2024-04-23T23:41:09.053593+0000","last_peered":"2024-04-23T23:41:09.053593+0000","last_clean":"2024-04-23T23:41:09.053593+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:09.053593+0000","last_undegraded":"2024-04-23T23:41:09.053593+0000","last_fullsized":"2024-04-23T23:41:09.053593+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:50.475530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505822+0000","last_change":"2024-04-23T23:41:08.169629+0000","last_active":"2024-04-23T23:41:09.505822+0000","last_peered":"2024-04-23T23:41:09.505822+0000","last_clean":"2024-04-23T23:41:09.505822+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:09.505822+0000","last_undegraded":"2024-04-23T23:41:09.505822+0000","last_fullsized":"2024-04-23T23:41:09.505822+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:02.570364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"193'542","reported_seq":3978,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505650+0000","last_change":"2024-04-23T23:40:57.998148+0000","last_active":"2024-04-23T23:41:09.505650+0000","last_peered":"2024-04-23T23:41:09.505650+0000","last_clean":"2024-04-23T23:41:09.505650+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:09.505650+0000","last_undegraded":"2024-04-23T23:41:09.505650+0000","last_fullsized":"2024-04-23T23:41:09.505650+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:26.714306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":426,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505549+0000","last_change":"2024-04-23T23:40:53.840908+0000","last_active":"2024-04-23T23:41:09.505549+0000","last_peered":"2024-04-23T23:41:09.505549+0000","last_clean":"2024-04-23T23:41:09.505549+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:09.505549+0000","last_undegraded":"2024-04-23T23:41:09.505549+0000","last_fullsized":"2024-04-23T23:41:09.505549+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:25.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"192'694","reported_seq":6684,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052844+0000","last_change":"2024-04-23T23:41:03.842535+0000","last_active":"2024-04-23T23:41:09.052844+0000","last_peered":"2024-04-23T23:41:09.052844+0000","last_clean":"2024-04-23T23:41:09.052844+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:09.052844+0000","last_undegraded":"2024-04-23T23:41:09.052844+0000","last_fullsized":"2024-04-23T23:41:09.052844+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:35.426802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506307+0000","last_change":"2024-04-23T23:41:06.111378+0000","last_active":"2024-04-23T23:41:09.506307+0000","last_peered":"2024-04-23T23:41:09.506307+0000","last_clean":"2024-04-23T23:41:09.506307+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:09.506307+0000","last_undegraded":"2024-04-23T23:41:09.506307+0000","last_fullsized":"2024-04-23T23:41:09.506307+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:16.658130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"194'781","reported_seq":4286,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053189+0000","last_change":"2024-04-23T23:40:58.007032+0000","last_active":"2024-04-23T23:41:09.053189+0000","last_peered":"2024-04-23T23:41:09.053189+0000","last_clean":"2024-04-23T23:41:09.053189+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:09.053189+0000","last_undegraded":"2024-04-23T23:41:09.053189+0000","last_fullsized":"2024-04-23T23:41:09.053189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:20.921506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505850+0000","last_change":"2024-04-23T23:41:08.055163+0000","last_active":"2024-04-23T23:41:09.505850+0000","last_peered":"2024-04-23T23:41:09.505850+0000","last_clean":"2024-04-23T23:41:09.505850+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:09.505850+0000","last_undegraded":"2024-04-23T23:41:09.505850+0000","last_fullsized":"2024-04-23T23:41:09.505850+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:28:04.238966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":539,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506366+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:41:09.506366+0000","last_peered":"2024-04-23T23:41:09.506366+0000","last_clean":"2024-04-23T23:41:09.506366+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:09.506366+0000","last_undegraded":"2024-04-23T23:41:09.506366+0000","last_fullsized":"2024-04-23T23:41:09.506366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"193'515","reported_seq":21248,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052952+0000","last_change":"2024-04-23T23:40:57.005334+0000","last_active":"2024-04-23T23:41:09.052952+0000","last_peered":"2024-04-23T23:41:09.052952+0000","last_clean":"2024-04-23T23:41:09.052952+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:09.052952+0000","last_undegraded":"2024-04-23T23:41:09.052952+0000","last_fullsized":"2024-04-23T23:41:09.052952+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.072466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"195'542","reported_seq":5959,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053658+0000","last_change":"2024-04-23T23:40:46.952121+0000","last_active":"2024-04-23T23:41:09.053658+0000","last_peered":"2024-04-23T23:41:09.053658+0000","last_clean":"2024-04-23T23:41:09.053658+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:09.053658+0000","last_undegraded":"2024-04-23T23:41:09.053658+0000","last_fullsized":"2024-04-23T23:41:09.053658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:03.085576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"194'1061","reported_seq":14211,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506057+0000","last_change":"2024-04-23T23:41:03.842188+0000","last_active":"2024-04-23T23:41:09.506057+0000","last_peered":"2024-04-23T23:41:09.506057+0000","last_clean":"2024-04-23T23:41:09.506057+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:09.506057+0000","last_undegraded":"2024-04-23T23:41:09.506057+0000","last_fullsized":"2024-04-23T23:41:09.506057+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:27:51.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"194'593","reported_seq":14871,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053055+0000","last_change":"2024-04-23T23:40:58.839397+0000","last_active":"2024-04-23T23:41:09.053055+0000","last_peered":"2024-04-23T23:41:09.053055+0000","last_clean":"2024-04-23T23:41:09.053055+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:09.053055+0000","last_undegraded":"2024-04-23T23:41:09.053055+0000","last_fullsized":"2024-04-23T23:41:09.053055+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.244095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"193'477","reported_seq":17866,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506130+0000","last_change":"2024-04-23T23:41:08.058546+0000","last_active":"2024-04-23T23:41:09.506130+0000","last_peered":"2024-04-23T23:41:09.506130+0000","last_clean":"2024-04-23T23:41:09.506130+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:09.506130+0000","last_undegraded":"2024-04-23T23:41:09.506130+0000","last_fullsized":"2024-04-23T23:41:09.506130+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:12.587030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"193'615","reported_seq":15497,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506318+0000","last_change":"2024-04-23T23:41:06.043877+0000","last_active":"2024-04-23T23:41:09.506318+0000","last_peered":"2024-04-23T23:41:09.506318+0000","last_clean":"2024-04-23T23:41:09.506318+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:09.506318+0000","last_undegraded":"2024-04-23T23:41:09.506318+0000","last_fullsized":"2024-04-23T23:41:09.506318+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:36.941806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"195'861","reported_seq":5666,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505704+0000","last_change":"2024-04-23T23:40:46.950831+0000","last_active":"2024-04-23T23:41:09.505704+0000","last_peered":"2024-04-23T23:41:09.505704+0000","last_clean":"2024-04-23T23:41:09.505704+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:09.505704+0000","last_undegraded":"2024-04-23T23:41:09.505704+0000","last_fullsized":"2024-04-23T23:41:09.505704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:52.747665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"192'722","reported_seq":12050,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506183+0000","last_change":"2024-04-23T23:41:03.841556+0000","last_active":"2024-04-23T23:41:09.506183+0000","last_peered":"2024-04-23T23:41:09.506183+0000","last_clean":"2024-04-23T23:41:09.506183+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:09.506183+0000","last_undegraded":"2024-04-23T23:41:09.506183+0000","last_fullsized":"2024-04-23T23:41:09.506183+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:39.447349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"193'609","reported_seq":27144,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505909+0000","last_change":"2024-04-23T23:40:46.953889+0000","last_active":"2024-04-23T23:41:09.505909+0000","last_peered":"2024-04-23T23:41:09.505909+0000","last_clean":"2024-04-23T23:41:09.505909+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:09.505909+0000","last_undegraded":"2024-04-23T23:41:09.505909+0000","last_fullsized":"2024-04-23T23:41:09.505909+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:11:52.992581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'513","reported_seq":8473,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:06.042645+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:37.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"193'805","reported_seq":7805,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052811+0000","last_change":"2024-04-23T23:40:46.950968+0000","last_active":"2024-04-23T23:41:09.052811+0000","last_peered":"2024-04-23T23:41:09.052811+0000","last_clean":"2024-04-23T23:41:09.052811+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:09.052811+0000","last_undegraded":"2024-04-23T23:41:09.052811+0000","last_fullsized":"2024-04-23T23:41:09.052811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:24.147887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"194'437","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506347+0000","last_change":"2024-04-23T23:40:46.955255+0000","last_active":"2024-04-23T23:41:09.506347+0000","last_peered":"2024-04-23T23:41:09.506347+0000","last_clean":"2024-04-23T23:41:09.506347+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:09.506347+0000","last_undegraded":"2024-04-23T23:41:09.506347+0000","last_fullsized":"2024-04-23T23:41:09.506347+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:20.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":21916,"ondisk_log_size":21916,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82836,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289004,"statfs":{"total":96636764160,"available":96551940096,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":81590730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51788,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320052,"statfs":{"total":96636764160,"available":96583733248,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855401,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61200,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94310640,"statfs":{"total":96636764160,"available":96574095360,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192529,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42780,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329060,"statfs":{"total":96636764160,"available":96592957440,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55948,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315892,"statfs":{"total":96636764160,"available":96579473408,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:12.818 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-23T23:41:12.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-23T23:41:13.124 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T23:41:13.133 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T23:41:13.133 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:13.412 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:13.413 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:13.424 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-23T23:41:12.243056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22033,"ondisk_log_size":22033,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467172,"kb_used_data":21656,"kb_used_omap":20,"kb_used_meta":445355,"kb_avail":754507548,"statfs":{"total":773094113280,"available":772615729152,"internally_reserved":0,"allocated":22175744,"data_stored":11429184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":456043980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001194"},"pg_stats":[{"pgid":"3.1f","version":"195'850","reported_seq":6388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053268+0000","last_change":"2024-04-23T23:40:46.952803+0000","last_active":"2024-04-23T23:41:09.053268+0000","last_peered":"2024-04-23T23:41:09.053268+0000","last_clean":"2024-04-23T23:41:09.053268+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:09.053268+0000","last_undegraded":"2024-04-23T23:41:09.053268+0000","last_fullsized":"2024-04-23T23:41:09.053268+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:29.685374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'523","reported_seq":5131,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053031+0000","last_change":"2024-04-23T23:40:58.839474+0000","last_active":"2024-04-23T23:41:09.053031+0000","last_peered":"2024-04-23T23:41:09.053031+0000","last_clean":"2024-04-23T23:41:09.053031+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:09.053031+0000","last_undegraded":"2024-04-23T23:41:09.053031+0000","last_fullsized":"2024-04-23T23:41:09.053031+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:59.446652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"193'665","reported_seq":23785,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:08.059066+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:38.056866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"195'773","reported_seq":16975,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506021+0000","last_change":"2024-04-23T23:41:08.058573+0000","last_active":"2024-04-23T23:41:09.506021+0000","last_peered":"2024-04-23T23:41:09.506021+0000","last_clean":"2024-04-23T23:41:09.506021+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:09.506021+0000","last_undegraded":"2024-04-23T23:41:09.506021+0000","last_fullsized":"2024-04-23T23:41:09.506021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:02.250704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"192'846","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052885+0000","last_change":"2024-04-23T23:40:46.952426+0000","last_active":"2024-04-23T23:41:09.052885+0000","last_peered":"2024-04-23T23:41:09.052885+0000","last_clean":"2024-04-23T23:41:09.052885+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:09.052885+0000","last_undegraded":"2024-04-23T23:41:09.052885+0000","last_fullsized":"2024-04-23T23:41:09.052885+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:18.804252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"195'770","reported_seq":17589,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053552+0000","last_change":"2024-04-23T23:40:46.952178+0000","last_active":"2024-04-23T23:41:09.053552+0000","last_peered":"2024-04-23T23:41:09.053552+0000","last_clean":"2024-04-23T23:41:09.053552+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:09.053552+0000","last_undegraded":"2024-04-23T23:41:09.053552+0000","last_fullsized":"2024-04-23T23:41:09.053552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:46.733880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"194'691","reported_seq":9606,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505707+0000","last_change":"2024-04-23T23:40:59.005552+0000","last_active":"2024-04-23T23:41:09.505707+0000","last_peered":"2024-04-23T23:41:09.505707+0000","last_clean":"2024-04-23T23:41:09.505707+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:09.505707+0000","last_undegraded":"2024-04-23T23:41:09.505707+0000","last_fullsized":"2024-04-23T23:41:09.505707+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:51.413923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"192'527","reported_seq":3734,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053080+0000","last_change":"2024-04-23T23:40:58.009381+0000","last_active":"2024-04-23T23:41:09.053080+0000","last_peered":"2024-04-23T23:41:09.053080+0000","last_clean":"2024-04-23T23:41:09.053080+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:09.053080+0000","last_undegraded":"2024-04-23T23:41:09.053080+0000","last_fullsized":"2024-04-23T23:41:09.053080+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.551844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"194'656","reported_seq":6150,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053177+0000","last_change":"2024-04-23T23:40:46.953281+0000","last_active":"2024-04-23T23:41:09.053177+0000","last_peered":"2024-04-23T23:41:09.053177+0000","last_clean":"2024-04-23T23:41:09.053177+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:09.053177+0000","last_undegraded":"2024-04-23T23:41:09.053177+0000","last_fullsized":"2024-04-23T23:41:09.053177+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:59:36.009122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"195'819","reported_seq":24537,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505889+0000","last_change":"2024-04-23T23:40:46.959487+0000","last_active":"2024-04-23T23:41:09.505889+0000","last_peered":"2024-04-23T23:41:09.505889+0000","last_clean":"2024-04-23T23:41:09.505889+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:09.505889+0000","last_undegraded":"2024-04-23T23:41:09.505889+0000","last_fullsized":"2024-04-23T23:41:09.505889+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:47.683153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"192'513","reported_seq":8317,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506416+0000","last_change":"2024-04-23T23:40:57.005009+0000","last_active":"2024-04-23T23:41:09.506416+0000","last_peered":"2024-04-23T23:41:09.506416+0000","last_clean":"2024-04-23T23:41:09.506416+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:09.506416+0000","last_undegraded":"2024-04-23T23:41:09.506416+0000","last_fullsized":"2024-04-23T23:41:09.506416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:38.944188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"193'990","reported_seq":13434,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053660+0000","last_change":"2024-04-23T23:40:46.951655+0000","last_active":"2024-04-23T23:41:09.053660+0000","last_peered":"2024-04-23T23:41:09.053660+0000","last_clean":"2024-04-23T23:41:09.053660+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:09.053660+0000","last_undegraded":"2024-04-23T23:41:09.053660+0000","last_fullsized":"2024-04-23T23:41:09.053660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:39.609261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506191+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:41:09.506191+0000","last_peered":"2024-04-23T23:41:09.506191+0000","last_clean":"2024-04-23T23:41:09.506191+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:09.506191+0000","last_undegraded":"2024-04-23T23:41:09.506191+0000","last_fullsized":"2024-04-23T23:41:09.506191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"195'508","reported_seq":6509,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053079+0000","last_change":"2024-04-23T23:40:46.951937+0000","last_active":"2024-04-23T23:41:09.053079+0000","last_peered":"2024-04-23T23:41:09.053079+0000","last_clean":"2024-04-23T23:41:09.053079+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:09.053079+0000","last_undegraded":"2024-04-23T23:41:09.053079+0000","last_fullsized":"2024-04-23T23:41:09.053079+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:34.479922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":406,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505801+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:41:09.505801+0000","last_peered":"2024-04-23T23:41:09.505801+0000","last_clean":"2024-04-23T23:41:09.505801+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:09.505801+0000","last_undegraded":"2024-04-23T23:41:09.505801+0000","last_fullsized":"2024-04-23T23:41:09.505801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"193'808","reported_seq":6934,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053192+0000","last_change":"2024-04-23T23:40:59.839248+0000","last_active":"2024-04-23T23:41:09.053192+0000","last_peered":"2024-04-23T23:41:09.053192+0000","last_clean":"2024-04-23T23:41:09.053192+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:09.053192+0000","last_undegraded":"2024-04-23T23:41:09.053192+0000","last_fullsized":"2024-04-23T23:41:09.053192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:49.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506431+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:41:09.506431+0000","last_peered":"2024-04-23T23:41:09.506431+0000","last_clean":"2024-04-23T23:41:09.506431+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:09.506431+0000","last_undegraded":"2024-04-23T23:41:09.506431+0000","last_fullsized":"2024-04-23T23:41:09.506431+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"192'635","reported_seq":5469,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505587+0000","last_change":"2024-04-23T23:40:58.000674+0000","last_active":"2024-04-23T23:41:09.505587+0000","last_peered":"2024-04-23T23:41:09.505587+0000","last_clean":"2024-04-23T23:41:09.505587+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:09.505587+0000","last_undegraded":"2024-04-23T23:41:09.505587+0000","last_fullsized":"2024-04-23T23:41:09.505587+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:50.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505689+0000","last_change":"2024-04-23T23:40:58.005393+0000","last_active":"2024-04-23T23:41:09.505689+0000","last_peered":"2024-04-23T23:41:09.505689+0000","last_clean":"2024-04-23T23:41:09.505689+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:09.505689+0000","last_undegraded":"2024-04-23T23:41:09.505689+0000","last_fullsized":"2024-04-23T23:41:09.505689+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:41:05.587146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"194'827","reported_seq":3997,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506173+0000","last_change":"2024-04-23T23:41:08.060452+0000","last_active":"2024-04-23T23:41:09.506173+0000","last_peered":"2024-04-23T23:41:09.506173+0000","last_clean":"2024-04-23T23:41:09.506173+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:09.506173+0000","last_undegraded":"2024-04-23T23:41:09.506173+0000","last_fullsized":"2024-04-23T23:41:09.506173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:08.587415+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"195'748","reported_seq":8566,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053593+0000","last_change":"2024-04-23T23:40:46.950766+0000","last_active":"2024-04-23T23:41:09.053593+0000","last_peered":"2024-04-23T23:41:09.053593+0000","last_clean":"2024-04-23T23:41:09.053593+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:09.053593+0000","last_undegraded":"2024-04-23T23:41:09.053593+0000","last_fullsized":"2024-04-23T23:41:09.053593+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:50.475530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505822+0000","last_change":"2024-04-23T23:41:08.169629+0000","last_active":"2024-04-23T23:41:09.505822+0000","last_peered":"2024-04-23T23:41:09.505822+0000","last_clean":"2024-04-23T23:41:09.505822+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:09.505822+0000","last_undegraded":"2024-04-23T23:41:09.505822+0000","last_fullsized":"2024-04-23T23:41:09.505822+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:02.570364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"193'542","reported_seq":3978,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505650+0000","last_change":"2024-04-23T23:40:57.998148+0000","last_active":"2024-04-23T23:41:09.505650+0000","last_peered":"2024-04-23T23:41:09.505650+0000","last_clean":"2024-04-23T23:41:09.505650+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:09.505650+0000","last_undegraded":"2024-04-23T23:41:09.505650+0000","last_fullsized":"2024-04-23T23:41:09.505650+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:26.714306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":426,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505549+0000","last_change":"2024-04-23T23:40:53.840908+0000","last_active":"2024-04-23T23:41:09.505549+0000","last_peered":"2024-04-23T23:41:09.505549+0000","last_clean":"2024-04-23T23:41:09.505549+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:09.505549+0000","last_undegraded":"2024-04-23T23:41:09.505549+0000","last_fullsized":"2024-04-23T23:41:09.505549+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:25.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"192'694","reported_seq":6684,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052844+0000","last_change":"2024-04-23T23:41:03.842535+0000","last_active":"2024-04-23T23:41:09.052844+0000","last_peered":"2024-04-23T23:41:09.052844+0000","last_clean":"2024-04-23T23:41:09.052844+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:09.052844+0000","last_undegraded":"2024-04-23T23:41:09.052844+0000","last_fullsized":"2024-04-23T23:41:09.052844+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:35.426802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506307+0000","last_change":"2024-04-23T23:41:06.111378+0000","last_active":"2024-04-23T23:41:09.506307+0000","last_peered":"2024-04-23T23:41:09.506307+0000","last_clean":"2024-04-23T23:41:09.506307+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:09.506307+0000","last_undegraded":"2024-04-23T23:41:09.506307+0000","last_fullsized":"2024-04-23T23:41:09.506307+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:16.658130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"194'781","reported_seq":4286,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053189+0000","last_change":"2024-04-23T23:40:58.007032+0000","last_active":"2024-04-23T23:41:09.053189+0000","last_peered":"2024-04-23T23:41:09.053189+0000","last_clean":"2024-04-23T23:41:09.053189+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:09.053189+0000","last_undegraded":"2024-04-23T23:41:09.053189+0000","last_fullsized":"2024-04-23T23:41:09.053189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:20.921506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505850+0000","last_change":"2024-04-23T23:41:08.055163+0000","last_active":"2024-04-23T23:41:09.505850+0000","last_peered":"2024-04-23T23:41:09.505850+0000","last_clean":"2024-04-23T23:41:09.505850+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:09.505850+0000","last_undegraded":"2024-04-23T23:41:09.505850+0000","last_fullsized":"2024-04-23T23:41:09.505850+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:28:04.238966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":539,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506366+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:41:09.506366+0000","last_peered":"2024-04-23T23:41:09.506366+0000","last_clean":"2024-04-23T23:41:09.506366+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:09.506366+0000","last_undegraded":"2024-04-23T23:41:09.506366+0000","last_fullsized":"2024-04-23T23:41:09.506366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"193'515","reported_seq":21248,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052952+0000","last_change":"2024-04-23T23:40:57.005334+0000","last_active":"2024-04-23T23:41:09.052952+0000","last_peered":"2024-04-23T23:41:09.052952+0000","last_clean":"2024-04-23T23:41:09.052952+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:09.052952+0000","last_undegraded":"2024-04-23T23:41:09.052952+0000","last_fullsized":"2024-04-23T23:41:09.052952+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.072466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"195'542","reported_seq":5959,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053658+0000","last_change":"2024-04-23T23:40:46.952121+0000","last_active":"2024-04-23T23:41:09.053658+0000","last_peered":"2024-04-23T23:41:09.053658+0000","last_clean":"2024-04-23T23:41:09.053658+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:09.053658+0000","last_undegraded":"2024-04-23T23:41:09.053658+0000","last_fullsized":"2024-04-23T23:41:09.053658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:03.085576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"194'1061","reported_seq":14211,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506057+0000","last_change":"2024-04-23T23:41:03.842188+0000","last_active":"2024-04-23T23:41:09.506057+0000","last_peered":"2024-04-23T23:41:09.506057+0000","last_clean":"2024-04-23T23:41:09.506057+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:09.506057+0000","last_undegraded":"2024-04-23T23:41:09.506057+0000","last_fullsized":"2024-04-23T23:41:09.506057+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:27:51.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"194'593","reported_seq":14871,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053055+0000","last_change":"2024-04-23T23:40:58.839397+0000","last_active":"2024-04-23T23:41:09.053055+0000","last_peered":"2024-04-23T23:41:09.053055+0000","last_clean":"2024-04-23T23:41:09.053055+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:09.053055+0000","last_undegraded":"2024-04-23T23:41:09.053055+0000","last_fullsized":"2024-04-23T23:41:09.053055+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.244095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"193'477","reported_seq":17866,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506130+0000","last_change":"2024-04-23T23:41:08.058546+0000","last_active":"2024-04-23T23:41:09.506130+0000","last_peered":"2024-04-23T23:41:09.506130+0000","last_clean":"2024-04-23T23:41:09.506130+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:09.506130+0000","last_undegraded":"2024-04-23T23:41:09.506130+0000","last_fullsized":"2024-04-23T23:41:09.506130+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:12.587030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"193'615","reported_seq":15497,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506318+0000","last_change":"2024-04-23T23:41:06.043877+0000","last_active":"2024-04-23T23:41:09.506318+0000","last_peered":"2024-04-23T23:41:09.506318+0000","last_clean":"2024-04-23T23:41:09.506318+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:09.506318+0000","last_undegraded":"2024-04-23T23:41:09.506318+0000","last_fullsized":"2024-04-23T23:41:09.506318+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:36.941806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"195'861","reported_seq":5666,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505704+0000","last_change":"2024-04-23T23:40:46.950831+0000","last_active":"2024-04-23T23:41:09.505704+0000","last_peered":"2024-04-23T23:41:09.505704+0000","last_clean":"2024-04-23T23:41:09.505704+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:09.505704+0000","last_undegraded":"2024-04-23T23:41:09.505704+0000","last_fullsized":"2024-04-23T23:41:09.505704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:52.747665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"192'722","reported_seq":12050,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506183+0000","last_change":"2024-04-23T23:41:03.841556+0000","last_active":"2024-04-23T23:41:09.506183+0000","last_peered":"2024-04-23T23:41:09.506183+0000","last_clean":"2024-04-23T23:41:09.506183+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:09.506183+0000","last_undegraded":"2024-04-23T23:41:09.506183+0000","last_fullsized":"2024-04-23T23:41:09.506183+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:39.447349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"193'609","reported_seq":27144,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505909+0000","last_change":"2024-04-23T23:40:46.953889+0000","last_active":"2024-04-23T23:41:09.505909+0000","last_peered":"2024-04-23T23:41:09.505909+0000","last_clean":"2024-04-23T23:41:09.505909+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:09.505909+0000","last_undegraded":"2024-04-23T23:41:09.505909+0000","last_fullsized":"2024-04-23T23:41:09.505909+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:11:52.992581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'513","reported_seq":8473,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:06.042645+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:37.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"193'805","reported_seq":7805,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052811+0000","last_change":"2024-04-23T23:40:46.950968+0000","last_active":"2024-04-23T23:41:09.052811+0000","last_peered":"2024-04-23T23:41:09.052811+0000","last_clean":"2024-04-23T23:41:09.052811+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:09.052811+0000","last_undegraded":"2024-04-23T23:41:09.052811+0000","last_fullsized":"2024-04-23T23:41:09.052811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:24.147887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"194'437","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506347+0000","last_change":"2024-04-23T23:40:46.955255+0000","last_active":"2024-04-23T23:41:09.506347+0000","last_peered":"2024-04-23T23:41:09.506347+0000","last_clean":"2024-04-23T23:41:09.506347+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:09.506347+0000","last_undegraded":"2024-04-23T23:41:09.506347+0000","last_fullsized":"2024-04-23T23:41:09.506347+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:20.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":21916,"ondisk_log_size":21916,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82836,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289004,"statfs":{"total":96636764160,"available":96551940096,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":81590730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51788,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320052,"statfs":{"total":96636764160,"available":96583733248,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855401,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61200,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94310640,"statfs":{"total":96636764160,"available":96574095360,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192529,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42780,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329060,"statfs":{"total":96636764160,"available":96592957440,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55948,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315892,"statfs":{"total":96636764160,"available":96579473408,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:13.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:13.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:13.735 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:13.747 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-23T23:41:12.243056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22033,"ondisk_log_size":22033,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467172,"kb_used_data":21656,"kb_used_omap":20,"kb_used_meta":445355,"kb_avail":754507548,"statfs":{"total":773094113280,"available":772615729152,"internally_reserved":0,"allocated":22175744,"data_stored":11429184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":456043980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001194"},"pg_stats":[{"pgid":"3.1f","version":"195'850","reported_seq":6388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053268+0000","last_change":"2024-04-23T23:40:46.952803+0000","last_active":"2024-04-23T23:41:09.053268+0000","last_peered":"2024-04-23T23:41:09.053268+0000","last_clean":"2024-04-23T23:41:09.053268+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:09.053268+0000","last_undegraded":"2024-04-23T23:41:09.053268+0000","last_fullsized":"2024-04-23T23:41:09.053268+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:29.685374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'523","reported_seq":5131,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053031+0000","last_change":"2024-04-23T23:40:58.839474+0000","last_active":"2024-04-23T23:41:09.053031+0000","last_peered":"2024-04-23T23:41:09.053031+0000","last_clean":"2024-04-23T23:41:09.053031+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:09.053031+0000","last_undegraded":"2024-04-23T23:41:09.053031+0000","last_fullsized":"2024-04-23T23:41:09.053031+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:59.446652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"193'665","reported_seq":23785,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:08.059066+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:38.056866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"195'773","reported_seq":16975,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506021+0000","last_change":"2024-04-23T23:41:08.058573+0000","last_active":"2024-04-23T23:41:09.506021+0000","last_peered":"2024-04-23T23:41:09.506021+0000","last_clean":"2024-04-23T23:41:09.506021+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:09.506021+0000","last_undegraded":"2024-04-23T23:41:09.506021+0000","last_fullsized":"2024-04-23T23:41:09.506021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:02.250704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"192'846","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052885+0000","last_change":"2024-04-23T23:40:46.952426+0000","last_active":"2024-04-23T23:41:09.052885+0000","last_peered":"2024-04-23T23:41:09.052885+0000","last_clean":"2024-04-23T23:41:09.052885+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:09.052885+0000","last_undegraded":"2024-04-23T23:41:09.052885+0000","last_fullsized":"2024-04-23T23:41:09.052885+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:18.804252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"195'770","reported_seq":17589,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053552+0000","last_change":"2024-04-23T23:40:46.952178+0000","last_active":"2024-04-23T23:41:09.053552+0000","last_peered":"2024-04-23T23:41:09.053552+0000","last_clean":"2024-04-23T23:41:09.053552+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:09.053552+0000","last_undegraded":"2024-04-23T23:41:09.053552+0000","last_fullsized":"2024-04-23T23:41:09.053552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:46.733880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"194'691","reported_seq":9606,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505707+0000","last_change":"2024-04-23T23:40:59.005552+0000","last_active":"2024-04-23T23:41:09.505707+0000","last_peered":"2024-04-23T23:41:09.505707+0000","last_clean":"2024-04-23T23:41:09.505707+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:09.505707+0000","last_undegraded":"2024-04-23T23:41:09.505707+0000","last_fullsized":"2024-04-23T23:41:09.505707+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:51.413923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"192'527","reported_seq":3734,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053080+0000","last_change":"2024-04-23T23:40:58.009381+0000","last_active":"2024-04-23T23:41:09.053080+0000","last_peered":"2024-04-23T23:41:09.053080+0000","last_clean":"2024-04-23T23:41:09.053080+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:09.053080+0000","last_undegraded":"2024-04-23T23:41:09.053080+0000","last_fullsized":"2024-04-23T23:41:09.053080+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.551844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"194'656","reported_seq":6150,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053177+0000","last_change":"2024-04-23T23:40:46.953281+0000","last_active":"2024-04-23T23:41:09.053177+0000","last_peered":"2024-04-23T23:41:09.053177+0000","last_clean":"2024-04-23T23:41:09.053177+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:09.053177+0000","last_undegraded":"2024-04-23T23:41:09.053177+0000","last_fullsized":"2024-04-23T23:41:09.053177+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:59:36.009122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"195'819","reported_seq":24537,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505889+0000","last_change":"2024-04-23T23:40:46.959487+0000","last_active":"2024-04-23T23:41:09.505889+0000","last_peered":"2024-04-23T23:41:09.505889+0000","last_clean":"2024-04-23T23:41:09.505889+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:09.505889+0000","last_undegraded":"2024-04-23T23:41:09.505889+0000","last_fullsized":"2024-04-23T23:41:09.505889+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:47.683153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"192'513","reported_seq":8317,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506416+0000","last_change":"2024-04-23T23:40:57.005009+0000","last_active":"2024-04-23T23:41:09.506416+0000","last_peered":"2024-04-23T23:41:09.506416+0000","last_clean":"2024-04-23T23:41:09.506416+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:09.506416+0000","last_undegraded":"2024-04-23T23:41:09.506416+0000","last_fullsized":"2024-04-23T23:41:09.506416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:38.944188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"193'990","reported_seq":13434,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053660+0000","last_change":"2024-04-23T23:40:46.951655+0000","last_active":"2024-04-23T23:41:09.053660+0000","last_peered":"2024-04-23T23:41:09.053660+0000","last_clean":"2024-04-23T23:41:09.053660+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:09.053660+0000","last_undegraded":"2024-04-23T23:41:09.053660+0000","last_fullsized":"2024-04-23T23:41:09.053660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:39.609261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506191+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:41:09.506191+0000","last_peered":"2024-04-23T23:41:09.506191+0000","last_clean":"2024-04-23T23:41:09.506191+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:09.506191+0000","last_undegraded":"2024-04-23T23:41:09.506191+0000","last_fullsized":"2024-04-23T23:41:09.506191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"195'508","reported_seq":6509,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053079+0000","last_change":"2024-04-23T23:40:46.951937+0000","last_active":"2024-04-23T23:41:09.053079+0000","last_peered":"2024-04-23T23:41:09.053079+0000","last_clean":"2024-04-23T23:41:09.053079+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:09.053079+0000","last_undegraded":"2024-04-23T23:41:09.053079+0000","last_fullsized":"2024-04-23T23:41:09.053079+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:34.479922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":406,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505801+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:41:09.505801+0000","last_peered":"2024-04-23T23:41:09.505801+0000","last_clean":"2024-04-23T23:41:09.505801+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:09.505801+0000","last_undegraded":"2024-04-23T23:41:09.505801+0000","last_fullsized":"2024-04-23T23:41:09.505801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"193'808","reported_seq":6934,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053192+0000","last_change":"2024-04-23T23:40:59.839248+0000","last_active":"2024-04-23T23:41:09.053192+0000","last_peered":"2024-04-23T23:41:09.053192+0000","last_clean":"2024-04-23T23:41:09.053192+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:09.053192+0000","last_undegraded":"2024-04-23T23:41:09.053192+0000","last_fullsized":"2024-04-23T23:41:09.053192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:49.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506431+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:41:09.506431+0000","last_peered":"2024-04-23T23:41:09.506431+0000","last_clean":"2024-04-23T23:41:09.506431+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:09.506431+0000","last_undegraded":"2024-04-23T23:41:09.506431+0000","last_fullsized":"2024-04-23T23:41:09.506431+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"192'635","reported_seq":5469,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505587+0000","last_change":"2024-04-23T23:40:58.000674+0000","last_active":"2024-04-23T23:41:09.505587+0000","last_peered":"2024-04-23T23:41:09.505587+0000","last_clean":"2024-04-23T23:41:09.505587+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:09.505587+0000","last_undegraded":"2024-04-23T23:41:09.505587+0000","last_fullsized":"2024-04-23T23:41:09.505587+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:50.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505689+0000","last_change":"2024-04-23T23:40:58.005393+0000","last_active":"2024-04-23T23:41:09.505689+0000","last_peered":"2024-04-23T23:41:09.505689+0000","last_clean":"2024-04-23T23:41:09.505689+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:09.505689+0000","last_undegraded":"2024-04-23T23:41:09.505689+0000","last_fullsized":"2024-04-23T23:41:09.505689+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:41:05.587146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"194'827","reported_seq":3997,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506173+0000","last_change":"2024-04-23T23:41:08.060452+0000","last_active":"2024-04-23T23:41:09.506173+0000","last_peered":"2024-04-23T23:41:09.506173+0000","last_clean":"2024-04-23T23:41:09.506173+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:09.506173+0000","last_undegraded":"2024-04-23T23:41:09.506173+0000","last_fullsized":"2024-04-23T23:41:09.506173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:08.587415+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"195'748","reported_seq":8566,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053593+0000","last_change":"2024-04-23T23:40:46.950766+0000","last_active":"2024-04-23T23:41:09.053593+0000","last_peered":"2024-04-23T23:41:09.053593+0000","last_clean":"2024-04-23T23:41:09.053593+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:09.053593+0000","last_undegraded":"2024-04-23T23:41:09.053593+0000","last_fullsized":"2024-04-23T23:41:09.053593+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:50.475530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505822+0000","last_change":"2024-04-23T23:41:08.169629+0000","last_active":"2024-04-23T23:41:09.505822+0000","last_peered":"2024-04-23T23:41:09.505822+0000","last_clean":"2024-04-23T23:41:09.505822+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:09.505822+0000","last_undegraded":"2024-04-23T23:41:09.505822+0000","last_fullsized":"2024-04-23T23:41:09.505822+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:02.570364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"193'542","reported_seq":3978,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505650+0000","last_change":"2024-04-23T23:40:57.998148+0000","last_active":"2024-04-23T23:41:09.505650+0000","last_peered":"2024-04-23T23:41:09.505650+0000","last_clean":"2024-04-23T23:41:09.505650+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:09.505650+0000","last_undegraded":"2024-04-23T23:41:09.505650+0000","last_fullsized":"2024-04-23T23:41:09.505650+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:26.714306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":426,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505549+0000","last_change":"2024-04-23T23:40:53.840908+0000","last_active":"2024-04-23T23:41:09.505549+0000","last_peered":"2024-04-23T23:41:09.505549+0000","last_clean":"2024-04-23T23:41:09.505549+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:09.505549+0000","last_undegraded":"2024-04-23T23:41:09.505549+0000","last_fullsized":"2024-04-23T23:41:09.505549+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:25.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"192'694","reported_seq":6684,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052844+0000","last_change":"2024-04-23T23:41:03.842535+0000","last_active":"2024-04-23T23:41:09.052844+0000","last_peered":"2024-04-23T23:41:09.052844+0000","last_clean":"2024-04-23T23:41:09.052844+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:09.052844+0000","last_undegraded":"2024-04-23T23:41:09.052844+0000","last_fullsized":"2024-04-23T23:41:09.052844+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:35.426802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506307+0000","last_change":"2024-04-23T23:41:06.111378+0000","last_active":"2024-04-23T23:41:09.506307+0000","last_peered":"2024-04-23T23:41:09.506307+0000","last_clean":"2024-04-23T23:41:09.506307+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:09.506307+0000","last_undegraded":"2024-04-23T23:41:09.506307+0000","last_fullsized":"2024-04-23T23:41:09.506307+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:16.658130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"194'781","reported_seq":4286,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053189+0000","last_change":"2024-04-23T23:40:58.007032+0000","last_active":"2024-04-23T23:41:09.053189+0000","last_peered":"2024-04-23T23:41:09.053189+0000","last_clean":"2024-04-23T23:41:09.053189+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:09.053189+0000","last_undegraded":"2024-04-23T23:41:09.053189+0000","last_fullsized":"2024-04-23T23:41:09.053189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:20.921506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505850+0000","last_change":"2024-04-23T23:41:08.055163+0000","last_active":"2024-04-23T23:41:09.505850+0000","last_peered":"2024-04-23T23:41:09.505850+0000","last_clean":"2024-04-23T23:41:09.505850+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:09.505850+0000","last_undegraded":"2024-04-23T23:41:09.505850+0000","last_fullsized":"2024-04-23T23:41:09.505850+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:28:04.238966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":539,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506366+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:41:09.506366+0000","last_peered":"2024-04-23T23:41:09.506366+0000","last_clean":"2024-04-23T23:41:09.506366+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:09.506366+0000","last_undegraded":"2024-04-23T23:41:09.506366+0000","last_fullsized":"2024-04-23T23:41:09.506366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"193'515","reported_seq":21248,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052952+0000","last_change":"2024-04-23T23:40:57.005334+0000","last_active":"2024-04-23T23:41:09.052952+0000","last_peered":"2024-04-23T23:41:09.052952+0000","last_clean":"2024-04-23T23:41:09.052952+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:09.052952+0000","last_undegraded":"2024-04-23T23:41:09.052952+0000","last_fullsized":"2024-04-23T23:41:09.052952+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.072466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"195'542","reported_seq":5959,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053658+0000","last_change":"2024-04-23T23:40:46.952121+0000","last_active":"2024-04-23T23:41:09.053658+0000","last_peered":"2024-04-23T23:41:09.053658+0000","last_clean":"2024-04-23T23:41:09.053658+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:09.053658+0000","last_undegraded":"2024-04-23T23:41:09.053658+0000","last_fullsized":"2024-04-23T23:41:09.053658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:03.085576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"194'1061","reported_seq":14211,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506057+0000","last_change":"2024-04-23T23:41:03.842188+0000","last_active":"2024-04-23T23:41:09.506057+0000","last_peered":"2024-04-23T23:41:09.506057+0000","last_clean":"2024-04-23T23:41:09.506057+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:09.506057+0000","last_undegraded":"2024-04-23T23:41:09.506057+0000","last_fullsized":"2024-04-23T23:41:09.506057+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:27:51.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"194'593","reported_seq":14871,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053055+0000","last_change":"2024-04-23T23:40:58.839397+0000","last_active":"2024-04-23T23:41:09.053055+0000","last_peered":"2024-04-23T23:41:09.053055+0000","last_clean":"2024-04-23T23:41:09.053055+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:09.053055+0000","last_undegraded":"2024-04-23T23:41:09.053055+0000","last_fullsized":"2024-04-23T23:41:09.053055+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.244095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"193'477","reported_seq":17866,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506130+0000","last_change":"2024-04-23T23:41:08.058546+0000","last_active":"2024-04-23T23:41:09.506130+0000","last_peered":"2024-04-23T23:41:09.506130+0000","last_clean":"2024-04-23T23:41:09.506130+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:09.506130+0000","last_undegraded":"2024-04-23T23:41:09.506130+0000","last_fullsized":"2024-04-23T23:41:09.506130+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:12.587030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"193'615","reported_seq":15497,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506318+0000","last_change":"2024-04-23T23:41:06.043877+0000","last_active":"2024-04-23T23:41:09.506318+0000","last_peered":"2024-04-23T23:41:09.506318+0000","last_clean":"2024-04-23T23:41:09.506318+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:09.506318+0000","last_undegraded":"2024-04-23T23:41:09.506318+0000","last_fullsized":"2024-04-23T23:41:09.506318+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:36.941806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"195'861","reported_seq":5666,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505704+0000","last_change":"2024-04-23T23:40:46.950831+0000","last_active":"2024-04-23T23:41:09.505704+0000","last_peered":"2024-04-23T23:41:09.505704+0000","last_clean":"2024-04-23T23:41:09.505704+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:09.505704+0000","last_undegraded":"2024-04-23T23:41:09.505704+0000","last_fullsized":"2024-04-23T23:41:09.505704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:52.747665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"192'722","reported_seq":12050,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506183+0000","last_change":"2024-04-23T23:41:03.841556+0000","last_active":"2024-04-23T23:41:09.506183+0000","last_peered":"2024-04-23T23:41:09.506183+0000","last_clean":"2024-04-23T23:41:09.506183+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:09.506183+0000","last_undegraded":"2024-04-23T23:41:09.506183+0000","last_fullsized":"2024-04-23T23:41:09.506183+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:39.447349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"193'609","reported_seq":27144,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505909+0000","last_change":"2024-04-23T23:40:46.953889+0000","last_active":"2024-04-23T23:41:09.505909+0000","last_peered":"2024-04-23T23:41:09.505909+0000","last_clean":"2024-04-23T23:41:09.505909+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:09.505909+0000","last_undegraded":"2024-04-23T23:41:09.505909+0000","last_fullsized":"2024-04-23T23:41:09.505909+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:11:52.992581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'513","reported_seq":8473,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:06.042645+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:37.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"193'805","reported_seq":7805,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052811+0000","last_change":"2024-04-23T23:40:46.950968+0000","last_active":"2024-04-23T23:41:09.052811+0000","last_peered":"2024-04-23T23:41:09.052811+0000","last_clean":"2024-04-23T23:41:09.052811+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:09.052811+0000","last_undegraded":"2024-04-23T23:41:09.052811+0000","last_fullsized":"2024-04-23T23:41:09.052811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:24.147887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"194'437","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506347+0000","last_change":"2024-04-23T23:40:46.955255+0000","last_active":"2024-04-23T23:41:09.506347+0000","last_peered":"2024-04-23T23:41:09.506347+0000","last_clean":"2024-04-23T23:41:09.506347+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:09.506347+0000","last_undegraded":"2024-04-23T23:41:09.506347+0000","last_fullsized":"2024-04-23T23:41:09.506347+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:20.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":21916,"ondisk_log_size":21916,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82836,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289004,"statfs":{"total":96636764160,"available":96551940096,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":81590730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51788,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320052,"statfs":{"total":96636764160,"available":96583733248,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855401,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61200,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94310640,"statfs":{"total":96636764160,"available":96574095360,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192529,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42780,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329060,"statfs":{"total":96636764160,"available":96592957440,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55948,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315892,"statfs":{"total":96636764160,"available":96579473408,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:13.749 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T23:41:13.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:14.030 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:14.031 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:14.042 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2024-04-23T23:41:12.243056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22033,"ondisk_log_size":22033,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467172,"kb_used_data":21656,"kb_used_omap":20,"kb_used_meta":445355,"kb_avail":754507548,"statfs":{"total":773094113280,"available":772615729152,"internally_reserved":0,"allocated":22175744,"data_stored":11429184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":456043980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-5,"num_read_kb":-4,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001194"},"pg_stats":[{"pgid":"3.1f","version":"195'850","reported_seq":6388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053268+0000","last_change":"2024-04-23T23:40:46.952803+0000","last_active":"2024-04-23T23:41:09.053268+0000","last_peered":"2024-04-23T23:41:09.053268+0000","last_clean":"2024-04-23T23:41:09.053268+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:09.053268+0000","last_undegraded":"2024-04-23T23:41:09.053268+0000","last_fullsized":"2024-04-23T23:41:09.053268+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:29.685374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'523","reported_seq":5131,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053031+0000","last_change":"2024-04-23T23:40:58.839474+0000","last_active":"2024-04-23T23:41:09.053031+0000","last_peered":"2024-04-23T23:41:09.053031+0000","last_clean":"2024-04-23T23:41:09.053031+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:09.053031+0000","last_undegraded":"2024-04-23T23:41:09.053031+0000","last_fullsized":"2024-04-23T23:41:09.053031+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:59.446652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"193'665","reported_seq":23785,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:08.059066+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:38.056866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"195'773","reported_seq":16975,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506021+0000","last_change":"2024-04-23T23:41:08.058573+0000","last_active":"2024-04-23T23:41:09.506021+0000","last_peered":"2024-04-23T23:41:09.506021+0000","last_clean":"2024-04-23T23:41:09.506021+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:09.506021+0000","last_undegraded":"2024-04-23T23:41:09.506021+0000","last_fullsized":"2024-04-23T23:41:09.506021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:02.250704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"192'846","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052885+0000","last_change":"2024-04-23T23:40:46.952426+0000","last_active":"2024-04-23T23:41:09.052885+0000","last_peered":"2024-04-23T23:41:09.052885+0000","last_clean":"2024-04-23T23:41:09.052885+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:09.052885+0000","last_undegraded":"2024-04-23T23:41:09.052885+0000","last_fullsized":"2024-04-23T23:41:09.052885+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:18.804252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"195'770","reported_seq":17589,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053552+0000","last_change":"2024-04-23T23:40:46.952178+0000","last_active":"2024-04-23T23:41:09.053552+0000","last_peered":"2024-04-23T23:41:09.053552+0000","last_clean":"2024-04-23T23:41:09.053552+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:09.053552+0000","last_undegraded":"2024-04-23T23:41:09.053552+0000","last_fullsized":"2024-04-23T23:41:09.053552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:46.733880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"194'691","reported_seq":9606,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505707+0000","last_change":"2024-04-23T23:40:59.005552+0000","last_active":"2024-04-23T23:41:09.505707+0000","last_peered":"2024-04-23T23:41:09.505707+0000","last_clean":"2024-04-23T23:41:09.505707+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:09.505707+0000","last_undegraded":"2024-04-23T23:41:09.505707+0000","last_fullsized":"2024-04-23T23:41:09.505707+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:57:51.413923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"192'527","reported_seq":3734,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053080+0000","last_change":"2024-04-23T23:40:58.009381+0000","last_active":"2024-04-23T23:41:09.053080+0000","last_peered":"2024-04-23T23:41:09.053080+0000","last_clean":"2024-04-23T23:41:09.053080+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:09.053080+0000","last_undegraded":"2024-04-23T23:41:09.053080+0000","last_fullsized":"2024-04-23T23:41:09.053080+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.551844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"194'656","reported_seq":6150,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053177+0000","last_change":"2024-04-23T23:40:46.953281+0000","last_active":"2024-04-23T23:41:09.053177+0000","last_peered":"2024-04-23T23:41:09.053177+0000","last_clean":"2024-04-23T23:41:09.053177+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:09.053177+0000","last_undegraded":"2024-04-23T23:41:09.053177+0000","last_fullsized":"2024-04-23T23:41:09.053177+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:59:36.009122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"195'819","reported_seq":24537,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505889+0000","last_change":"2024-04-23T23:40:46.959487+0000","last_active":"2024-04-23T23:41:09.505889+0000","last_peered":"2024-04-23T23:41:09.505889+0000","last_clean":"2024-04-23T23:41:09.505889+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:09.505889+0000","last_undegraded":"2024-04-23T23:41:09.505889+0000","last_fullsized":"2024-04-23T23:41:09.505889+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:47.683153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"192'513","reported_seq":8317,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506416+0000","last_change":"2024-04-23T23:40:57.005009+0000","last_active":"2024-04-23T23:41:09.506416+0000","last_peered":"2024-04-23T23:41:09.506416+0000","last_clean":"2024-04-23T23:41:09.506416+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:09.506416+0000","last_undegraded":"2024-04-23T23:41:09.506416+0000","last_fullsized":"2024-04-23T23:41:09.506416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:38.944188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"193'990","reported_seq":13434,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053660+0000","last_change":"2024-04-23T23:40:46.951655+0000","last_active":"2024-04-23T23:41:09.053660+0000","last_peered":"2024-04-23T23:41:09.053660+0000","last_clean":"2024-04-23T23:41:09.053660+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:09.053660+0000","last_undegraded":"2024-04-23T23:41:09.053660+0000","last_fullsized":"2024-04-23T23:41:09.053660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:39.609261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506191+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:41:09.506191+0000","last_peered":"2024-04-23T23:41:09.506191+0000","last_clean":"2024-04-23T23:41:09.506191+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:09.506191+0000","last_undegraded":"2024-04-23T23:41:09.506191+0000","last_fullsized":"2024-04-23T23:41:09.506191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"195'508","reported_seq":6509,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053079+0000","last_change":"2024-04-23T23:40:46.951937+0000","last_active":"2024-04-23T23:41:09.053079+0000","last_peered":"2024-04-23T23:41:09.053079+0000","last_clean":"2024-04-23T23:41:09.053079+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:09.053079+0000","last_undegraded":"2024-04-23T23:41:09.053079+0000","last_fullsized":"2024-04-23T23:41:09.053079+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:34.479922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":406,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505801+0000","last_change":"2024-04-23T23:37:23.755584+0000","last_active":"2024-04-23T23:41:09.505801+0000","last_peered":"2024-04-23T23:41:09.505801+0000","last_clean":"2024-04-23T23:41:09.505801+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:09.505801+0000","last_undegraded":"2024-04-23T23:41:09.505801+0000","last_fullsized":"2024-04-23T23:41:09.505801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:59:14.688942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"193'808","reported_seq":6934,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053192+0000","last_change":"2024-04-23T23:40:59.839248+0000","last_active":"2024-04-23T23:41:09.053192+0000","last_peered":"2024-04-23T23:41:09.053192+0000","last_clean":"2024-04-23T23:41:09.053192+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:09.053192+0000","last_undegraded":"2024-04-23T23:41:09.053192+0000","last_fullsized":"2024-04-23T23:41:09.053192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:49.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506431+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:41:09.506431+0000","last_peered":"2024-04-23T23:41:09.506431+0000","last_clean":"2024-04-23T23:41:09.506431+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:09.506431+0000","last_undegraded":"2024-04-23T23:41:09.506431+0000","last_fullsized":"2024-04-23T23:41:09.506431+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"192'635","reported_seq":5469,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505587+0000","last_change":"2024-04-23T23:40:58.000674+0000","last_active":"2024-04-23T23:41:09.505587+0000","last_peered":"2024-04-23T23:41:09.505587+0000","last_clean":"2024-04-23T23:41:09.505587+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:09.505587+0000","last_undegraded":"2024-04-23T23:41:09.505587+0000","last_fullsized":"2024-04-23T23:41:09.505587+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:52:50.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505689+0000","last_change":"2024-04-23T23:40:58.005393+0000","last_active":"2024-04-23T23:41:09.505689+0000","last_peered":"2024-04-23T23:41:09.505689+0000","last_clean":"2024-04-23T23:41:09.505689+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:09.505689+0000","last_undegraded":"2024-04-23T23:41:09.505689+0000","last_fullsized":"2024-04-23T23:41:09.505689+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:41:05.587146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"194'827","reported_seq":3997,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506173+0000","last_change":"2024-04-23T23:41:08.060452+0000","last_active":"2024-04-23T23:41:09.506173+0000","last_peered":"2024-04-23T23:41:09.506173+0000","last_clean":"2024-04-23T23:41:09.506173+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:09.506173+0000","last_undegraded":"2024-04-23T23:41:09.506173+0000","last_fullsized":"2024-04-23T23:41:09.506173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:08.587415+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"195'748","reported_seq":8566,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053593+0000","last_change":"2024-04-23T23:40:46.950766+0000","last_active":"2024-04-23T23:41:09.053593+0000","last_peered":"2024-04-23T23:41:09.053593+0000","last_clean":"2024-04-23T23:41:09.053593+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:09.053593+0000","last_undegraded":"2024-04-23T23:41:09.053593+0000","last_fullsized":"2024-04-23T23:41:09.053593+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:50.475530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505822+0000","last_change":"2024-04-23T23:41:08.169629+0000","last_active":"2024-04-23T23:41:09.505822+0000","last_peered":"2024-04-23T23:41:09.505822+0000","last_clean":"2024-04-23T23:41:09.505822+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:09.505822+0000","last_undegraded":"2024-04-23T23:41:09.505822+0000","last_fullsized":"2024-04-23T23:41:09.505822+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:02.570364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"193'542","reported_seq":3978,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505650+0000","last_change":"2024-04-23T23:40:57.998148+0000","last_active":"2024-04-23T23:41:09.505650+0000","last_peered":"2024-04-23T23:41:09.505650+0000","last_clean":"2024-04-23T23:41:09.505650+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:09.505650+0000","last_undegraded":"2024-04-23T23:41:09.505650+0000","last_fullsized":"2024-04-23T23:41:09.505650+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:14:26.714306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":426,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505549+0000","last_change":"2024-04-23T23:40:53.840908+0000","last_active":"2024-04-23T23:41:09.505549+0000","last_peered":"2024-04-23T23:41:09.505549+0000","last_clean":"2024-04-23T23:41:09.505549+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:09.505549+0000","last_undegraded":"2024-04-23T23:41:09.505549+0000","last_fullsized":"2024-04-23T23:41:09.505549+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:25.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"192'694","reported_seq":6684,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052844+0000","last_change":"2024-04-23T23:41:03.842535+0000","last_active":"2024-04-23T23:41:09.052844+0000","last_peered":"2024-04-23T23:41:09.052844+0000","last_clean":"2024-04-23T23:41:09.052844+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:09.052844+0000","last_undegraded":"2024-04-23T23:41:09.052844+0000","last_fullsized":"2024-04-23T23:41:09.052844+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:35.426802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506307+0000","last_change":"2024-04-23T23:41:06.111378+0000","last_active":"2024-04-23T23:41:09.506307+0000","last_peered":"2024-04-23T23:41:09.506307+0000","last_clean":"2024-04-23T23:41:09.506307+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:09.506307+0000","last_undegraded":"2024-04-23T23:41:09.506307+0000","last_fullsized":"2024-04-23T23:41:09.506307+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:16.658130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"194'781","reported_seq":4286,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053189+0000","last_change":"2024-04-23T23:40:58.007032+0000","last_active":"2024-04-23T23:41:09.053189+0000","last_peered":"2024-04-23T23:41:09.053189+0000","last_clean":"2024-04-23T23:41:09.053189+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:09.053189+0000","last_undegraded":"2024-04-23T23:41:09.053189+0000","last_fullsized":"2024-04-23T23:41:09.053189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:20.921506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505850+0000","last_change":"2024-04-23T23:41:08.055163+0000","last_active":"2024-04-23T23:41:09.505850+0000","last_peered":"2024-04-23T23:41:09.505850+0000","last_clean":"2024-04-23T23:41:09.505850+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:09.505850+0000","last_undegraded":"2024-04-23T23:41:09.505850+0000","last_fullsized":"2024-04-23T23:41:09.505850+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:28:04.238966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":539,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506366+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:41:09.506366+0000","last_peered":"2024-04-23T23:41:09.506366+0000","last_clean":"2024-04-23T23:41:09.506366+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:09.506366+0000","last_undegraded":"2024-04-23T23:41:09.506366+0000","last_fullsized":"2024-04-23T23:41:09.506366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"193'515","reported_seq":21248,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052952+0000","last_change":"2024-04-23T23:40:57.005334+0000","last_active":"2024-04-23T23:41:09.052952+0000","last_peered":"2024-04-23T23:41:09.052952+0000","last_clean":"2024-04-23T23:41:09.052952+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:09.052952+0000","last_undegraded":"2024-04-23T23:41:09.052952+0000","last_fullsized":"2024-04-23T23:41:09.052952+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.072466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"195'542","reported_seq":5959,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053658+0000","last_change":"2024-04-23T23:40:46.952121+0000","last_active":"2024-04-23T23:41:09.053658+0000","last_peered":"2024-04-23T23:41:09.053658+0000","last_clean":"2024-04-23T23:41:09.053658+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:09.053658+0000","last_undegraded":"2024-04-23T23:41:09.053658+0000","last_fullsized":"2024-04-23T23:41:09.053658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:03.085576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"194'1061","reported_seq":14211,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506057+0000","last_change":"2024-04-23T23:41:03.842188+0000","last_active":"2024-04-23T23:41:09.506057+0000","last_peered":"2024-04-23T23:41:09.506057+0000","last_clean":"2024-04-23T23:41:09.506057+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:09.506057+0000","last_undegraded":"2024-04-23T23:41:09.506057+0000","last_fullsized":"2024-04-23T23:41:09.506057+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:27:51.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"194'593","reported_seq":14871,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053055+0000","last_change":"2024-04-23T23:40:58.839397+0000","last_active":"2024-04-23T23:41:09.053055+0000","last_peered":"2024-04-23T23:41:09.053055+0000","last_clean":"2024-04-23T23:41:09.053055+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:09.053055+0000","last_undegraded":"2024-04-23T23:41:09.053055+0000","last_fullsized":"2024-04-23T23:41:09.053055+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.244095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"193'477","reported_seq":17866,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506130+0000","last_change":"2024-04-23T23:41:08.058546+0000","last_active":"2024-04-23T23:41:09.506130+0000","last_peered":"2024-04-23T23:41:09.506130+0000","last_clean":"2024-04-23T23:41:09.506130+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:09.506130+0000","last_undegraded":"2024-04-23T23:41:09.506130+0000","last_fullsized":"2024-04-23T23:41:09.506130+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:12.587030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"193'615","reported_seq":15497,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506318+0000","last_change":"2024-04-23T23:41:06.043877+0000","last_active":"2024-04-23T23:41:09.506318+0000","last_peered":"2024-04-23T23:41:09.506318+0000","last_clean":"2024-04-23T23:41:09.506318+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:09.506318+0000","last_undegraded":"2024-04-23T23:41:09.506318+0000","last_fullsized":"2024-04-23T23:41:09.506318+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:36.941806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"195'861","reported_seq":5666,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505704+0000","last_change":"2024-04-23T23:40:46.950831+0000","last_active":"2024-04-23T23:41:09.505704+0000","last_peered":"2024-04-23T23:41:09.505704+0000","last_clean":"2024-04-23T23:41:09.505704+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:09.505704+0000","last_undegraded":"2024-04-23T23:41:09.505704+0000","last_fullsized":"2024-04-23T23:41:09.505704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:52.747665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"192'722","reported_seq":12050,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506183+0000","last_change":"2024-04-23T23:41:03.841556+0000","last_active":"2024-04-23T23:41:09.506183+0000","last_peered":"2024-04-23T23:41:09.506183+0000","last_clean":"2024-04-23T23:41:09.506183+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:09.506183+0000","last_undegraded":"2024-04-23T23:41:09.506183+0000","last_fullsized":"2024-04-23T23:41:09.506183+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:39.447349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"193'609","reported_seq":27144,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505909+0000","last_change":"2024-04-23T23:40:46.953889+0000","last_active":"2024-04-23T23:41:09.505909+0000","last_peered":"2024-04-23T23:41:09.505909+0000","last_clean":"2024-04-23T23:41:09.505909+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:09.505909+0000","last_undegraded":"2024-04-23T23:41:09.505909+0000","last_fullsized":"2024-04-23T23:41:09.505909+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:11:52.992581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'513","reported_seq":8473,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:06.042645+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:37.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"193'805","reported_seq":7805,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052811+0000","last_change":"2024-04-23T23:40:46.950968+0000","last_active":"2024-04-23T23:41:09.052811+0000","last_peered":"2024-04-23T23:41:09.052811+0000","last_clean":"2024-04-23T23:41:09.052811+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:09.052811+0000","last_undegraded":"2024-04-23T23:41:09.052811+0000","last_fullsized":"2024-04-23T23:41:09.052811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:24.147887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"194'437","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506347+0000","last_change":"2024-04-23T23:40:46.955255+0000","last_active":"2024-04-23T23:41:09.506347+0000","last_peered":"2024-04-23T23:41:09.506347+0000","last_clean":"2024-04-23T23:41:09.506347+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:09.506347+0000","last_undegraded":"2024-04-23T23:41:09.506347+0000","last_fullsized":"2024-04-23T23:41:09.506347+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:20.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":21916,"ondisk_log_size":21916,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82836,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289004,"statfs":{"total":96636764160,"available":96551940096,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":81590730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51788,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320052,"statfs":{"total":96636764160,"available":96583733248,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855401,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61200,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94310640,"statfs":{"total":96636764160,"available":96574095360,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192529,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42780,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329060,"statfs":{"total":96636764160,"available":96592957440,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55948,"kb_used_data":2552,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315892,"statfs":{"total":96636764160,"available":96579473408,"internally_reserved":0,"allocated":2613248,"data_stored":1276648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:14.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T23:41:14.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:14.328 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":217,"fsid":"f73eea51-5002-4eee-8d85-f2db649bc1b5","created":"2024-04-23T23:37:04.013555+0000","modified":"2024-04-23T23:41:09.049381+0000","last_up_change":"2024-04-23T23:39:58.814990+0000","last_in_change":"2024-04-23T23:40:52.972238+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T23:37:16.233938+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-23T23:37:22.007673+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-04-23T23:37:30.028908+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":58,"snap_epoch":195,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83bcc6ca-0a72-4e35-94f8-5e998f400255","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6801","nonce":1910915292}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6803","nonce":1910915292}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6807","nonce":1910915292}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1910915292},{"type":"v1","addr":"172.21.15.77:6805","nonce":1910915292}]},"public_addr":"172.21.15.77:6801/1910915292","cluster_addr":"172.21.15.77:6803/1910915292","heartbeat_back_addr":"172.21.15.77:6807/1910915292","heartbeat_front_addr":"172.21.15.77:6805/1910915292","state":["exists","up"]},{"osd":1,"uuid":"1f301988-977e-4d44-8e15-1bb166701438","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":206,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6817","nonce":2701012491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6819","nonce":2701012491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6823","nonce":2701012491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2701012491},{"type":"v1","addr":"172.21.15.77:6821","nonce":2701012491}]},"public_addr":"172.21.15.77:6817/2701012491","cluster_addr":"172.21.15.77:6819/2701012491","heartbeat_back_addr":"172.21.15.77:6823/2701012491","heartbeat_front_addr":"172.21.15.77:6821/2701012491","state":["exists","up"]},{"osd":2,"uuid":"49ee3814-425e-4ec5-9f7c-b007d26b4249","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":205,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6825","nonce":14105002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6827","nonce":14105002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6831","nonce":14105002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":14105002},{"type":"v1","addr":"172.21.15.77:6829","nonce":14105002}]},"public_addr":"172.21.15.77:6825/14105002","cluster_addr":"172.21.15.77:6827/14105002","heartbeat_back_addr":"172.21.15.77:6831/14105002","heartbeat_front_addr":"172.21.15.77:6829/14105002","state":["exists","up"]},{"osd":3,"uuid":"60cfa342-4270-4d01-b26b-4a9fabb8ff1f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":82,"up_from":147,"up_thru":207,"down_at":84,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6809","nonce":2677547801}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6811","nonce":2677547801}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6815","nonce":2677547801}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":2677547801},{"type":"v1","addr":"172.21.15.77:6813","nonce":2677547801}]},"public_addr":"172.21.15.77:6809/2677547801","cluster_addr":"172.21.15.77:6811/2677547801","heartbeat_back_addr":"172.21.15.77:6815/2677547801","heartbeat_front_addr":"172.21.15.77:6813/2677547801","state":["exists","up"]},{"osd":4,"uuid":"eba66f3c-1472-4e43-971d-bfc106e6533a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":197,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6824","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6825","nonce":1333725690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6826","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6827","nonce":1333725690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6830","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6831","nonce":1333725690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6828","nonce":1333725690},{"type":"v1","addr":"172.21.15.170:6829","nonce":1333725690}]},"public_addr":"172.21.15.170:6825/1333725690","cluster_addr":"172.21.15.170:6827/1333725690","heartbeat_back_addr":"172.21.15.170:6831/1333725690","heartbeat_front_addr":"172.21.15.170:6829/1333725690","state":["exists","up"]},{"osd":5,"uuid":"bf8b21e7-277d-485b-a249-5739b1ea5e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":24,"up_from":35,"up_thru":215,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6800","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6801","nonce":2756265516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6802","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6803","nonce":2756265516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6806","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6807","nonce":2756265516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6804","nonce":2756265516},{"type":"v1","addr":"172.21.15.170:6805","nonce":2756265516}]},"public_addr":"172.21.15.170:6801/2756265516","cluster_addr":"172.21.15.170:6803/2756265516","heartbeat_back_addr":"172.21.15.170:6807/2756265516","heartbeat_front_addr":"172.21.15.170:6805/2756265516","state":["exists","up"]},{"osd":6,"uuid":"9c77bfe9-4574-4be7-b13c-97352d0b36b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6816","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6817","nonce":1055419423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6818","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6819","nonce":1055419423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6822","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6823","nonce":1055419423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6820","nonce":1055419423},{"type":"v1","addr":"172.21.15.170:6821","nonce":1055419423}]},"public_addr":"172.21.15.170:6817/1055419423","cluster_addr":"172.21.15.170:6819/1055419423","heartbeat_back_addr":"172.21.15.170:6823/1055419423","heartbeat_front_addr":"172.21.15.170:6821/1055419423","state":["exists","up"]},{"osd":7,"uuid":"6a7a0184-9708-4d0a-a230-722480d38bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":213,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6808","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6809","nonce":2863840516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6810","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6811","nonce":2863840516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6814","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6815","nonce":2863840516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.170:6812","nonce":2863840516},{"type":"v1","addr":"172.21.15.170:6813","nonce":2863840516}]},"public_addr":"172.21.15.170:6809/2863840516","cluster_addr":"172.21.15.170:6811/2863840516","heartbeat_back_addr":"172.21.15.170:6815/2863840516","heartbeat_front_addr":"172.21.15.170:6813/2863840516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.291145+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.258527+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.327333+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.322206+0000","dead_epoch":84},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.377293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.334347+0000","dead_epoch":26},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.311178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T23:37:11.388211+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.e","osds":[2,6]},{"pgid":"3.f","osds":[6,2]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T23:41:15.341 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T23:41:15.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:15.469 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:15.469 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:15.470 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:15.480 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T23:41:15.760 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T23:41:15.773 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T23:41:15.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:15.893 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:15.894 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:15.894 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:15.904 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T23:41:16.186 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T23:41:16.199 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T23:41:16.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:16.321 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:16.321 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:16.321 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:16.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T23:41:16.614 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T23:41:16.626 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T23:41:16.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:16.750 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:16.751 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:16.751 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:16.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T23:41:17.046 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T23:41:17.059 INFO:tasks.ceph:Scrubbing osd.4 2024-04-23T23:41:17.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:17.182 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:17.182 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:17.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-23T23:41:17.491 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 4 to deep-scrub 2024-04-23T23:41:17.503 INFO:tasks.ceph:Scrubbing osd.5 2024-04-23T23:41:17.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:17.633 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:17.633 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:17.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-23T23:41:17.930 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 5 to deep-scrub 2024-04-23T23:41:17.945 INFO:tasks.ceph:Scrubbing osd.6 2024-04-23T23:41:17.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:18.066 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:18.067 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:18.067 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:18.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-23T23:41:18.366 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 6 to deep-scrub 2024-04-23T23:41:18.379 INFO:tasks.ceph:Scrubbing osd.7 2024-04-23T23:41:18.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-23T23:41:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-04-23T23:41:18.501 INFO:teuthology.orchestra.run.smithi077.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T23:41:18.501 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-04-23T23:41:18.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-23T23:41:18.795 INFO:teuthology.orchestra.run.smithi077.stderr:instructed osd(s) 7 to deep-scrub 2024-04-23T23:41:18.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:19.095 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:19.095 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:19.108 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2024-04-23T23:41:18.244464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22033,"ondisk_log_size":22033,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":467180,"kb_used_data":21680,"kb_used_omap":20,"kb_used_meta":445355,"kb_avail":754507540,"statfs":{"total":773094113280,"available":772615720960,"internally_reserved":0,"allocated":22200320,"data_stored":11440926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":456043980},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":-2,"num_read_kb":-1,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-143,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002186"},"pg_stats":[{"pgid":"3.1f","version":"195'850","reported_seq":6388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053268+0000","last_change":"2024-04-23T23:40:46.952803+0000","last_active":"2024-04-23T23:41:09.053268+0000","last_peered":"2024-04-23T23:41:09.053268+0000","last_clean":"2024-04-23T23:41:09.053268+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:09.053268+0000","last_undegraded":"2024-04-23T23:41:09.053268+0000","last_fullsized":"2024-04-23T23:41:09.053268+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":850,"log_dups_size":0,"ondisk_log_size":850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:14:29.685374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"193'523","reported_seq":5131,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053031+0000","last_change":"2024-04-23T23:40:58.839474+0000","last_active":"2024-04-23T23:41:09.053031+0000","last_peered":"2024-04-23T23:41:09.053031+0000","last_clean":"2024-04-23T23:41:09.053031+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:09.053031+0000","last_undegraded":"2024-04-23T23:41:09.053031+0000","last_fullsized":"2024-04-23T23:41:09.053031+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":523,"log_dups_size":0,"ondisk_log_size":523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:50:59.446652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"193'665","reported_seq":23785,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:08.059066+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":665,"log_dups_size":0,"ondisk_log_size":665,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:09:38.056866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"195'773","reported_seq":16975,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506021+0000","last_change":"2024-04-23T23:41:08.058573+0000","last_active":"2024-04-23T23:41:09.506021+0000","last_peered":"2024-04-23T23:41:09.506021+0000","last_clean":"2024-04-23T23:41:09.506021+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:09.506021+0000","last_undegraded":"2024-04-23T23:41:09.506021+0000","last_fullsized":"2024-04-23T23:41:09.506021+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":773,"log_dups_size":0,"ondisk_log_size":773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:10:02.250704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"192'846","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052885+0000","last_change":"2024-04-23T23:40:46.952426+0000","last_active":"2024-04-23T23:41:09.052885+0000","last_peered":"2024-04-23T23:41:09.052885+0000","last_clean":"2024-04-23T23:41:09.052885+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:09.052885+0000","last_undegraded":"2024-04-23T23:41:09.052885+0000","last_fullsized":"2024-04-23T23:41:09.052885+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":846,"log_dups_size":0,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:18.804252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"195'770","reported_seq":17589,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053552+0000","last_change":"2024-04-23T23:40:46.952178+0000","last_active":"2024-04-23T23:41:09.053552+0000","last_peered":"2024-04-23T23:41:09.053552+0000","last_clean":"2024-04-23T23:41:09.053552+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:09.053552+0000","last_undegraded":"2024-04-23T23:41:09.053552+0000","last_fullsized":"2024-04-23T23:41:09.053552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":770,"log_dups_size":0,"ondisk_log_size":770,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:35:46.733880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"194'691","reported_seq":9607,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505736+0000","last_change":"2024-04-23T23:40:59.005552+0000","last_active":"2024-04-23T23:41:09.505736+0000","last_peered":"2024-04-23T23:41:09.505736+0000","last_clean":"2024-04-23T23:41:09.505736+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:09.505736+0000","last_undegraded":"2024-04-23T23:41:09.505736+0000","last_fullsized":"2024-04-23T23:41:09.505736+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":691,"log_dups_size":0,"ondisk_log_size":691,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"192'527","reported_seq":3734,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053080+0000","last_change":"2024-04-23T23:40:58.009381+0000","last_active":"2024-04-23T23:41:09.053080+0000","last_peered":"2024-04-23T23:41:09.053080+0000","last_clean":"2024-04-23T23:41:09.053080+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:09.053080+0000","last_undegraded":"2024-04-23T23:41:09.053080+0000","last_fullsized":"2024-04-23T23:41:09.053080+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":527,"log_dups_size":0,"ondisk_log_size":527,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:18:44.551844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"194'656","reported_seq":6150,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053177+0000","last_change":"2024-04-23T23:40:46.953281+0000","last_active":"2024-04-23T23:41:09.053177+0000","last_peered":"2024-04-23T23:41:09.053177+0000","last_clean":"2024-04-23T23:41:09.053177+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:09.053177+0000","last_undegraded":"2024-04-23T23:41:09.053177+0000","last_fullsized":"2024-04-23T23:41:09.053177+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:59:36.009122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"195'819","reported_seq":24537,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505889+0000","last_change":"2024-04-23T23:40:46.959487+0000","last_active":"2024-04-23T23:41:09.505889+0000","last_peered":"2024-04-23T23:41:09.505889+0000","last_clean":"2024-04-23T23:41:09.505889+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:09.505889+0000","last_undegraded":"2024-04-23T23:41:09.505889+0000","last_fullsized":"2024-04-23T23:41:09.505889+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:22:47.683153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"192'513","reported_seq":8317,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506416+0000","last_change":"2024-04-23T23:40:57.005009+0000","last_active":"2024-04-23T23:41:09.506416+0000","last_peered":"2024-04-23T23:41:09.506416+0000","last_clean":"2024-04-23T23:41:09.506416+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:09.506416+0000","last_undegraded":"2024-04-23T23:41:09.506416+0000","last_fullsized":"2024-04-23T23:41:09.506416+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:54:38.944188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"193'990","reported_seq":13434,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053660+0000","last_change":"2024-04-23T23:40:46.951655+0000","last_active":"2024-04-23T23:41:09.053660+0000","last_peered":"2024-04-23T23:41:09.053660+0000","last_clean":"2024-04-23T23:41:09.053660+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:09.053660+0000","last_undegraded":"2024-04-23T23:41:09.053660+0000","last_fullsized":"2024-04-23T23:41:09.053660+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":990,"log_dups_size":0,"ondisk_log_size":990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:05:39.609261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506191+0000","last_change":"2024-04-23T23:39:30.096779+0000","last_active":"2024-04-23T23:41:09.506191+0000","last_peered":"2024-04-23T23:41:09.506191+0000","last_clean":"2024-04-23T23:41:09.506191+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:09.506191+0000","last_undegraded":"2024-04-23T23:41:09.506191+0000","last_fullsized":"2024-04-23T23:41:09.506191+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:00.000488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"195'508","reported_seq":6509,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053079+0000","last_change":"2024-04-23T23:40:46.951937+0000","last_active":"2024-04-23T23:41:09.053079+0000","last_peered":"2024-04-23T23:41:09.053079+0000","last_clean":"2024-04-23T23:41:09.053079+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:09.053079+0000","last_undegraded":"2024-04-23T23:41:09.053079+0000","last_fullsized":"2024-04-23T23:41:09.053079+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":508,"log_dups_size":0,"ondisk_log_size":508,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:30:34.479922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":415,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:16.254477+0000","last_change":"2024-04-23T23:41:16.254516+0000","last_active":"2024-04-23T23:41:16.254477+0000","last_peered":"2024-04-23T23:41:16.254477+0000","last_clean":"2024-04-23T23:41:16.254477+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:16.254477+0000","last_undegraded":"2024-04-23T23:41:16.254477+0000","last_fullsized":"2024-04-23T23:41:16.254477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:16.254386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:16.254386+0000","last_clean_scrub_stamp":"2024-04-23T23:41:16.254386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:50:46.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"193'808","reported_seq":6934,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053192+0000","last_change":"2024-04-23T23:40:59.839248+0000","last_active":"2024-04-23T23:41:09.053192+0000","last_peered":"2024-04-23T23:41:09.053192+0000","last_clean":"2024-04-23T23:41:09.053192+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:09.053192+0000","last_undegraded":"2024-04-23T23:41:09.053192+0000","last_fullsized":"2024-04-23T23:41:09.053192+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:05:49.550552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506431+0000","last_change":"2024-04-23T23:40:10.934401+0000","last_active":"2024-04-23T23:41:09.506431+0000","last_peered":"2024-04-23T23:41:09.506431+0000","last_clean":"2024-04-23T23:41:09.506431+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:09.506431+0000","last_undegraded":"2024-04-23T23:41:09.506431+0000","last_fullsized":"2024-04-23T23:41:09.506431+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:01:30.820868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"192'635","reported_seq":5470,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505638+0000","last_change":"2024-04-23T23:40:58.000674+0000","last_active":"2024-04-23T23:41:09.505638+0000","last_peered":"2024-04-23T23:41:09.505638+0000","last_clean":"2024-04-23T23:41:09.505638+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:09.505638+0000","last_undegraded":"2024-04-23T23:41:09.505638+0000","last_fullsized":"2024-04-23T23:41:09.505638+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":635,"log_dups_size":0,"ondisk_log_size":635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":322,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505729+0000","last_change":"2024-04-23T23:40:58.005393+0000","last_active":"2024-04-23T23:41:09.505729+0000","last_peered":"2024-04-23T23:41:09.505729+0000","last_clean":"2024-04-23T23:41:09.505729+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:09.505729+0000","last_undegraded":"2024-04-23T23:41:09.505729+0000","last_fullsized":"2024-04-23T23:41:09.505729+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"194'827","reported_seq":3997,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506173+0000","last_change":"2024-04-23T23:41:08.060452+0000","last_active":"2024-04-23T23:41:09.506173+0000","last_peered":"2024-04-23T23:41:09.506173+0000","last_clean":"2024-04-23T23:41:09.506173+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:09.506173+0000","last_undegraded":"2024-04-23T23:41:09.506173+0000","last_fullsized":"2024-04-23T23:41:09.506173+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":827,"log_dups_size":0,"ondisk_log_size":827,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:12:08.587415+0000","scrub_duration":0,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"195'748","reported_seq":8566,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053593+0000","last_change":"2024-04-23T23:40:46.950766+0000","last_active":"2024-04-23T23:41:09.053593+0000","last_peered":"2024-04-23T23:41:09.053593+0000","last_clean":"2024-04-23T23:41:09.053593+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:09.053593+0000","last_undegraded":"2024-04-23T23:41:09.053593+0000","last_fullsized":"2024-04-23T23:41:09.053593+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:48:50.475530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":367,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505822+0000","last_change":"2024-04-23T23:41:08.169629+0000","last_active":"2024-04-23T23:41:09.505822+0000","last_peered":"2024-04-23T23:41:09.505822+0000","last_clean":"2024-04-23T23:41:09.505822+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:09.505822+0000","last_undegraded":"2024-04-23T23:41:09.505822+0000","last_fullsized":"2024-04-23T23:41:09.505822+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:51:02.570364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"193'542","reported_seq":3979,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505675+0000","last_change":"2024-04-23T23:40:57.998148+0000","last_active":"2024-04-23T23:41:09.505675+0000","last_peered":"2024-04-23T23:41:09.505675+0000","last_clean":"2024-04-23T23:41:09.505675+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:09.505675+0000","last_undegraded":"2024-04-23T23:41:09.505675+0000","last_fullsized":"2024-04-23T23:41:09.505675+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":426,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505549+0000","last_change":"2024-04-23T23:40:53.840908+0000","last_active":"2024-04-23T23:41:09.505549+0000","last_peered":"2024-04-23T23:41:09.505549+0000","last_clean":"2024-04-23T23:41:09.505549+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:09.505549+0000","last_undegraded":"2024-04-23T23:41:09.505549+0000","last_fullsized":"2024-04-23T23:41:09.505549+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:41:25.350081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"192'694","reported_seq":6684,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052844+0000","last_change":"2024-04-23T23:41:03.842535+0000","last_active":"2024-04-23T23:41:09.052844+0000","last_peered":"2024-04-23T23:41:09.052844+0000","last_clean":"2024-04-23T23:41:09.052844+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:09.052844+0000","last_undegraded":"2024-04-23T23:41:09.052844+0000","last_fullsized":"2024-04-23T23:41:09.052844+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":694,"log_dups_size":0,"ondisk_log_size":694,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:07:35.426802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":289,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506307+0000","last_change":"2024-04-23T23:41:06.111378+0000","last_active":"2024-04-23T23:41:09.506307+0000","last_peered":"2024-04-23T23:41:09.506307+0000","last_clean":"2024-04-23T23:41:09.506307+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:09.506307+0000","last_undegraded":"2024-04-23T23:41:09.506307+0000","last_fullsized":"2024-04-23T23:41:09.506307+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:56:16.658130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"194'781","reported_seq":4286,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053189+0000","last_change":"2024-04-23T23:40:58.007032+0000","last_active":"2024-04-23T23:41:09.053189+0000","last_peered":"2024-04-23T23:41:09.053189+0000","last_clean":"2024-04-23T23:41:09.053189+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:09.053189+0000","last_undegraded":"2024-04-23T23:41:09.053189+0000","last_fullsized":"2024-04-23T23:41:09.053189+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":781,"log_dups_size":0,"ondisk_log_size":781,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:16:20.921506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":195,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505850+0000","last_change":"2024-04-23T23:41:08.055163+0000","last_active":"2024-04-23T23:41:09.505850+0000","last_peered":"2024-04-23T23:41:09.505850+0000","last_clean":"2024-04-23T23:41:09.505850+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:09.505850+0000","last_undegraded":"2024-04-23T23:41:09.505850+0000","last_fullsized":"2024-04-23T23:41:09.505850+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:22.743365+0000","last_clean_scrub_stamp":"2024-04-23T23:37:22.743365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:28:04.238966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":539,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506366+0000","last_change":"2024-04-23T23:40:13.827766+0000","last_active":"2024-04-23T23:41:09.506366+0000","last_peered":"2024-04-23T23:41:09.506366+0000","last_clean":"2024-04-23T23:41:09.506366+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:09.506366+0000","last_undegraded":"2024-04-23T23:41:09.506366+0000","last_fullsized":"2024-04-23T23:41:09.506366+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:16.713618+0000","last_clean_scrub_stamp":"2024-04-23T23:37:16.713618+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:02.946955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"193'515","reported_seq":21248,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052952+0000","last_change":"2024-04-23T23:40:57.005334+0000","last_active":"2024-04-23T23:41:09.052952+0000","last_peered":"2024-04-23T23:41:09.052952+0000","last_clean":"2024-04-23T23:41:09.052952+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:09.052952+0000","last_undegraded":"2024-04-23T23:41:09.052952+0000","last_fullsized":"2024-04-23T23:41:09.052952+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:04:56.072466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"195'542","reported_seq":5959,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053658+0000","last_change":"2024-04-23T23:40:46.952121+0000","last_active":"2024-04-23T23:41:09.053658+0000","last_peered":"2024-04-23T23:41:09.053658+0000","last_clean":"2024-04-23T23:41:09.053658+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:09.053658+0000","last_undegraded":"2024-04-23T23:41:09.053658+0000","last_fullsized":"2024-04-23T23:41:09.053658+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:22:03.085576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"194'1061","reported_seq":14211,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506057+0000","last_change":"2024-04-23T23:41:03.842188+0000","last_active":"2024-04-23T23:41:09.506057+0000","last_peered":"2024-04-23T23:41:09.506057+0000","last_clean":"2024-04-23T23:41:09.506057+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:09.506057+0000","last_undegraded":"2024-04-23T23:41:09.506057+0000","last_fullsized":"2024-04-23T23:41:09.506057+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":1061,"log_dups_size":0,"ondisk_log_size":1061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T00:27:51.566102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"194'593","reported_seq":14871,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.053055+0000","last_change":"2024-04-23T23:40:58.839397+0000","last_active":"2024-04-23T23:41:09.053055+0000","last_peered":"2024-04-23T23:41:09.053055+0000","last_clean":"2024-04-23T23:41:09.053055+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:09.053055+0000","last_undegraded":"2024-04-23T23:41:09.053055+0000","last_fullsized":"2024-04-23T23:41:09.053055+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":593,"log_dups_size":0,"ondisk_log_size":593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:03:11.244095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"193'477","reported_seq":17866,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506130+0000","last_change":"2024-04-23T23:41:08.058546+0000","last_active":"2024-04-23T23:41:09.506130+0000","last_peered":"2024-04-23T23:41:09.506130+0000","last_clean":"2024-04-23T23:41:09.506130+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:09.506130+0000","last_undegraded":"2024-04-23T23:41:09.506130+0000","last_fullsized":"2024-04-23T23:41:09.506130+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:21:12.587030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"193'615","reported_seq":15497,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506318+0000","last_change":"2024-04-23T23:41:06.043877+0000","last_active":"2024-04-23T23:41:09.506318+0000","last_peered":"2024-04-23T23:41:09.506318+0000","last_clean":"2024-04-23T23:41:09.506318+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:09.506318+0000","last_undegraded":"2024-04-23T23:41:09.506318+0000","last_fullsized":"2024-04-23T23:41:09.506318+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":615,"log_dups_size":0,"ondisk_log_size":615,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:32:36.941806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"195'861","reported_seq":5666,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505704+0000","last_change":"2024-04-23T23:40:46.950831+0000","last_active":"2024-04-23T23:41:09.505704+0000","last_peered":"2024-04-23T23:41:09.505704+0000","last_clean":"2024-04-23T23:41:09.505704+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:09.505704+0000","last_undegraded":"2024-04-23T23:41:09.505704+0000","last_fullsized":"2024-04-23T23:41:09.505704+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":861,"log_dups_size":0,"ondisk_log_size":861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:19:52.747665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"192'722","reported_seq":12050,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506183+0000","last_change":"2024-04-23T23:41:03.841556+0000","last_active":"2024-04-23T23:41:09.506183+0000","last_peered":"2024-04-23T23:41:09.506183+0000","last_clean":"2024-04-23T23:41:09.506183+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:09.506183+0000","last_undegraded":"2024-04-23T23:41:09.506183+0000","last_fullsized":"2024-04-23T23:41:09.506183+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":722,"log_dups_size":0,"ondisk_log_size":722,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:06:39.447349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"193'609","reported_seq":27144,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.505909+0000","last_change":"2024-04-23T23:40:46.953889+0000","last_active":"2024-04-23T23:41:09.505909+0000","last_peered":"2024-04-23T23:41:09.505909+0000","last_clean":"2024-04-23T23:41:09.505909+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:09.505909+0000","last_undegraded":"2024-04-23T23:41:09.505909+0000","last_fullsized":"2024-04-23T23:41:09.505909+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:11:52.992581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"195'513","reported_seq":8473,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506089+0000","last_change":"2024-04-23T23:41:06.042645+0000","last_active":"2024-04-23T23:41:09.506089+0000","last_peered":"2024-04-23T23:41:09.506089+0000","last_clean":"2024-04-23T23:41:09.506089+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:09.506089+0000","last_undegraded":"2024-04-23T23:41:09.506089+0000","last_fullsized":"2024-04-23T23:41:09.506089+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":513,"log_dups_size":0,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T23:38:37.511353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"193'805","reported_seq":7805,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.052811+0000","last_change":"2024-04-23T23:40:46.950968+0000","last_active":"2024-04-23T23:41:09.052811+0000","last_peered":"2024-04-23T23:41:09.052811+0000","last_clean":"2024-04-23T23:41:09.052811+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:09.052811+0000","last_undegraded":"2024-04-23T23:41:09.052811+0000","last_fullsized":"2024-04-23T23:41:09.052811+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:24.147887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"194'437","reported_seq":5344,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:09.506347+0000","last_change":"2024-04-23T23:40:46.955255+0000","last_active":"2024-04-23T23:41:09.506347+0000","last_peered":"2024-04-23T23:41:09.506347+0000","last_clean":"2024-04-23T23:41:09.506347+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:09.506347+0000","last_undegraded":"2024-04-23T23:41:09.506347+0000","last_fullsized":"2024-04-23T23:41:09.506347+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:37:30.781620+0000","last_clean_scrub_stamp":"2024-04-23T23:37:30.781620+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:35:20.669988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":21916,"ondisk_log_size":21916,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64276,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":61694,"kb_avail":94307564,"statfs":{"total":96636764160,"available":96570945536,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":63175109},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":82836,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":79678,"kb_avail":94289004,"statfs":{"total":96636764160,"available":96551940096,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":81590730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51792,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320048,"statfs":{"total":96636764160,"available":96583729152,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855403,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":61200,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":58619,"kb_avail":94310640,"statfs":{"total":96636764160,"available":96574095360,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":60026478},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47644,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324196,"statfs":{"total":96636764160,"available":96587976704,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192530,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42780,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329060,"statfs":{"total":96636764160,"available":96592957440,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55952,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315888,"statfs":{"total":96636764160,"available":96579469312,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60700,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311140,"statfs":{"total":96636764160,"available":96574607360,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.113 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.114 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.115 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T23:37:22.743365+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=22, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T23:37:16.713618+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=16, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.116 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T23:37:30.781620+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=37, tm_sec=30, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=23, tm_min=41, tm_sec=14, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T23:41:19.117 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T23:41:39.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T23:41:39.413 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-04-23T23:41:39.414 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-04-23T23:41:39.425 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-04-23T23:41:38.249403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":1294,"num_object_clones":0,"num_object_copies":2588,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1294,"num_whiteouts":1288,"num_read":358365,"num_read_kb":1270243,"num_write":24206,"num_write_kb":707859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10866,"num_bytes_recovered":525291950,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23327,"ondisk_log_size":23327,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":442160,"kb_used_data":21680,"kb_used_omap":20,"kb_used_meta":420395,"kb_avail":754532560,"statfs":{"total":773094113280,"available":772641341440,"internally_reserved":0,"allocated":22200320,"data_stored":11440926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":21044,"internal_metadata":430484940},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002815"},"pg_stats":[{"pgid":"3.1f","version":"217'891","reported_seq":6439,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.648319+0000","last_change":"2024-04-23T23:41:18.648364+0000","last_active":"2024-04-23T23:41:18.648319+0000","last_peered":"2024-04-23T23:41:18.648319+0000","last_clean":"2024-04-23T23:41:18.648319+0000","last_became_active":"2024-04-23T23:40:14.834206+0000","last_became_peered":"2024-04-23T23:40:14.834206+0000","last_unstale":"2024-04-23T23:41:18.648319+0000","last_undegraded":"2024-04-23T23:41:18.648319+0000","last_fullsized":"2024-04-23T23:41:18.648319+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'891","last_scrub_stamp":"2024-04-23T23:41:18.648249+0000","last_deep_scrub":"217'891","last_deep_scrub_stamp":"2024-04-23T23:41:18.648249+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.648249+0000","objects_scrubbed":41,"log_size":891,"log_dups_size":0,"ondisk_log_size":891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:29:57.354988+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.0020548509999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":8171,"num_read_kb":19558,"num_write":1030,"num_write_kb":5096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":234,"num_bytes_recovered":5909643,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"217'575","reported_seq":5194,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:22.030265+0000","last_change":"2024-04-23T23:41:22.030296+0000","last_active":"2024-04-23T23:41:22.030265+0000","last_peered":"2024-04-23T23:41:22.030265+0000","last_clean":"2024-04-23T23:41:22.030265+0000","last_became_active":"2024-04-23T23:40:58.836410+0000","last_became_peered":"2024-04-23T23:40:58.836410+0000","last_unstale":"2024-04-23T23:41:22.030265+0000","last_undegraded":"2024-04-23T23:41:22.030265+0000","last_fullsized":"2024-04-23T23:41:22.030265+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'575","last_scrub_stamp":"2024-04-23T23:41:22.030182+0000","last_deep_scrub":"217'575","last_deep_scrub_stamp":"2024-04-23T23:41:22.030182+0000","last_clean_scrub_stamp":"2024-04-23T23:41:22.030182+0000","objects_scrubbed":52,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:40:41.086260+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0.00105134,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":5575,"num_read_kb":29336,"num_write":431,"num_write_kb":9501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":1375027,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"217'712","reported_seq":23842,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:21.965288+0000","last_change":"2024-04-23T23:41:21.965381+0000","last_active":"2024-04-23T23:41:21.965288+0000","last_peered":"2024-04-23T23:41:21.965288+0000","last_clean":"2024-04-23T23:41:21.965288+0000","last_became_active":"2024-04-23T23:41:08.057142+0000","last_became_peered":"2024-04-23T23:41:08.057142+0000","last_unstale":"2024-04-23T23:41:21.965288+0000","last_undegraded":"2024-04-23T23:41:21.965288+0000","last_fullsized":"2024-04-23T23:41:21.965288+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'712","last_scrub_stamp":"2024-04-23T23:41:21.965207+0000","last_deep_scrub":"217'712","last_deep_scrub_stamp":"2024-04-23T23:41:21.965207+0000","last_clean_scrub_stamp":"2024-04-23T23:41:21.965207+0000","objects_scrubbed":47,"log_size":712,"log_dups_size":0,"ondisk_log_size":712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:56:42.317696+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.0015593429999999999,"stat_sum":{"num_bytes":0,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":47,"num_read":24612,"num_read_kb":39427,"num_write":651,"num_write_kb":35276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":199,"num_bytes_recovered":5872456,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"217'816","reported_seq":17028,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.924853+0000","last_change":"2024-04-23T23:41:20.924906+0000","last_active":"2024-04-23T23:41:20.924853+0000","last_peered":"2024-04-23T23:41:20.924853+0000","last_clean":"2024-04-23T23:41:20.924853+0000","last_became_active":"2024-04-23T23:41:08.057200+0000","last_became_peered":"2024-04-23T23:41:08.057200+0000","last_unstale":"2024-04-23T23:41:20.924853+0000","last_undegraded":"2024-04-23T23:41:20.924853+0000","last_fullsized":"2024-04-23T23:41:20.924853+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'816","last_scrub_stamp":"2024-04-23T23:41:20.924744+0000","last_deep_scrub":"217'816","last_deep_scrub_stamp":"2024-04-23T23:41:20.924744+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.924744+0000","objects_scrubbed":43,"log_size":816,"log_dups_size":0,"ondisk_log_size":816,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:26:14.527585+0000","scrub_duration":32,"objects_trimmed":0,"snaptrim_duration":0.0019840769999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":42,"num_read":18628,"num_read_kb":50081,"num_write":767,"num_write_kb":16222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":11730752,"num_keys_recovered":218,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"217'887","reported_seq":5395,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:19.666960+0000","last_change":"2024-04-23T23:41:19.667047+0000","last_active":"2024-04-23T23:41:19.666960+0000","last_peered":"2024-04-23T23:41:19.666960+0000","last_clean":"2024-04-23T23:41:19.666960+0000","last_became_active":"2024-04-23T23:40:15.841206+0000","last_became_peered":"2024-04-23T23:40:15.841206+0000","last_unstale":"2024-04-23T23:41:19.666960+0000","last_undegraded":"2024-04-23T23:41:19.666960+0000","last_fullsized":"2024-04-23T23:41:19.666960+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'887","last_scrub_stamp":"2024-04-23T23:41:19.666878+0000","last_deep_scrub":"217'887","last_deep_scrub_stamp":"2024-04-23T23:41:19.666878+0000","last_clean_scrub_stamp":"2024-04-23T23:41:19.666878+0000","objects_scrubbed":41,"log_size":887,"log_dups_size":0,"ondisk_log_size":887,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:19:34.807454+0000","scrub_duration":24,"objects_trimmed":0,"snaptrim_duration":0.0024075419999999999,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":5991,"num_read_kb":36093,"num_write":1130,"num_write_kb":30816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":533,"num_bytes_recovered":33344777,"num_keys_recovered":44,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"217'803","reported_seq":17633,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:17.616325+0000","last_change":"2024-04-23T23:41:17.616325+0000","last_active":"2024-04-23T23:41:17.616325+0000","last_peered":"2024-04-23T23:41:17.616325+0000","last_clean":"2024-04-23T23:41:17.616325+0000","last_became_active":"2024-04-23T23:39:03.812247+0000","last_became_peered":"2024-04-23T23:39:03.812247+0000","last_unstale":"2024-04-23T23:41:17.616325+0000","last_undegraded":"2024-04-23T23:41:17.616325+0000","last_fullsized":"2024-04-23T23:41:17.616325+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'803","last_scrub_stamp":"2024-04-23T23:41:17.616204+0000","last_deep_scrub":"217'803","last_deep_scrub_stamp":"2024-04-23T23:41:17.616204+0000","last_clean_scrub_stamp":"2024-04-23T23:41:17.616204+0000","objects_scrubbed":33,"log_size":803,"log_dups_size":0,"ondisk_log_size":803,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:40:27.087109+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0.0020926220000000001,"stat_sum":{"num_bytes":19,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":19680,"num_read_kb":31753,"num_write":868,"num_write_kb":19976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":160,"num_bytes_recovered":6494181,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"217'743","reported_seq":9669,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.347618+0000","last_change":"2024-04-23T23:41:20.347665+0000","last_active":"2024-04-23T23:41:20.347618+0000","last_peered":"2024-04-23T23:41:20.347618+0000","last_clean":"2024-04-23T23:41:20.347618+0000","last_became_active":"2024-04-23T23:40:58.837431+0000","last_became_peered":"2024-04-23T23:40:58.837431+0000","last_unstale":"2024-04-23T23:41:20.347618+0000","last_undegraded":"2024-04-23T23:41:20.347618+0000","last_fullsized":"2024-04-23T23:41:20.347618+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'743","last_scrub_stamp":"2024-04-23T23:41:20.347530+0000","last_deep_scrub":"217'743","last_deep_scrub_stamp":"2024-04-23T23:41:20.347530+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.347530+0000","objects_scrubbed":52,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:01:07.245875+0000","scrub_duration":48,"objects_trimmed":0,"snaptrim_duration":0.00056130399999999999,"stat_sum":{"num_bytes":0,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":52,"num_read":8361,"num_read_kb":49180,"num_write":646,"num_write_kb":29027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":618,"num_bytes_recovered":31531105,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"217'562","reported_seq":3779,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.025950+0000","last_change":"2024-04-23T23:41:20.026010+0000","last_active":"2024-04-23T23:41:20.025950+0000","last_peered":"2024-04-23T23:41:20.025950+0000","last_clean":"2024-04-23T23:41:20.025950+0000","last_became_active":"2024-04-23T23:40:58.007601+0000","last_became_peered":"2024-04-23T23:40:58.007601+0000","last_unstale":"2024-04-23T23:41:20.025950+0000","last_undegraded":"2024-04-23T23:41:20.025950+0000","last_fullsized":"2024-04-23T23:41:20.025950+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'562","last_scrub_stamp":"2024-04-23T23:41:20.025843+0000","last_deep_scrub":"217'562","last_deep_scrub_stamp":"2024-04-23T23:41:20.025843+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.025843+0000","objects_scrubbed":35,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:59:19.020306+0000","scrub_duration":20,"objects_trimmed":0,"snaptrim_duration":0.0024108789999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":2991,"num_read_kb":42782,"num_write":597,"num_write_kb":26999,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":429,"num_bytes_recovered":29084175,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"217'699","reported_seq":6203,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:17.647638+0000","last_change":"2024-04-23T23:41:17.647681+0000","last_active":"2024-04-23T23:41:17.647638+0000","last_peered":"2024-04-23T23:41:17.647638+0000","last_clean":"2024-04-23T23:41:17.647638+0000","last_became_active":"2024-04-23T23:40:14.832503+0000","last_became_peered":"2024-04-23T23:40:14.832503+0000","last_unstale":"2024-04-23T23:41:17.647638+0000","last_undegraded":"2024-04-23T23:41:17.647638+0000","last_fullsized":"2024-04-23T23:41:17.647638+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'699","last_scrub_stamp":"2024-04-23T23:41:17.647571+0000","last_deep_scrub":"217'699","last_deep_scrub_stamp":"2024-04-23T23:41:17.647571+0000","last_clean_scrub_stamp":"2024-04-23T23:41:17.647571+0000","objects_scrubbed":43,"log_size":699,"log_dups_size":0,"ondisk_log_size":699,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:43:27.750362+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0.0023152860000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":6853,"num_read_kb":49825,"num_write":825,"num_write_kb":37539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":232,"num_bytes_recovered":44001202,"num_keys_recovered":22,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"217'851","reported_seq":24579,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.001021+0000","last_change":"2024-04-23T23:41:18.001074+0000","last_active":"2024-04-23T23:41:18.001021+0000","last_peered":"2024-04-23T23:41:18.001021+0000","last_clean":"2024-04-23T23:41:18.001021+0000","last_became_active":"2024-04-23T23:39:33.820078+0000","last_became_peered":"2024-04-23T23:39:33.820078+0000","last_unstale":"2024-04-23T23:41:18.001021+0000","last_undegraded":"2024-04-23T23:41:18.001021+0000","last_fullsized":"2024-04-23T23:41:18.001021+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'851","last_scrub_stamp":"2024-04-23T23:41:18.000909+0000","last_deep_scrub":"217'851","last_deep_scrub_stamp":"2024-04-23T23:41:18.000909+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.000909+0000","objects_scrubbed":32,"log_size":851,"log_dups_size":0,"ondisk_log_size":851,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:01:45.832061+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0.0015453940000000001,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":25662,"num_read_kb":50179,"num_write":960,"num_write_kb":36186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":236,"num_bytes_recovered":26199025,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"217'573","reported_seq":8388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:22.881985+0000","last_change":"2024-04-23T23:41:22.882037+0000","last_active":"2024-04-23T23:41:22.881985+0000","last_peered":"2024-04-23T23:41:22.881985+0000","last_clean":"2024-04-23T23:41:22.881985+0000","last_became_active":"2024-04-23T23:40:57.003863+0000","last_became_peered":"2024-04-23T23:40:57.003863+0000","last_unstale":"2024-04-23T23:41:22.881985+0000","last_undegraded":"2024-04-23T23:41:22.881985+0000","last_fullsized":"2024-04-23T23:41:22.881985+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'573","last_scrub_stamp":"2024-04-23T23:41:22.881888+0000","last_deep_scrub":"217'573","last_deep_scrub_stamp":"2024-04-23T23:41:22.881888+0000","last_clean_scrub_stamp":"2024-04-23T23:41:22.881888+0000","objects_scrubbed":60,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:23:09.290824+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.001102902,"stat_sum":{"num_bytes":0,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":60,"num_read":8019,"num_read_kb":27856,"num_write":424,"num_write_kb":20394,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":701,"num_bytes_recovered":31338050,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"217'1032","reported_seq":13487,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:19.637975+0000","last_change":"2024-04-23T23:41:19.637975+0000","last_active":"2024-04-23T23:41:19.637975+0000","last_peered":"2024-04-23T23:41:19.637975+0000","last_clean":"2024-04-23T23:41:19.637975+0000","last_became_active":"2024-04-23T23:39:33.820642+0000","last_became_peered":"2024-04-23T23:39:33.820642+0000","last_unstale":"2024-04-23T23:41:19.637975+0000","last_undegraded":"2024-04-23T23:41:19.637975+0000","last_fullsized":"2024-04-23T23:41:19.637975+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'1032","last_scrub_stamp":"2024-04-23T23:41:19.637850+0000","last_deep_scrub":"217'1032","last_deep_scrub_stamp":"2024-04-23T23:41:19.637850+0000","last_clean_scrub_stamp":"2024-04-23T23:41:19.637850+0000","objects_scrubbed":42,"log_size":1032,"log_dups_size":0,"ondisk_log_size":1032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:43:39.666023+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.001925113,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":15778,"num_read_kb":20415,"num_write":1242,"num_write_kb":9798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":399,"num_bytes_recovered":9583132,"num_keys_recovered":68,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":385,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:19.295701+0000","last_change":"2024-04-23T23:41:19.295722+0000","last_active":"2024-04-23T23:41:19.295701+0000","last_peered":"2024-04-23T23:41:19.295701+0000","last_clean":"2024-04-23T23:41:19.295701+0000","last_became_active":"2024-04-23T23:39:30.096478+0000","last_became_peered":"2024-04-23T23:39:30.096478+0000","last_unstale":"2024-04-23T23:41:19.295701+0000","last_undegraded":"2024-04-23T23:41:19.295701+0000","last_fullsized":"2024-04-23T23:41:19.295701+0000","mapping_epoch":117,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":118,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:19.295604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:19.295604+0000","last_clean_scrub_stamp":"2024-04-23T23:41:19.295604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:01:26.819695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"217'543","reported_seq":6554,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:16.685008+0000","last_change":"2024-04-23T23:41:16.685045+0000","last_active":"2024-04-23T23:41:16.685008+0000","last_peered":"2024-04-23T23:41:16.685008+0000","last_clean":"2024-04-23T23:41:16.685008+0000","last_became_active":"2024-04-23T23:40:13.829516+0000","last_became_peered":"2024-04-23T23:40:13.829516+0000","last_unstale":"2024-04-23T23:41:16.685008+0000","last_undegraded":"2024-04-23T23:41:16.685008+0000","last_fullsized":"2024-04-23T23:41:16.685008+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'543","last_scrub_stamp":"2024-04-23T23:41:16.684914+0000","last_deep_scrub":"217'543","last_deep_scrub_stamp":"2024-04-23T23:41:16.684914+0000","last_clean_scrub_stamp":"2024-04-23T23:41:16.684914+0000","objects_scrubbed":35,"log_size":543,"log_dups_size":0,"ondisk_log_size":543,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:47:36.955376+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0.0021729459999999998,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":6506,"num_read_kb":30729,"num_write":402,"num_write_kb":2234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":298,"num_bytes_recovered":2553990,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":415,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:16.254477+0000","last_change":"2024-04-23T23:41:16.254516+0000","last_active":"2024-04-23T23:41:16.254477+0000","last_peered":"2024-04-23T23:41:16.254477+0000","last_clean":"2024-04-23T23:41:16.254477+0000","last_became_active":"2024-04-23T23:37:23.755291+0000","last_became_peered":"2024-04-23T23:37:23.755291+0000","last_unstale":"2024-04-23T23:41:16.254477+0000","last_undegraded":"2024-04-23T23:41:16.254477+0000","last_fullsized":"2024-04-23T23:41:16.254477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:16.254386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:16.254386+0000","last_clean_scrub_stamp":"2024-04-23T23:41:16.254386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:50:46.713635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"217'844","reported_seq":6980,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:23.027808+0000","last_change":"2024-04-23T23:41:23.027847+0000","last_active":"2024-04-23T23:41:23.027808+0000","last_peered":"2024-04-23T23:41:23.027808+0000","last_clean":"2024-04-23T23:41:23.027808+0000","last_became_active":"2024-04-23T23:40:59.837718+0000","last_became_peered":"2024-04-23T23:40:59.837718+0000","last_unstale":"2024-04-23T23:41:23.027808+0000","last_undegraded":"2024-04-23T23:41:23.027808+0000","last_fullsized":"2024-04-23T23:41:23.027808+0000","mapping_epoch":207,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":208,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'844","last_scrub_stamp":"2024-04-23T23:41:23.027727+0000","last_deep_scrub":"217'844","last_deep_scrub_stamp":"2024-04-23T23:41:23.027727+0000","last_clean_scrub_stamp":"2024-04-23T23:41:23.027727+0000","objects_scrubbed":36,"log_size":844,"log_dups_size":0,"ondisk_log_size":844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:37:11.324633+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.0025645619999999998,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":36,"num_read":8321,"num_read_kb":60448,"num_write":1098,"num_write_kb":15169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":611,"num_bytes_recovered":36049520,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":223,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.817058+0000","last_change":"2024-04-23T23:41:20.817058+0000","last_active":"2024-04-23T23:41:20.817058+0000","last_peered":"2024-04-23T23:41:20.817058+0000","last_clean":"2024-04-23T23:41:20.817058+0000","last_became_active":"2024-04-23T23:40:10.934178+0000","last_became_peered":"2024-04-23T23:40:10.934178+0000","last_unstale":"2024-04-23T23:41:20.817058+0000","last_undegraded":"2024-04-23T23:41:20.817058+0000","last_fullsized":"2024-04-23T23:41:20.817058+0000","mapping_epoch":158,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":159,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:20.816953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:20.816953+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.816953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:27:22.694819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"217'664","reported_seq":5508,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.336844+0000","last_change":"2024-04-23T23:41:18.336871+0000","last_active":"2024-04-23T23:41:18.336844+0000","last_peered":"2024-04-23T23:41:18.336844+0000","last_clean":"2024-04-23T23:41:18.336844+0000","last_became_active":"2024-04-23T23:40:57.999342+0000","last_became_peered":"2024-04-23T23:40:57.999342+0000","last_unstale":"2024-04-23T23:41:18.336844+0000","last_undegraded":"2024-04-23T23:41:18.336844+0000","last_fullsized":"2024-04-23T23:41:18.336844+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'664","last_scrub_stamp":"2024-04-23T23:41:18.336767+0000","last_deep_scrub":"217'664","last_deep_scrub_stamp":"2024-04-23T23:41:18.336767+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.336767+0000","objects_scrubbed":29,"log_size":664,"log_dups_size":0,"ondisk_log_size":664,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:07:23.500958+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0.0021693020000000001,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":6238,"num_read_kb":44983,"num_write":602,"num_write_kb":20821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":331,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:19.310048+0000","last_change":"2024-04-23T23:41:19.310048+0000","last_active":"2024-04-23T23:41:19.310048+0000","last_peered":"2024-04-23T23:41:19.310048+0000","last_clean":"2024-04-23T23:41:19.310048+0000","last_became_active":"2024-04-23T23:40:58.005152+0000","last_became_peered":"2024-04-23T23:40:58.005152+0000","last_unstale":"2024-04-23T23:41:19.310048+0000","last_undegraded":"2024-04-23T23:41:19.310048+0000","last_fullsized":"2024-04-23T23:41:19.310048+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:19.309933+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:19.309933+0000","last_clean_scrub_stamp":"2024-04-23T23:41:19.309933+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T09:03:08.430509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"217'869","reported_seq":4049,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:22.946753+0000","last_change":"2024-04-23T23:41:22.946799+0000","last_active":"2024-04-23T23:41:22.946753+0000","last_peered":"2024-04-23T23:41:22.946753+0000","last_clean":"2024-04-23T23:41:22.946753+0000","last_became_active":"2024-04-23T23:41:08.059165+0000","last_became_peered":"2024-04-23T23:41:08.059165+0000","last_unstale":"2024-04-23T23:41:22.946753+0000","last_undegraded":"2024-04-23T23:41:22.946753+0000","last_fullsized":"2024-04-23T23:41:22.946753+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'869","last_scrub_stamp":"2024-04-23T23:41:22.946661+0000","last_deep_scrub":"217'869","last_deep_scrub_stamp":"2024-04-23T23:41:22.946661+0000","last_clean_scrub_stamp":"2024-04-23T23:41:22.946661+0000","objects_scrubbed":42,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:44:19.931997+0000","scrub_duration":27,"objects_trimmed":4,"snaptrim_duration":0.00060609599999999998,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":5950,"num_read_kb":29696,"num_write":1153,"num_write_kb":26165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":12357570,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"217'780","reported_seq":8608,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.636701+0000","last_change":"2024-04-23T23:41:20.636745+0000","last_active":"2024-04-23T23:41:20.636701+0000","last_peered":"2024-04-23T23:41:20.636701+0000","last_clean":"2024-04-23T23:41:20.636701+0000","last_became_active":"2024-04-23T23:40:14.832911+0000","last_became_peered":"2024-04-23T23:40:14.832911+0000","last_unstale":"2024-04-23T23:41:20.636701+0000","last_undegraded":"2024-04-23T23:41:20.636701+0000","last_fullsized":"2024-04-23T23:41:20.636701+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'780","last_scrub_stamp":"2024-04-23T23:41:20.636579+0000","last_deep_scrub":"217'780","last_deep_scrub_stamp":"2024-04-23T23:41:20.636579+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.636579+0000","objects_scrubbed":32,"log_size":780,"log_dups_size":0,"ondisk_log_size":780,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:08:14.742411+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.0016437419999999999,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":31,"num_read":7777,"num_read_kb":31267,"num_write":805,"num_write_kb":18581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":369,"num_bytes_recovered":16344957,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":376,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:23.885280+0000","last_change":"2024-04-23T23:41:23.885304+0000","last_active":"2024-04-23T23:41:23.885280+0000","last_peered":"2024-04-23T23:41:23.885280+0000","last_clean":"2024-04-23T23:41:23.885280+0000","last_became_active":"2024-04-23T23:41:08.169242+0000","last_became_peered":"2024-04-23T23:41:08.169242+0000","last_unstale":"2024-04-23T23:41:23.885280+0000","last_undegraded":"2024-04-23T23:41:23.885280+0000","last_fullsized":"2024-04-23T23:41:23.885280+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:23.885168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:23.885168+0000","last_clean_scrub_stamp":"2024-04-23T23:41:23.885168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T11:34:36.240528+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"217'581","reported_seq":4028,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:17.329340+0000","last_change":"2024-04-23T23:41:17.329340+0000","last_active":"2024-04-23T23:41:17.329340+0000","last_peered":"2024-04-23T23:41:17.329340+0000","last_clean":"2024-04-23T23:41:17.329340+0000","last_became_active":"2024-04-23T23:40:57.996726+0000","last_became_peered":"2024-04-23T23:40:57.996726+0000","last_unstale":"2024-04-23T23:41:17.329340+0000","last_undegraded":"2024-04-23T23:41:17.329340+0000","last_fullsized":"2024-04-23T23:41:17.329340+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'581","last_scrub_stamp":"2024-04-23T23:41:17.329175+0000","last_deep_scrub":"217'581","last_deep_scrub_stamp":"2024-04-23T23:41:17.329175+0000","last_clean_scrub_stamp":"2024-04-23T23:41:17.329175+0000","objects_scrubbed":39,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:17:12.484599+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.00063417200000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":3796,"num_read_kb":45534,"num_write":709,"num_write_kb":72444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":436,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.228752+0000","last_change":"2024-04-23T23:41:18.228752+0000","last_active":"2024-04-23T23:41:18.228752+0000","last_peered":"2024-04-23T23:41:18.228752+0000","last_clean":"2024-04-23T23:41:18.228752+0000","last_became_active":"2024-04-23T23:40:53.840652+0000","last_became_peered":"2024-04-23T23:40:53.840652+0000","last_unstale":"2024-04-23T23:41:18.228752+0000","last_undegraded":"2024-04-23T23:41:18.228752+0000","last_fullsized":"2024-04-23T23:41:18.228752+0000","mapping_epoch":201,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:18.228618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:18.228618+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.228618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:37:05.389570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"217'732","reported_seq":6732,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:21.635952+0000","last_change":"2024-04-23T23:41:21.636007+0000","last_active":"2024-04-23T23:41:21.635952+0000","last_peered":"2024-04-23T23:41:21.635952+0000","last_clean":"2024-04-23T23:41:21.635952+0000","last_became_active":"2024-04-23T23:41:03.841065+0000","last_became_peered":"2024-04-23T23:41:03.841065+0000","last_unstale":"2024-04-23T23:41:21.635952+0000","last_undegraded":"2024-04-23T23:41:21.635952+0000","last_fullsized":"2024-04-23T23:41:21.635952+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'732","last_scrub_stamp":"2024-04-23T23:41:21.635868+0000","last_deep_scrub":"217'732","last_deep_scrub_stamp":"2024-04-23T23:41:21.635868+0000","last_clean_scrub_stamp":"2024-04-23T23:41:21.635868+0000","objects_scrubbed":38,"log_size":732,"log_dups_size":0,"ondisk_log_size":732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:42:06.716301+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.0020510519999999998,"stat_sum":{"num_bytes":0,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":38,"num_read":6126,"num_read_kb":25420,"num_write":951,"num_write_kb":14230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":704,"num_bytes_recovered":12002781,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":298,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:25.918049+0000","last_change":"2024-04-23T23:41:25.918074+0000","last_active":"2024-04-23T23:41:25.918049+0000","last_peered":"2024-04-23T23:41:25.918049+0000","last_clean":"2024-04-23T23:41:25.918049+0000","last_became_active":"2024-04-23T23:41:06.111154+0000","last_became_peered":"2024-04-23T23:41:06.111154+0000","last_unstale":"2024-04-23T23:41:25.918049+0000","last_undegraded":"2024-04-23T23:41:25.918049+0000","last_fullsized":"2024-04-23T23:41:25.918049+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:25.917955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:25.917955+0000","last_clean_scrub_stamp":"2024-04-23T23:41:25.917955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T05:40:49.834999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"217'814","reported_seq":4329,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.993310+0000","last_change":"2024-04-23T23:41:18.993370+0000","last_active":"2024-04-23T23:41:18.993310+0000","last_peered":"2024-04-23T23:41:18.993310+0000","last_clean":"2024-04-23T23:41:18.993310+0000","last_became_active":"2024-04-23T23:40:58.004398+0000","last_became_peered":"2024-04-23T23:40:58.004398+0000","last_unstale":"2024-04-23T23:41:18.993310+0000","last_undegraded":"2024-04-23T23:41:18.993310+0000","last_fullsized":"2024-04-23T23:41:18.993310+0000","mapping_epoch":205,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":206,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'814","last_scrub_stamp":"2024-04-23T23:41:18.993228+0000","last_deep_scrub":"217'814","last_deep_scrub_stamp":"2024-04-23T23:41:18.993228+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.993228+0000","objects_scrubbed":33,"log_size":814,"log_dups_size":0,"ondisk_log_size":814,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:35:13.773441+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0.00068418600000000004,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":5566,"num_read_kb":13092,"num_write":934,"num_write_kb":5259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":185,"num_bytes_recovered":253143,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":205,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.965455+0000","last_change":"2024-04-23T23:41:18.965455+0000","last_active":"2024-04-23T23:41:18.965455+0000","last_peered":"2024-04-23T23:41:18.965455+0000","last_clean":"2024-04-23T23:41:18.965455+0000","last_became_active":"2024-04-23T23:41:08.054900+0000","last_became_peered":"2024-04-23T23:41:08.054900+0000","last_unstale":"2024-04-23T23:41:18.965455+0000","last_undegraded":"2024-04-23T23:41:18.965455+0000","last_fullsized":"2024-04-23T23:41:18.965455+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T23:41:18.965340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T23:41:18.965340+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.965340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:11:06.079416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"217'119","reported_seq":551,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:21.850808+0000","last_change":"2024-04-23T23:41:21.850808+0000","last_active":"2024-04-23T23:41:21.850808+0000","last_peered":"2024-04-23T23:41:21.850808+0000","last_clean":"2024-04-23T23:41:21.850808+0000","last_became_active":"2024-04-23T23:40:13.827343+0000","last_became_peered":"2024-04-23T23:40:13.827343+0000","last_unstale":"2024-04-23T23:41:21.850808+0000","last_undegraded":"2024-04-23T23:41:21.850808+0000","last_fullsized":"2024-04-23T23:41:21.850808+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'119","last_scrub_stamp":"2024-04-23T23:41:21.850643+0000","last_deep_scrub":"217'119","last_deep_scrub_stamp":"2024-04-23T23:41:21.850643+0000","last_clean_scrub_stamp":"2024-04-23T23:41:21.850643+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:03:35.088952+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"217'561","reported_seq":21304,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:17.954824+0000","last_change":"2024-04-23T23:41:17.954902+0000","last_active":"2024-04-23T23:41:17.954824+0000","last_peered":"2024-04-23T23:41:17.954824+0000","last_clean":"2024-04-23T23:41:17.954824+0000","last_became_active":"2024-04-23T23:40:57.003630+0000","last_became_peered":"2024-04-23T23:40:57.003630+0000","last_unstale":"2024-04-23T23:41:17.954824+0000","last_undegraded":"2024-04-23T23:41:17.954824+0000","last_fullsized":"2024-04-23T23:41:17.954824+0000","mapping_epoch":204,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'561","last_scrub_stamp":"2024-04-23T23:41:17.954738+0000","last_deep_scrub":"217'561","last_deep_scrub_stamp":"2024-04-23T23:41:17.954738+0000","last_clean_scrub_stamp":"2024-04-23T23:41:17.954738+0000","objects_scrubbed":46,"log_size":561,"log_dups_size":0,"ondisk_log_size":561,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:01:21.624056+0000","scrub_duration":29,"objects_trimmed":0,"snaptrim_duration":0.00096515200000000005,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":20124,"num_read_kb":46296,"num_write":570,"num_write_kb":24490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":465,"num_bytes_recovered":36791632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"217'585","reported_seq":6012,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:18.634346+0000","last_change":"2024-04-23T23:41:18.634407+0000","last_active":"2024-04-23T23:41:18.634346+0000","last_peered":"2024-04-23T23:41:18.634346+0000","last_clean":"2024-04-23T23:41:18.634346+0000","last_became_active":"2024-04-23T23:39:03.813196+0000","last_became_peered":"2024-04-23T23:39:03.813196+0000","last_unstale":"2024-04-23T23:41:18.634346+0000","last_undegraded":"2024-04-23T23:41:18.634346+0000","last_fullsized":"2024-04-23T23:41:18.634346+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'585","last_scrub_stamp":"2024-04-23T23:41:18.634265+0000","last_deep_scrub":"217'585","last_deep_scrub_stamp":"2024-04-23T23:41:18.634265+0000","last_clean_scrub_stamp":"2024-04-23T23:41:18.634265+0000","objects_scrubbed":43,"log_size":585,"log_dups_size":0,"ondisk_log_size":585,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:59:29.303844+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.0024348400000000002,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":5578,"num_read_kb":29592,"num_write":438,"num_write_kb":29616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":3047238,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"217'1094","reported_seq":14254,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:22.344101+0000","last_change":"2024-04-23T23:41:22.344143+0000","last_active":"2024-04-23T23:41:22.344101+0000","last_peered":"2024-04-23T23:41:22.344101+0000","last_clean":"2024-04-23T23:41:22.344101+0000","last_became_active":"2024-04-23T23:41:03.840571+0000","last_became_peered":"2024-04-23T23:41:03.840571+0000","last_unstale":"2024-04-23T23:41:22.344101+0000","last_undegraded":"2024-04-23T23:41:22.344101+0000","last_fullsized":"2024-04-23T23:41:22.344101+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'1094","last_scrub_stamp":"2024-04-23T23:41:22.344010+0000","last_deep_scrub":"217'1094","last_deep_scrub_stamp":"2024-04-23T23:41:22.344010+0000","last_clean_scrub_stamp":"2024-04-23T23:41:22.344010+0000","objects_scrubbed":33,"log_size":1094,"log_dups_size":0,"ondisk_log_size":1094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T01:23:26.011542+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0.002501264,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":32,"num_read":16413,"num_read_kb":43778,"num_write":1195,"num_write_kb":20605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":171,"num_bytes_recovered":1651220,"num_keys_recovered":100,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"217'632","reported_seq":14920,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:21.061129+0000","last_change":"2024-04-23T23:41:21.061206+0000","last_active":"2024-04-23T23:41:21.061129+0000","last_peered":"2024-04-23T23:41:21.061129+0000","last_clean":"2024-04-23T23:41:21.061129+0000","last_became_active":"2024-04-23T23:40:58.836846+0000","last_became_peered":"2024-04-23T23:40:58.836846+0000","last_unstale":"2024-04-23T23:41:21.061129+0000","last_undegraded":"2024-04-23T23:41:21.061129+0000","last_fullsized":"2024-04-23T23:41:21.061129+0000","mapping_epoch":206,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'632","last_scrub_stamp":"2024-04-23T23:41:21.061036+0000","last_deep_scrub":"217'632","last_deep_scrub_stamp":"2024-04-23T23:41:21.061036+0000","last_clean_scrub_stamp":"2024-04-23T23:41:21.061036+0000","objects_scrubbed":39,"log_size":632,"log_dups_size":0,"ondisk_log_size":632,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T07:25:48.879879+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0.0024163729999999999,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":14272,"num_read_kb":53900,"num_write":529,"num_write_kb":22122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":16696489,"num_keys_recovered":55,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"217'521","reported_seq":17920,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:19.948516+0000","last_change":"2024-04-23T23:41:19.948560+0000","last_active":"2024-04-23T23:41:19.948516+0000","last_peered":"2024-04-23T23:41:19.948516+0000","last_clean":"2024-04-23T23:41:19.948516+0000","last_became_active":"2024-04-23T23:41:08.056850+0000","last_became_peered":"2024-04-23T23:41:08.056850+0000","last_unstale":"2024-04-23T23:41:19.948516+0000","last_undegraded":"2024-04-23T23:41:19.948516+0000","last_fullsized":"2024-04-23T23:41:19.948516+0000","mapping_epoch":215,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":216,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'521","last_scrub_stamp":"2024-04-23T23:41:19.948434+0000","last_deep_scrub":"217'521","last_deep_scrub_stamp":"2024-04-23T23:41:19.948434+0000","last_clean_scrub_stamp":"2024-04-23T23:41:19.948434+0000","objects_scrubbed":44,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T10:42:17.991704+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.001862479,"stat_sum":{"num_bytes":0,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":44,"num_read":16847,"num_read_kb":61100,"num_write":409,"num_write_kb":17414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":1505593,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"217'656","reported_seq":15548,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:24.911588+0000","last_change":"2024-04-23T23:41:24.911644+0000","last_active":"2024-04-23T23:41:24.911588+0000","last_peered":"2024-04-23T23:41:24.911588+0000","last_clean":"2024-04-23T23:41:24.911588+0000","last_became_active":"2024-04-23T23:41:06.042246+0000","last_became_peered":"2024-04-23T23:41:06.042246+0000","last_unstale":"2024-04-23T23:41:24.911588+0000","last_undegraded":"2024-04-23T23:41:24.911588+0000","last_fullsized":"2024-04-23T23:41:24.911588+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'656","last_scrub_stamp":"2024-04-23T23:41:24.911500+0000","last_deep_scrub":"217'656","last_deep_scrub_stamp":"2024-04-23T23:41:24.911500+0000","last_clean_scrub_stamp":"2024-04-23T23:41:24.911500+0000","objects_scrubbed":41,"log_size":656,"log_dups_size":0,"ondisk_log_size":656,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:03:04.118019+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.00099101399999999991,"stat_sum":{"num_bytes":0,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":41,"num_read":15864,"num_read_kb":44538,"num_write":501,"num_write_kb":14137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":289,"num_bytes_recovered":7776002,"num_keys_recovered":84,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"217'900","reported_seq":5715,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:17.279031+0000","last_change":"2024-04-23T23:41:17.279105+0000","last_active":"2024-04-23T23:41:17.279031+0000","last_peered":"2024-04-23T23:41:17.279031+0000","last_clean":"2024-04-23T23:41:17.279031+0000","last_became_active":"2024-04-23T23:39:51.833906+0000","last_became_peered":"2024-04-23T23:39:51.833906+0000","last_unstale":"2024-04-23T23:41:17.279031+0000","last_undegraded":"2024-04-23T23:41:17.279031+0000","last_fullsized":"2024-04-23T23:41:17.279031+0000","mapping_epoch":139,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":140,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'900","last_scrub_stamp":"2024-04-23T23:41:17.278913+0000","last_deep_scrub":"217'900","last_deep_scrub_stamp":"2024-04-23T23:41:17.278913+0000","last_clean_scrub_stamp":"2024-04-23T23:41:17.278913+0000","objects_scrubbed":39,"log_size":900,"log_dups_size":0,"ondisk_log_size":900,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T08:22:40.430610+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.0013327910000000001,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":7553,"num_read_kb":29290,"num_write":953,"num_write_kb":10388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":469,"num_bytes_recovered":17062304,"num_keys_recovered":128,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"217'768","reported_seq":12106,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:21.360240+0000","last_change":"2024-04-23T23:41:21.360289+0000","last_active":"2024-04-23T23:41:21.360240+0000","last_peered":"2024-04-23T23:41:21.360240+0000","last_clean":"2024-04-23T23:41:21.360240+0000","last_became_active":"2024-04-23T23:41:03.839215+0000","last_became_peered":"2024-04-23T23:41:03.839215+0000","last_unstale":"2024-04-23T23:41:21.360240+0000","last_undegraded":"2024-04-23T23:41:21.360240+0000","last_fullsized":"2024-04-23T23:41:21.360240+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'768","last_scrub_stamp":"2024-04-23T23:41:21.360153+0000","last_deep_scrub":"217'768","last_deep_scrub_stamp":"2024-04-23T23:41:21.360153+0000","last_clean_scrub_stamp":"2024-04-23T23:41:21.360153+0000","objects_scrubbed":46,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T06:14:20.423941+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0014039289999999999,"stat_sum":{"num_bytes":0,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":46,"num_read":12380,"num_read_kb":51248,"num_write":743,"num_write_kb":21024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":511,"num_bytes_recovered":24503192,"num_keys_recovered":115,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"217'652","reported_seq":27197,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.348053+0000","last_change":"2024-04-23T23:41:20.348145+0000","last_active":"2024-04-23T23:41:20.348053+0000","last_peered":"2024-04-23T23:41:20.348053+0000","last_clean":"2024-04-23T23:41:20.348053+0000","last_became_active":"2024-04-23T23:40:13.827314+0000","last_became_peered":"2024-04-23T23:40:13.827314+0000","last_unstale":"2024-04-23T23:41:20.348053+0000","last_undegraded":"2024-04-23T23:41:20.348053+0000","last_fullsized":"2024-04-23T23:41:20.348053+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'652","last_scrub_stamp":"2024-04-23T23:41:20.347950+0000","last_deep_scrub":"217'652","last_deep_scrub_stamp":"2024-04-23T23:41:20.347950+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.347950+0000","objects_scrubbed":43,"log_size":652,"log_dups_size":0,"ondisk_log_size":652,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T03:03:53.276506+0000","scrub_duration":34,"objects_trimmed":0,"snaptrim_duration":0.0010328329999999999,"stat_sum":{"num_bytes":0,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":43,"num_read":26442,"num_read_kb":41403,"num_write":644,"num_write_kb":40504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":250,"num_bytes_recovered":12451024,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"217'550","reported_seq":8520,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:23.915856+0000","last_change":"2024-04-23T23:41:23.915905+0000","last_active":"2024-04-23T23:41:23.915856+0000","last_peered":"2024-04-23T23:41:23.915856+0000","last_clean":"2024-04-23T23:41:23.915856+0000","last_became_active":"2024-04-23T23:41:06.040724+0000","last_became_peered":"2024-04-23T23:41:06.040724+0000","last_unstale":"2024-04-23T23:41:23.915856+0000","last_undegraded":"2024-04-23T23:41:23.915856+0000","last_fullsized":"2024-04-23T23:41:23.915856+0000","mapping_epoch":213,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":214,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'550","last_scrub_stamp":"2024-04-23T23:41:23.915764+0000","last_deep_scrub":"217'550","last_deep_scrub_stamp":"2024-04-23T23:41:23.915764+0000","last_clean_scrub_stamp":"2024-04-23T23:41:23.915764+0000","objects_scrubbed":37,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:45:30.205478+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0.0010564039999999999,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":7354,"num_read_kb":67684,"num_write":425,"num_write_kb":19050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":462,"num_bytes_recovered":44177667,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"217'847","reported_seq":7857,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:20.662053+0000","last_change":"2024-04-23T23:41:20.662090+0000","last_active":"2024-04-23T23:41:20.662053+0000","last_peered":"2024-04-23T23:41:20.662053+0000","last_clean":"2024-04-23T23:41:20.662053+0000","last_became_active":"2024-04-23T23:40:16.835687+0000","last_became_peered":"2024-04-23T23:40:16.835687+0000","last_unstale":"2024-04-23T23:41:20.662053+0000","last_undegraded":"2024-04-23T23:41:20.662053+0000","last_fullsized":"2024-04-23T23:41:20.662053+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'847","last_scrub_stamp":"2024-04-23T23:41:20.661966+0000","last_deep_scrub":"217'847","last_deep_scrub_stamp":"2024-04-23T23:41:20.661966+0000","last_clean_scrub_stamp":"2024-04-23T23:41:20.661966+0000","objects_scrubbed":42,"log_size":847,"log_dups_size":0,"ondisk_log_size":847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T04:33:20.375758+0000","scrub_duration":30,"objects_trimmed":0,"snaptrim_duration":0.0017385180000000001,"stat_sum":{"num_bytes":0,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":42,"num_read":9726,"num_read_kb":43246,"num_write":1023,"num_write_kb":24025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":453,"num_bytes_recovered":37273635,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"217'471","reported_seq":5388,"reported_epoch":217,"state":"active+clean","last_fresh":"2024-04-23T23:41:19.790508+0000","last_change":"2024-04-23T23:41:19.790566+0000","last_active":"2024-04-23T23:41:19.790508+0000","last_peered":"2024-04-23T23:41:19.790508+0000","last_clean":"2024-04-23T23:41:19.790508+0000","last_became_active":"2024-04-23T23:39:33.117899+0000","last_became_peered":"2024-04-23T23:39:33.117899+0000","last_unstale":"2024-04-23T23:41:19.790508+0000","last_undegraded":"2024-04-23T23:41:19.790508+0000","last_fullsized":"2024-04-23T23:41:19.790508+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'471","last_scrub_stamp":"2024-04-23T23:41:19.790391+0000","last_deep_scrub":"217'471","last_deep_scrub_stamp":"2024-04-23T23:41:19.790391+0000","last_clean_scrub_stamp":"2024-04-23T23:41:19.790391+0000","objects_scrubbed":34,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T02:46:30.256485+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.001912502,"stat_sum":{"num_bytes":0,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":34,"num_read":5095,"num_read_kb":30414,"num_write":392,"num_write_kb":10335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":4559364,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1292,"num_object_clones":0,"num_object_copies":2584,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1292,"num_whiteouts":1288,"num_read":358249,"num_read_kb":1270143,"num_write":24047,"num_write_kb":705443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10860,"num_bytes_recovered":523520846,"num_keys_recovered":1201,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3289,"internal_metadata":0},"log_size":23208,"ondisk_log_size":23208,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":4}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542201,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47632,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324208,"statfs":{"total":96636764160,"available":96587988992,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66192,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":63038,"kb_avail":94305648,"statfs":{"total":96636764160,"available":96568983552,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":64551370},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51788,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320052,"statfs":{"total":96636764160,"available":96583733248,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855407,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65356,"kb_used_data":2564,"kb_used_omap":4,"kb_used_meta":62779,"kb_avail":94306484,"statfs":{"total":96636764160,"available":96569839616,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4498,"internal_metadata":64286318},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51792,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320048,"statfs":{"total":96636764160,"available":96583729152,"internally_reserved":0,"allocated":2629632,"data_stored":1282538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":147,"seq":631360192534,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42764,"kb_used_data":2564,"kb_used_omap":6,"kb_used_meta":40185,"kb_avail":94329076,"statfs":{"total":96636764160,"available":96592973824,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6982,"internal_metadata":41149626},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55948,"kb_used_data":2564,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94315892,"statfs":{"total":96636764160,"available":96579473408,"internally_reserved":0,"allocated":2625536,"data_stored":1282519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60688,"kb_used_data":3144,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94311152,"statfs":{"total":96636764160,"available":96574619648,"internally_reserved":0,"allocated":3219456,"data_stored":1872887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2034,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1255,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T23:41:39.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T23:41:39.721 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T23:41:39.722 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T23:41:39.722 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T23:41:39.722 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:39.763 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T23:41:39.763 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T23:41:39.763 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:39.794 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T23:41:39.794 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T23:41:39.795 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:39.872 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T23:41:39.872 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T23:41:39.873 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:39.944 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T23:41:39.944 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-23T23:41:39.944 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:39.992 INFO:tasks.ceph.osd.4:Stopped 2024-04-23T23:41:39.992 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-23T23:41:39.992 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.030 INFO:tasks.ceph.osd.5:Stopped 2024-04-23T23:41:40.031 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-23T23:41:40.031 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.108 INFO:tasks.ceph.osd.6:Stopped 2024-04-23T23:41:40.108 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-23T23:41:40.108 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.178 INFO:tasks.ceph.osd.7:Stopped 2024-04-23T23:41:40.178 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T23:41:40.178 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-23T23:41:40.178 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.202 INFO:tasks.ceph.mgr.y:Stopped 2024-04-23T23:41:40.202 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T23:41:40.202 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.247 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T23:41:40.247 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T23:41:40.248 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T23:41:40.248 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.260 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T23:41:40.260 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-23T23:41:40.260 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.311 INFO:tasks.ceph.mon.c:Stopped 2024-04-23T23:41:40.311 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-23T23:41:40.311 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T23:41:40.327 INFO:tasks.ceph.mon.b:Stopped 2024-04-23T23:41:40.327 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T23:41:40.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | head -n 1 2024-04-23T23:41:40.400 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:41:40.401 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T23:41:40.558 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:41:40.558 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T23:41:40.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:41:40.622 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T23:41:40.687 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:41:40.687 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T23:41:40.736 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:41:40.736 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-23T23:41:40.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:41:40.911 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-23T23:41:41.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:41:41.016 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-23T23:41:41.063 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:41:41.063 DEBUG:teuthology.orchestra.run.smithi170:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-23T23:41:41.115 INFO:tasks.ceph:Archiving mon data... 2024-04-23T23:41:41.116 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/data/mon.a.tgz 2024-04-23T23:41:41.116 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-04-23T23:41:41.131 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.chxn0Rok7l 2024-04-23T23:41:41.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.chxn0Rok7l 2024-04-23T23:41:41.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.chxn0Rok7l 2024-04-23T23:41:41.396 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.chxn0Rok7l is 458KB 2024-04-23T23:41:41.495 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.chxn0Rok7l 2024-04-23T23:41:41.509 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/data/mon.c.tgz 2024-04-23T23:41:41.510 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-04-23T23:41:41.562 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.AdUbBDdtLh 2024-04-23T23:41:41.563 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AdUbBDdtLh 2024-04-23T23:41:41.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.AdUbBDdtLh 2024-04-23T23:41:41.830 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.AdUbBDdtLh is 621KB 2024-04-23T23:41:41.930 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.AdUbBDdtLh 2024-04-23T23:41:41.944 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/data/mon.b.tgz 2024-04-23T23:41:41.945 DEBUG:teuthology.orchestra.run.smithi170:> mktemp 2024-04-23T23:41:41.963 INFO:teuthology.orchestra.run.smithi170.stdout:/tmp/tmp.12dC6SUOjl 2024-04-23T23:41:41.963 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.12dC6SUOjl 2024-04-23T23:41:42.174 DEBUG:teuthology.orchestra.run.smithi170:> sudo chmod 0666 /tmp/tmp.12dC6SUOjl 2024-04-23T23:41:42.254 DEBUG:teuthology.orchestra.remote:smithi170:/tmp/tmp.12dC6SUOjl is 621KB 2024-04-23T23:41:42.354 DEBUG:teuthology.orchestra.run.smithi170:> rm -fr /tmp/tmp.12dC6SUOjl 2024-04-23T23:41:42.370 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T23:41:42.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T23:41:42.373 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T23:41:42.449 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T23:41:42.486 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T23:41:42.487 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T23:41:42.488 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/remote/smithi077/crash 2024-04-23T23:41:42.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T23:41:42.513 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/remote/smithi170/crash 2024-04-23T23:41:42.514 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T23:41:42.549 INFO:tasks.ceph:Compressing logs... 2024-04-23T23:41:42.549 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T23:41:42.558 DEBUG:teuthology.orchestra.run.smithi170:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T23:41:42.635 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31752.log 2024-04-23T23:41:42.635 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31661.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31752.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31752.log.gz 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31661.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.39038.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31661.log.gz 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.39861.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/objectstore_tool.39038.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.37332.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/objectstore_tool.39861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31792.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/objectstore_tool.37332.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31712.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31792.log.gz 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph.audit.log: 84.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31712.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-23T23:41:42.636 INFO:teuthology.orchestra.run.smithi170.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31712.log.gz 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31621.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31581.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31621.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31581.log.gz 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31872.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-osd.6.log: 95.0% -- replaced with /var/log/ceph/objectstore_tool.39038.log.gz 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr: 94.9% -- replaced with /var/log/ceph/objectstore_tool.39861.log.gz 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/objectstore_tool.38155.log 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.37332.log.gz 2024-04-23T23:41:42.637 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/ceph-client.admin.31872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31872.log.gz 2024-04-23T23:41:42.638 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-23T23:41:42.638 INFO:teuthology.orchestra.run.smithi170.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-04-23T23:41:42.638 INFO:teuthology.orchestra.run.smithi170.stderr:/var/log/ceph/objectstore_tool.38155.log: /var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.admin.31832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-04-23T23:41:42.638 INFO:teuthology.orchestra.run.smithi170.stderr: 95.1% -- replaced with /var/log/ceph/objectstore_tool.38155.log.gz 2024-04-23T23:41:42.710 INFO:teuthology.orchestra.run.smithi170.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T23:41:42.739 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55004.log 2024-04-23T23:41:42.739 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47690.log 2024-04-23T23:41:42.739 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53535.log 2024-04-23T23:41:42.739 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55004.log.gz 2024-04-23T23:41:42.739 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59387.log 2024-04-23T23:41:42.739 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47690.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32318.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53535.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58919.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59387.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38561.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53493.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58919.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38283.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38561.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42157.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53493.log.gz 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41386.log 2024-04-23T23:41:42.740 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38283.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51040.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42157.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41386.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54964.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51040.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63669.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63249.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54964.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53812.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63669.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38481.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63249.log.gz 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39027.log 2024-04-23T23:41:42.741 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53812.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46944.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38481.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57381.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39027.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51297.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46944.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55325.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57381.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65307.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51297.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46825.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55325.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63976.log 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65307.log.gz 2024-04-23T23:41:42.742 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62950.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46825.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61144.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63976.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38221.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62950.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61144.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51788.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38221.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65265.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52665.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51788.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59488.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65265.log.gz 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55283.log 2024-04-23T23:41:42.743 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52665.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37767.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59488.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61024.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55283.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63501.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37767.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56806.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61024.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63501.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63501.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.56806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47732.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56806.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60903.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44981.log 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47732.log.gz 2024-04-23T23:41:42.744 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37946.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60903.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46522.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44981.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46039.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37946.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46522.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46522.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45922.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46039.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60746.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54887.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45922.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 91.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39551.log 2024-04-23T23:41:42.745 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60746.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54887.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.52841.log -- replaced with /var/log/ceph/ceph-client.admin.54887.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63973.log 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39551.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52800.log 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52841.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61804.log 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63973.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65769.log 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52800.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45781.log 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61804.log.gz 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60024.log 2024-04-23T23:41:42.746 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65769.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45781.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59096.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60024.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64628.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65559.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59096.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52937.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64628.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65559.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39131.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61824.log 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52937.log.gz 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39131.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.39131.log.gz --verbose 2024-04-23T23:41:42.747 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.65601.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46181.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61824.log.gz 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46703.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65601.log.gz 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43689.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46181.log.gz 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46703.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46703.log.gz 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48071.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43689.log.gz 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63543.log 2024-04-23T23:41:42.748 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60964.log 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48071.log.gz 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65727.log 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63543.log.gz 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60964.log.gz 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37948.log 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57582.log 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65727.log.gz 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37948.log.gz 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62644.log 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53988.log 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57582.log.gz 2024-04-23T23:41:42.749 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62644.log.gz 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63967.log 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53988.log: gzip 93.6% -5 -- replaced with /var/log/ceph/ceph.audit.log.gz --verbose 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-client.admin.57001.log 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53988.log.gz 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37683.log 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63967.log.gz 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38619.log 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57001.log.gz 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37683.log.gz 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65517.log 2024-04-23T23:41:42.750 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38619.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50444.log 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52149.log 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65517.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42969.log 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50444.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54145.log 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52149.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44065.log 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42969.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64303.log 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54145.log.gz 2024-04-23T23:41:42.751 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37454.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44065.log.gz 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64303.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64303.log.gz 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46357.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37454.log.gz 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44645.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46357.log.gz 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44645.log.gz 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62806.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64313.log 2024-04-23T23:41:42.752 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62806.log.gz 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63627.log 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50606.log 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64313.log.gz 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63627.log.gz 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63459.log 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38558.log 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50606.log.gz 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63459.log.gz 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51414.log 2024-04-23T23:41:42.753 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38558.log.gz 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65013.log 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64670.log 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51414.log.gz 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50763.log 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65013.log.gz 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46723.log 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64670.log.gz 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50763.log.gz 2024-04-23T23:41:42.754 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39996.log 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63585.log 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46723.log.gz 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39996.log.gz 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60803.log 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63795.log 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63585.log.gz 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60803.log.gz 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62908.log 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53867.log 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63795.log.gz 2024-04-23T23:41:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62908.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63291.log 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32437.log 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53867.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63291.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54885.log 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32437.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42475.log 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50167.log 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54885.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42475.log.gz 2024-04-23T23:41:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45021.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44304.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50167.log.gz 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45021.log.gz 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62992.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44304.log.gz 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63972.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62992.log.gz 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52523.log 2024-04-23T23:41:42.757 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50804.log 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63972.log.gz 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52523.log.gz 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63711.log 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43391.log 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50804.log.gz 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63711.log.gz 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64309.log 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43391.log.gz 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64309.log: gzip -5 --verbose -- /var/log/ceph/objectstore_tool.48696.log 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64309.log.gz 2024-04-23T23:41:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65853.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/objectstore_tool.48696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37599.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65853.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65853.log.gz 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr: -- /var/log/ceph/ceph-osd.0.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37599.log.gz 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40426.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47350.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40426.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45362.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40426.log.gz 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63975.log 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47350.log.gz 2024-04-23T23:41:42.759 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45362.log.gz 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42912.log 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr: 93.4%/var/log/ceph/ceph-client.admin.63975.log: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63975.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39069.log 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59545.log 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42912.log: /var/log/ceph/ceph-client.admin.39069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63417.log 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42912.log.gz 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39069.log.gz 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59801.log 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59545.log.gz 2024-04-23T23:41:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60843.log 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63417.log: /var/log/ceph/ceph-client.admin.59801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62345.log 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63417.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59801.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60843.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52092.log 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53444.log 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62345.log: /var/log/ceph/ceph-client.admin.52092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50389.log 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62345.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr: 94.9% -- replaced with /var/log/ceph/objectstore_tool.48696.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52092.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53444.log.gz 2024-04-23T23:41:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57881.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50389.log.gz 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59728.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57881.log.gz 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54228.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63333.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59728.log.gz 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64306.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54228.log.gz 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65391.log 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63333.log: /var/log/ceph/ceph-client.admin.64306.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64306.log.gz 2024-04-23T23:41:42.762 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64509.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63333.log.gz 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65391.log.gz 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48560.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64509.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48009.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64509.log.gz 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55953.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48560.log.gz 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.48009.log: -- /var/log/ceph/ceph-client.admin.40708.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48009.log.gz 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55953.log.gz 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63165.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65475.log 2024-04-23T23:41:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40708.log.gz 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60705.log 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63165.log: /var/log/ceph/ceph-client.admin.65475.log: 0.0%gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65475.log.gz 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63165.log.gz 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60705.log.gz 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50721.log 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45701.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50721.log.gz 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41049.log 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39694.log 2024-04-23T23:41:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41049.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47308.log 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41049.log.gz 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62084.log 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39694.log: /var/log/ceph/ceph-client.admin.47308.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39694.log.gz 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47308.log.gz 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49089.log 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62084.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.62084.log.gz 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54587.log 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49089.log: -- /var/log/ceph/ceph-client.admin.54270.log 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49089.log.gz 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58658.log 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54587.log.gz 2024-04-23T23:41:42.765 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54270.log.gz 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58658.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.58658.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.61700.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62543.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61700.log: /var/log/ceph/ceph-client.admin.38943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61700.log.gz 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37947.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62543.log.gzgzip 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.64623.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37947.log.gz 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39269.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58120.log 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64623.log.gz 2024-04-23T23:41:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39269.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59927.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39269.log.gz 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58120.log.gz 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63974.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57699.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59927.log.gz 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63974.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53119.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57699.log.gz 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58200.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53169.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53119.log.gz 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58200.log.gzgzip 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53169.log.gz 2024-04-23T23:41:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32016.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64173.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32016.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58715.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64173.log.gz 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42354.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38560.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58715.log.gz 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42354.log.gz 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64629.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38560.log.gz 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38209.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38623.log 2024-04-23T23:41:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64629.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38209.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49873.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38623.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40093.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49873.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.39182.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40093.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64311.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49555.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.0.39182.log: /var/log/ceph/ceph-client.admin.64311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64311.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.0.39182.log.gz 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26153.log 2024-04-23T23:41:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49555.log: /var/log/ceph/ceph.tmp-client.admin.26153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49555.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26153.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54547.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51516.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54547.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37940.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.51516.log: -- /var/log/ceph/ceph-client.admin.52426.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51516.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.37940.log: -- /var/log/ceph/ceph-client.admin.55655.log 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37940.log.gz 2024-04-23T23:41:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.52426.log: -- /var/log/ceph/ceph-client.admin.62707.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52426.log.gz 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.55655.log: /var/log/ceph/ceph-client.admin.55855.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55655.log.gz 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51095.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62707.log.gz 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55855.log.gz 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64305.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51095.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55068.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64305.log.gz 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63034.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57500.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55068.log.gz 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63034.log.gzgzip 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.60467.log 2024-04-23T23:41:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57500.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58360.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48328.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60467.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58360.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50111.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48328.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37945.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38224.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50111.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37945.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37949.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37945.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38224.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65223.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37949.log.gz 2024-04-23T23:41:42.772 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65223.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37641.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65685.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37641.log.gz 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64845.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65685.log.gz 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37725.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42095.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64845.log.gz 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37725.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37725.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.39751.log 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42095.log.gz 2024-04-23T23:41:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38985.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51691.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39751.log.gz 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38985.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65349.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38985.log.gz 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51691.log.gz 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65433.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64929.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65349.log.gz 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65433.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38225.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64929.log.gz 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61483.log 2024-04-23T23:41:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38225.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61483.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62748.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65811.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46318.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62748.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65811.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63977.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46318.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38618.log 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63977.log.gz 2024-04-23T23:41:42.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61381.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38618.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64529.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63123.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61381.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64529.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41151.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63123.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47239.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46582.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41151.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47239.log.gz 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2024-04-23T23:41:42.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.46582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46582.log.gz 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65893.log 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52466.log 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65893.log.gz 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54311.log 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52466.log.gz 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63207.log 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54311.log.gz 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63207.log.gz 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43908.log 2024-04-23T23:41:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.48445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62304.log 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51849.log 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43908.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62304.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39265.log 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51849.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64887.log 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39265.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62206.log 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64887.log.gz 2024-04-23T23:41:42.778 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61084.log 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54765.log 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.62206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62206.log.gz 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61084.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64622.log 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54765.log.gz 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47573.log 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57300.log 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64622.log.gz 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47573.log.gz 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59138.log 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57300.log: 26.7% -- replaced with /var/log/ceph/ceph-client.admin.57300.log.gz 2024-04-23T23:41:42.779 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58757.log 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44466.log 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.59138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59138.log.gz 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58757.log.gz 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54027.log 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44466.log.gz 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60227.log 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52052.log 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.54027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54027.log.gz 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60227.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39449.log 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.780 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52052.log.gz 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49738.log 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37944.log 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.39449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39449.log.gz 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49738.log.gz 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65139.log 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37944.log.gz 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64671.log 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65139.log.gz 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 2024-04-23T23:41:42.781 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64671.log.gz 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50070.log 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61761.log 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.44924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.50070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50070.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61303.log 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61761.log.gz 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38285.log 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61303.log.gz 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-04-23T23:41:42.782 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41703.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38285.log.gz 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53296.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55540.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41703.log.gz 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53296.log.gz 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63081.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.55540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55540.log.gz 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41764.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38817.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63081.log.gz 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41764.log.gz 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53650.log 2024-04-23T23:41:42.783 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38817.log.gz 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38219.log 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63971.log 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.53650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53650.log.gz 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38219.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42633.log 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63971.log.gz 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52194.log 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63375.log 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42633.log.gz 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.52194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52194.log.gz 2024-04-23T23:41:42.784 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42673.log 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63375.log.gz 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47238.log 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64308.log 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.42673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42673.log.gz 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.47238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47238.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41920.log 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64308.log.gz 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37941.log 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58319.log 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.41920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41920.log.gz 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.37941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37941.log.gz 2024-04-23T23:41:42.785 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45721.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.58319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58319.log.gz 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64971.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51296.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.45721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45721.log.gz 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.64971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64971.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61903.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.51296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51296.log.gz 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49811.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65055.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.61903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61903.log.gz 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.49811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49811.log.gz 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65055.log.gz 2024-04-23T23:41:42.786 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40193.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57938.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.43151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.40193.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57104.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40193.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57938.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38284.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65097.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.57104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57104.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.38284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38284.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63753.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65097.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65181.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60366.log 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.63753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63753.log.gz 2024-04-23T23:41:42.787 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.65181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65181.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60309.log 2024-04-23T23:41:42.788 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:42.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60366.log.gz 2024-04-23T23:41:42.788 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65643.log 2024-04-23T23:41:42.788 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.60309.log: 0.0%/var/log/ceph/ceph-client.admin.65643.log: -- replaced with /var/log/ceph/ceph-client.admin.60309.log.gz 2024-04-23T23:41:42.788 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65643.log.gz 2024-04-23T23:41:42.788 INFO:teuthology.orchestra.run.smithi077.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-23T23:41:42.808 INFO:teuthology.orchestra.run.smithi170.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-23T23:41:43.059 INFO:teuthology.orchestra.run.smithi077.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T23:41:43.864 INFO:teuthology.orchestra.run.smithi077.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T23:41:43.903 INFO:teuthology.orchestra.run.smithi077.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T23:41:45.646 INFO:teuthology.orchestra.run.smithi170.stderr: 96.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-23T23:41:45.831 INFO:teuthology.orchestra.run.smithi077.stderr: 95.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T23:41:46.243 INFO:teuthology.orchestra.run.smithi170.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-23T23:41:48.160 INFO:teuthology.orchestra.run.smithi077.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T23:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-04-23T23:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m5.593s 2024-04-23T23:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m11.602s 2024-04-23T23:41:48.162 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.589s 2024-04-23T23:41:51.629 INFO:teuthology.orchestra.run.smithi170.stderr: 95.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-23T23:41:53.470 INFO:teuthology.orchestra.run.smithi170.stderr: 95.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-23T23:41:53.472 INFO:teuthology.orchestra.run.smithi170.stderr: 2024-04-23T23:41:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:real 0m10.865s 2024-04-23T23:41:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:user 0m25.767s 2024-04-23T23:41:53.472 INFO:teuthology.orchestra.run.smithi170.stderr:sys 0m1.028s 2024-04-23T23:41:53.473 INFO:tasks.ceph:Archiving logs... 2024-04-23T23:41:53.473 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/remote/smithi077/log 2024-04-23T23:41:53.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T23:41:55.333 DEBUG:teuthology.misc:Transferring archived files from smithi170:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/remote/smithi170/log 2024-04-23T23:41:55.334 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T23:41:58.589 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T23:41:58.599 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T23:41:58.599 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T23:41:58.602 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T23:41:58.686 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T23:41:58.695 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T23:41:58.696 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T23:41:58.698 DEBUG:teuthology.orchestra.run.smithi170:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T23:41:58.712 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-04-23T23:41:58.714 INFO:teuthology.orchestra.run.smithi170.stderr:bash: line 1: ntpq: command not found 2024-04-23T23:41:58.717 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T23:41:58.717 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-04-23T23:41:58.717 INFO:teuthology.orchestra.run.smithi077.stdout:^- hv01.front.sepia.ceph.com 2 6 377 38 +1604us[+1605us] +/- 581ms 2024-04-23T23:41:58.717 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -440us[ -440us] +/- 78ms 2024-04-23T23:41:58.717 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv03.front.sepia.ceph.com 3 6 377 37 +425us[ +427us] +/- 74ms 2024-04-23T23:41:58.718 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:41:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-23T23:41:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:=============================================================================== 2024-04-23T23:41:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:^- hv01.front.sepia.ceph.com 2 6 377 37 +1620us[+1623us] +/- 581ms 2024-04-23T23:41:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -456us[ -456us] +/- 78ms 2024-04-23T23:41:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:^* hv03.front.sepia.ceph.com 3 6 377 37 +423us[ +426us] +/- 74ms 2024-04-23T23:41:58.719 INFO:teuthology.orchestra.run.smithi170.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-23T23:41:58.720 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T23:41:58.729 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T23:41:58.730 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T23:41:58.778 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T23:41:58.862 DEBUG:teuthology.orchestra.run.smithi170:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-23T23:41:58.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T23:41:58.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:41:58.969 DEBUG:teuthology.orchestra.run.smithi170:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-23T23:41:58.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:41:58.998 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T23:41:59.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T23:41:59.037 INFO:teuthology.task.internal:Duration was 701.970834 seconds 2024-04-23T23:41:59.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T23:41:59.087 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T23:41:59.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T23:41:59.090 DEBUG:teuthology.orchestra.run.smithi170:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T23:41:59.125 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T23:41:59.128 INFO:teuthology.orchestra.run.smithi170.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-23T23:41:59.378 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T23:41:59.379 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-04-23T23:41:59.379 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T23:41:59.398 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi170.front.sepia.ceph.com 2024-04-23T23:41:59.398 DEBUG:teuthology.orchestra.run.smithi170:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T23:41:59.443 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T23:41:59.443 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T23:41:59.445 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T23:41:59.508 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T23:41:59.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T23:41:59.511 DEBUG:teuthology.orchestra.run.smithi170:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T23:41:59.664 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T23:41:59.675 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T23:41:59.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T23:41:59.698 DEBUG:teuthology.orchestra.run.smithi170:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T23:41:59.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T23:41:59.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T23:41:59.742 DEBUG:teuthology.orchestra.run.smithi170:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T23:41:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-04-23T23:41:59.787 INFO:teuthology.orchestra.run.smithi170.stdout:kernel.core_pattern = core 2024-04-23T23:41:59.826 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T23:41:59.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:41:59.840 DEBUG:teuthology.orchestra.run.smithi170:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T23:41:59.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T23:41:59.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T23:41:59.898 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T23:41:59.898 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/remote/smithi077 2024-04-23T23:41:59.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T23:41:59.938 DEBUG:teuthology.misc:Transferring archived files from smithi170:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-23_21:16:02-rbd-squid-distro-default-smithi/7670477/remote/smithi170 2024-04-23T23:41:59.938 DEBUG:teuthology.orchestra.run.smithi170:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T23:41:59.970 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T23:41:59.970 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T23:41:59.973 DEBUG:teuthology.orchestra.run.smithi170:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T23:42:00.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T23:42:00.031 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T23:42:00.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T23:42:00.062 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T23:42:00.062 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T23:42:00.064 DEBUG:teuthology.orchestra.run.smithi170:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T23:42:00.076 INFO:teuthology.orchestra.run.smithi077.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 23:41 /home/ubuntu/cephtest 2024-04-23T23:42:00.078 INFO:teuthology.orchestra.run.smithi170.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 23:42 /home/ubuntu/cephtest 2024-04-23T23:42:00.079 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T23:42:00.113 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T23:42:00.215 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writearound} duration: 701.9708340167999 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-23T23:42:00.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T23:42:00.300 INFO:teuthology.run:pass